本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新1286篇论文，其中：
- 自然语言处理135篇
- 信息检索30篇
- 计算机视觉198篇
自然语言处理
1. 【2611.17332】ArchSpace: Recording, Reviewing, and Referencing LLM Architecture Research
链接：https://arxiv.org/abs/2611.17332
作者：Jie Wang,Tong Zhu,JiaHao Kuang,Zhe Xu,Yunkai Chai,Dehong Zheng,Yu Cheng,Tao Ji,ZhouHan Lin,Qi Zhang,Bowen Zhou
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：cost of LLMs, inference cost, central focus, Referencing Architecture Researc, Kimi routinely introduce
备注：
点击查看摘要
Abstract:Model architecture shapes the scaling behavior, training efficiency, and inference cost of LLMs, making it a central focus of both industry and academia. In industry, teams such as those behind DeepSeek, Qwen, and Kimi routinely introduce architectural innovations, yet public reports rarely document which ideas succeeded, which were abandoned, and why. In academia, limited compute and inconsistent baselines often restrict evaluations to small-scale, single-point comparisons, making it difficult to establish whether improvements hold at larger scales or translate into broader impact. ArchSpace addresses both gaps as a public platform for Recording, Reviewing, and Referencing Architecture Researc}: each proposal is recorded with its experiments and reasoning, reviewed by the community, and referenced by later work. To evaluate ideas before costly large-scale training, ArchSpace leverages scaling laws to predict model loss at larger scales from smaller experiments, a practice widely adopted in industry. We provide initial references that make the platform usable: Qwen3.5 and OLMo3 baselines, fitted scaling laws, and a reusable training recipe. Ideas validated through this review can in turn become new baselines, and ArchSpace thereby aims to broaden the range of ideas that shape the next generation of models.
2. 【2611.17320】Learning When Diffusion Language Models Should Regenerate
链接：https://arxiv.org/abs/2611.17320
作者：Minhae Oh,Jeonghye Kim,Jinwoo Koo,Yeongoon Kim,Jimin Seo,Minsik Seol,Jungwoo Lee
类目：Computation and Language (cs.CL)
关键词：effective correction requires, correction requires knowing, revisit generated text, diffusion language models, diffusion language
备注：
点击查看摘要
Abstract:Remasking allows diffusion language models to revisit generated text, but effective correction requires knowing when and what to revise. Our diagnosis on Sudoku reveals two gaps. Hidden states contain error information that token confidence does not reliably expose, and remasking an isolated error usually reproduces it when the surrounding context remains fixed. These findings motivate DiVR , a verifier that predicts whether a partially generated sequence will reach a correct answer. Trained on the final correctness of the model's own trajectories, DiVR decides when to regenerate a block and which alternative to retain, while the generator itself stays unchanged. On five reasoning benchmarks with LLaDA-8B-Base, DiVR raises the average accuracy of the fine-tuned generator from 35.3\% to 43.4\% at $1.9$-$3.5\times$ the cost of greedy decoding, above search baselines that use $3.8$-$7.4\times$. It also complements post-training such as supervised fine-tuning and reinforcement learning, and generalizes to other generators, including Dream.
3. 【2611.17316】CoReMem: Cost-Internalizing Memory for Successive Coding Tasks with Prospective Valuation
链接：https://arxiv.org/abs/2611.17316
作者：Peiwen Li(Yale University),Harshit Verma(Yale University),Sophia Zhou(Yale University),Haiwen Wang(Yale University),Ngoc Bui(Yale University),Heng Chang(Tsinghua University),Fei Fei(Goodvision AI),David van Dijk(Yale University),Rex Ying(Yale University)
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Coding agents tackle, carrying forward edits, agents tackle successive, Coding agents, tackle successive tasks
备注：
点击查看摘要
Abstract:Coding agents tackle successive tasks on an evolving repository, carrying forward edits and writing memory before the next task is known. Selecting memory for unknown next tasks requires balancing future usefulness against the costs of writing and reading it. The actor must also decide when acting on available memory saves effort as the task unfolds. We introduce Coding-Repository Memory (CoReMem), a cost-internalizing framework that guides memory design and actor adaptation through measured memory value on the next task. Prospective segment valuation compares runs of the next task with and without individual trajectory segments from the same inherited repository state, guiding a compact memory built around anchors: repository locations and executable checks. Actor adaptation estimates on-policy memory value within rollout groups with and without memory, using a reward that prioritizes resolution and penalizes step count in successful runs. Provenance-gated value credit assigns the additional value term to steps identified as using memory-supplied anchors, while every step retains outcome credit. On ChainSWE, CoReMem raises the 27B actor's resolve rate from 21.0% to 25.7%, with 17% fewer steps and 11% fewer total cache-aware tokens, including memory-module calls, relative to the untrained actor model without memory.
4. 【2611.17314】Linking Rapid Learning to Compositional Structure in Neural Networks: Evidence from Additive Analogies in Meta-Learned Parameter Spaces
链接：https://arxiv.org/abs/2611.17314
作者：Abigail L. Tenenbaum,R. Thomas McCoy
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：typically require extensive, networks typically require, require extensive training, neural networks, neural networks typically
备注： 24 pages plus references and appendices
点击查看摘要
Abstract:Humans can learn rapidly from limited experience, while neural networks typically require extensive training. In this work, we investigate what properties of a neural network can enable it to learn rapidly. We study neural networks that have been optimized via meta-learning, a technique that exposes a network to many related functions to facilitate its subsequent learning of similar functions. Prior work has shown that these meta-learned networks can learn new functions rapidly, but how they do so remains unclear. To investigate their internal structure, we take inspiration from classic work demonstrating additive relationships among the learned vectors that neural networks use to represent words (e.g., "king" minus "man" plus "woman" approximates "queen"). Analogously, we look for additive relationships among a meta-learned network's "representations" of different functions; when a meta-learned network rapidly learns to implement a specific function, all of its adapted parameter values can be concatenated into a single vector that we treat as representing the function. We find that such parameter vectors can be added and subtracted according to symbolic relationships among the functions they represent, yielding new parameter vectors that successfully represent the functions predicted by the corresponding symbolic manipulations: the networks specified by these artificially recombined vectors actually implement the intended functions without any direct training on them. Our results suggest that meta-learning can tune a network's starting point to organize subsequent learning along systematic, functionally meaningful trajectories through the space of possible parameter vectors, providing a geometric basis for realizing inductive biases in neural networks.
5. 【2611.17297】Goal Encoding in LLMs
链接：https://arxiv.org/abs/2611.17297
作者：Arnab Sen Sharma,Eric Todd,Sheridan Feucht,Andy Arditi,Rohit Gandikota,Natalie Shapira,Gabriele Sarti,Constanza Fierro,Lisa Schut,David Bau
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：internal neural representations, LLMs encode goals, internal neural, LLMs encode, neural representations
备注： Project page, code and data: [this https URL](https://goals.baulab.info/)
点击查看摘要
Abstract:We investigate whether and how LLMs encode goals: internal neural representations that precede and guide action, and that are flexible enough to be realized through many different execution paths. We construct a coding setting with multiple sub-tasks that allows us to evaluate goal-seeking behavior and the selection of sub-goals. In this setting, we localize an encoding of the next sub-goal in the outputs of a sparse set of attention heads. The same heads can be used to decode the LM's future actions in natural language (e.g., "I'm checking if a word is a palindrome"). We verify that this encoding is causal for next action and is plastic: transplanting it into a different environment, e.g., another programming language, triggers the same operation realized with a different sequence of tokens. The LM also sustains the encoding throughout the action's execution, which is puzzling because a transformer LM without recurrence cannot carry a state forward for more tokens than it has layers left. We propose that it does not need to. Under a non-recurrent goal-seeking (NRGS) account, the LM frequently re-reads the goal from the task specification, compares it with the progress visible in the growing context, and pursues what remains. We test the predictions of this account with targeted causal interventions.
6. 【2611.17294】Metal Sandbox: Isolated Execution and Command Scheduling for GPU Coding Agents on Apple Silicon
链接：https://arxiv.org/abs/2611.17294
作者：Haozhe Wang,Lina Chen,Fanqi Wan,Qi Han,Yinmin Zhang,Zheng Ge,Daxin Jiang,Junchi Yan
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：On-device inference requires, On-device inference, inference requires kernels, Apple Metal kernels, local accelerators
备注： 16 pages, 7 figures, 5 tables. Code available at [this https URL](https://github.com/WangHaoZhe/metal-sandbox) and [this https URL](https://github.com/WangHaoZhe/harbor)
点击查看摘要
Abstract:On-device inference requires kernels that make effective use of local accelerators. Efficient training and evaluation of models that generate Apple Metal kernels benefit from native macOS tools and concurrent agent sessions. These sessions alternate between model requests, development commands, and GPU execution, leaving GPU capacity idle for much of a rollout. We present Metal Sandbox, infrastructure that combines restricted per-instance file access, native command execution, and command-level scheduling across interconnected Macs. Each agent retains its workspace and private development environment. Parallel commands can run concurrently, while serial commands share one execution slot per node; eligible waiting commands can migrate to available Macs and return results to the original agent. Integration with Harbor supports task execution, automatic verification, and rollout collection through a common workflow. Controlled experiments on four Mac mini M4 nodes achieve $1.68\times$--$2.05\times$ gains in command throughput under concentrated demand. Sixteen static agent traces give an estimated $2.14\times$ sustained-throughput gain for four sessions per node versus one, assuming continuously replenished sessions and unchanged mean durations. Replaying these measured traces under dynamic scheduling reduces mean tool waiting by 18.8% and batch elapsed time by 22.3%, assuming unchanged phase durations. Metal Sandbox and its Harbor integration are open-source on GitHub.
7. 【2611.17287】Negative-Only Policy Optimization for One-Sided Verifiable Rewards
链接：https://arxiv.org/abs/2611.17287
作者：Jiacheng Xu,Shuo He,Fuxiang Zhang,Chaojie Wang,Bo An
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Reinforcement learning, typically relies, solutions are correct, learning with verifiable, reliably judge
备注： Accepted at NeurIPS 2026 (Spotlight)
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) typically relies on a verifier that can reliably judge whether sampled solutions are correct. However, in many realistic settings, complete verification is generally unavailable, while cheap checks can only falsify failures. We formalize this regime as one-sided verifiability (OSV): verified negatives are reliable counterexamples, but verified positives are merely non-falsified candidates and may contain many false positives. This asymmetry makes standard RLVR unreliable, because reinforcing verified positives can directly reward shortcuts that pass partial checks. To address this issue, we propose Negative-Only Policy Optimization (NOPO), which treats verified positives as unlabeled and updates the policy only by suppressing trusted verified negatives. Specifically, NOPO combines a reference-relative negative suppression loss with a group-level adapter that scales each update by the proportion of non-falsified responses. Across unit-test, constraint-check, and LLM self-verifiers, NOPO improves pass@k over baselines on code, logic, and math benchmarks when oracle rewards are unavailable. These gains persist under inference-time scaling and cross-benchmark transfer.
8. 【2611.17280】Synthesis Smuggling: Maliciously Hiding Inferred Personal Attributes in LLM Outputs
链接：https://arxiv.org/abs/2611.17280
作者：Gautam Galada,Supreeth Shastri,Sagnik Ray Choudhury
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：propose Synthesis Smuggling, Synthesis Smuggling, innocuous-looking model-generated content, adversarial LLM infers, LLM infers sensitive
备注：
点击查看摘要
Abstract:We propose Synthesis Smuggling, a novel threat model in which an adversarial LLM infers sensitive information about a user from routine assistance-seeking interactions and steganographically encodes that into innocuous-looking model-generated content. The user may then unknowingly transmit that information by sharing the generated artifact, say as an email, social-media post, or message, through ordinary communication channels. An adversary monitoring these channels can discover this information. We demonstrate this threat by training two open-weight models to infer gender and age-group labels from conversational cues and encode their predictions using invisible characters or word choices. These results show that user-shared model outputs can become a covert channel for personal inferences, even when the model itself has no direct means of contacting an adversary.
9. 【2611.17191】Maximizing Capacity Utilization of LoRA Adapters for Mitigating the Learning-Forgetting Trade-off
链接：https://arxiv.org/abs/2611.17191
作者：Tomohiro Sawada,Kartik Goyal
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：substantial forgetting occurs, Low-Rank Adaptation, underperforms full fine-tuning, forgetting occurs, underperforms full
备注：
点击查看摘要
Abstract:Low-Rank Adaptation (LoRA) often underperforms full fine-tuning, especially in heterogeneous and continual-learning settings in which substantial forgetting occurs. In general, it suffers from an undesirable learning-forgetting trade-off across diverse fine-tuning settings. We identify a potential contributor: LoRA adapters, especially high-rank ones, frequently fail to realize the available capacity afforded by the configured rank. Specifically, we find that standard LoRA updates have effective rank far below their configured rank, limiting how broadly the update energy is distributed. Therefore, we propose training mechanisms that optimize the original objective while maximizing adapter effective rank. Our main method adds a simple, stable, differentiable, and SVD-free Rényi-2 effective-rank regularizer to the language-modeling loss. We also connect capacity maximization to norm-bounded updates. In mixed-domain rank sweeps on three models evaluated with multiple random seeds, a penalty weight of $\lambda=0.01$ lowers mean Wiki perplexity at every tested rank of at least $16$ relative to unpenalized LoRA. Mean training perplexity improves or increases by at most $0.02$ in all but one model-rank comparison. Single-task and scheduling experiments further show that the balance between learning and retention depends on the configuration. We also observe that several LoRA variants in the literature also suffer from the identified capacity issue, and our approach provides a complementary axis of improvement to LoRA-based parameter-efficient fine-tuning. These results suggest that effective rank is not only a post-hoc diagnostic of adapter quality, but a trainable objective for improving the learning-forgetting frontier. Our code is available at this https URL
10. 【2611.17169】Parsed, Plausible, Wrong: Output Format Controls Silent Errors in Small-Model Semantic Parsing
链接：https://arxiv.org/abs/2611.17169
作者：Umar Ahmed,Maxim Dunaev,Mohammad Nour Al Awad,Sergey Ivanov,Ivan Khodnenko
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：small fine-tuned parser, tree fails silently, wrong tree fails, fails silently, small fine-tuned
备注： 10 pages, 6 figures, 11 tables. Code and models: [this https URL](https://github.com/UmarGit/coffee-llm)
点击查看摘要
Abstract:A small fine-tuned parser that emits a well-formed but wrong tree fails silently: nothing downstream can tell. We ask whether the output format, a free design choice, controls how often this happens. On the PIZZA ordering benchmark we fine-tune two sub-billion models (Qwen3.5-0.8B and LFM2.5-350M) with LoRA on six lossless encodings of the same target tree, from 44.3 down to 10.9 tokens per order, including two matched-length pairs that vary surface form at fixed length. Across 300 runs (5 training pool sizes, 5 seeds) with a hierarchical bootstrap and Holm correction fixed before the results were read, shortening alone never helps, but writing the target in ordinary words does. The word encoding is the most accurate format on both models (87.5% vs. 85.8% exact match for the native s-expression on Qwen) while emitting 4.1x fewer tokens, and it cuts the silent error rate by 2.3x on Qwen and 1.8x on LFM2, separating at every pool size. Error analysis locates much of the gain in negation. All runs also learn to refuse off-menu input (held out: 95.9-99.0% handled) and to apply in-utterance self-corrections. Strict refusal has a measured price: 2.1-10.1% of real, mostly polite, orders are refused.
11. 【2611.17167】Actor, Judge, or Teacher? Understanding Decision Models in Long-Horizon Agents
链接：https://arxiv.org/abs/2611.17167
作者：Haochen Liu,Qianhao Zhu,Zixuan Wang,Dingming Li,Tongbo Chen,Peng Qiu,Yingqi Qu,Weiming Lu,Jun Xiao,Yongliang Shen
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Decision models answer, typed output, reinforcement learning, answer a question, choice among options
备注：
点击查看摘要
Abstract:Decision models answer a question with a typed output, such as a choice among options with a probability for each, so one model can choose an agent's actions, evaluate actions already taken, or score every action to teach a policy with reinforcement learning. Prior work has studied them mainly as actors, judging their usefulness by how well they act. We ask whether a decision model that acts poorly can still teach well. We compare three decision models and three general LLMs as actors and judges on ALFWorld, and use JEV as a teacher on ALFWorld and WebShop. As actors, all six models are pulled away from a subgoal that must come first by an easier one. As judges that see the whole trajectory, the same models credit the steps toward that subgoal, and asking whether each action helped, rather than whether the task will succeed, separates useful from useless actions. As a teacher, JEV raises a Qwen2.5-1.5B policy over GRPO from 72.8% to 82.9% success on ALFWorld and from 56.8% to 71.4% on WebShop. These results suggest that a poor actor can still teach well, because judging an action after the episode ends reveals the consequences that acting must anticipate. Code is available at this https URL.
12. 【2611.17128】Parameter-Efficient Conciseness Adaptation: Differentiable Length Control for Concise Clinical Reasoning in Smaller Language Models
链接：https://arxiv.org/abs/2611.17128
作者：Tanzeel Abbas,Ahmad Kamran Malik,Nafees Qamar,Sana Liaqat
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Smaller language models, natural language processing, Smaller language, clinical natural language, deploy clinical natural
备注：
点击查看摘要
Abstract:Smaller language models (SLMs) make it feasible to deploy clinical natural language processing where large proprietary models are too costly, and parameter-efficient fine-tuning allows them to be specialised on commodity hardware. One obstacle persists after training: on medical tasks these models answer at far greater length than the clinical question requires. In clinical decision support and point-of-care use, where time is short, such verbosity is hard to act on even when the underlying reasoning is sound. Existing length-control methods depend on preference optimisation, reward models, or proprietary teachers that undercut the accessibility making SLMs attractive. We introduce Parameter-Efficient Conciseness Adaptation (PECA), which adds a single differentiable conciseness term to the QLoRA supervised fine-tuning objective. Because the token count is discrete and non-differentiable, PECA instead raises the end-of-sequence probability once generation exceeds a token budget, a smooth signal optimised during ordinary training, with no preference data, no auxiliary model, and a single commodity GPU. On a 1.7-billion-parameter model fine-tuned on the medical-o1-reasoning-SFT corpus, PECA reduces mean response length by 72.8% while improving multiple-choice diagnostic accuracy from 40.8% to 44.0%. A sweep over the conciseness strength traces an interpretable accuracy-to-length frontier for balancing brevity and diagnostic completeness.
13. 【2611.17115】CapLite: Prompt-Injection Defense for Small Language Model Agents without Model-Written Security Artifacts
链接：https://arxiv.org/abs/2611.17115
作者：Zimo Xu,Wenzhuo Liu,Hideki Nakayama
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：prompt injection, code then enforces, security artifact, write, Progent
备注： 19 pages, 11 figures, 9 tables
点击查看摘要
Abstract:Enforcement defenses against prompt injection, such as CaMeL, Progent, IPIGuard and DRIFT, ask the agent's own model to write a security artifact (a program, a privilege policy, a dependency graph or a constraint list) that code then enforces. We ask whether small language model (SLM) agents can be trusted to write these artifacts. Across 15 open-weight models, 13 of them between 1.7B and 12B parameters, they cannot: the policies, graphs and constraints that the agent's model writes admit attacks on 14 (Progent), 13 (IPIGuard) and 11 (DRIFT) of the models, and CaMeL's programs fail to run in up to 68% of episodes. We present CapLite, which derives its policy from the tool schemas, commits the write calls before any tool result is read, and admits a write only if every argument that decides whom or what it affects is stated in the user's request. This guarantees write integrity: injected text cannot add a write, and no write reaches a recipient, amount, object or destination that the user did not state. No attack succeeds in 13,935 attacked AgentDojo episodes. CapLite reaches utility under attack comparable to CaMeL's (29.0% vs. 27.2%) with fewer tokens than every other enforcement defense and than the undefended agent: 17.1k per episode, 18% of CaMeL's, and the highest utility per token of all enforcement defenses.
14. 【2611.17108】LazyWeights: Decode-on-Demand Edge LLMs
链接：https://arxiv.org/abs/2611.17108
作者：Arnab Sanyal,Gourav Datta,Sandeep P. Chinchali
类目：Machine Learning (cs.LG); Hardware Architecture (cs.AR); Computation and Language (cs.CL); Information Theory (cs.IT)
关键词：Jetson Orin Nano, Orin Nano Super, Memory decides, Jetson Orin, Jetson Nano
备注： 6 pages, 1 reference page, 5 figures
点击查看摘要
Abstract:Memory decides which LLMs an edge device runs, and how fast: capacity on a $4$ GB Jetson Nano, bandwidth on an $8$ GB Jetson Orin Nano Super. Deployed formats (GPTQ, AWQ, $\texttt{this http URL}$'s K- and I-quants) spend equal bits on every integer code of a matrix, although the codes are far from uniform. $\texttt{LazyWeights}$ keeps these formats but tunes GPTQ so the codes compress, Huffman-codes them losslessly in interleaved lanes, and decodes them on demand in a small unit between DRAM and L2, so GPU kernels run unchanged and DRAM moves only coded bytes. At $1\%$ and $3.5\%$ perplexity budgets, coded Phi-3-mini, Mistral-7B and SmolLM-1.7B are $5.7-31.4\%$ smaller than the best $\texttt{this http URL}$ format. A bit-exact $0.21$ mm$^2$ ASIC decoder unit ($1$ GHz, $7$ nm) cuts Orin latency and energy per token by up to $36\%$ and $38\%$ ($54\%$ and $44\%$ with prompt-lookup speculation). On the Nano, $\texttt{LazyWeights}$ needs $58-64\%$ less time and $53-57\%$ less energy per token than CPU $\texttt{this http URL}$, and runs a streamed Mistral-7B 6.6$\times$ faster at $3.89$ bits per weight. A Huffman decoder beats an rANS decoder in rate and area at equal throughput; the ASIC decoder unit runs bit-exact on a Zynq UltraScale+ FPGA (AMD ZCU102).
15. 【2611.17107】Disentangling Spurious Correlations: How IRM Handles Diverse Shortcuts in Text Classification
链接：https://arxiv.org/abs/2611.17107
作者：Paul Grunenwald,Benoît Crabbé,Guillaume Wisniewski,Pirmin Lemberger
类目：Computation and Language (cs.CL); Machine Learning (stat.ML)
关键词：Empirical Risk Minimization, exploit spurious correlations, Risk Minimization, Invariant Risk Minimization, Empirical Risk
备注： 21 pages. Published at EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:In NLP, models trained via Empirical Risk Minimization (ERM) often exploit spurious correlations, such as dialectal markers, at the expense of robust linguistic features, thereby degrading their out-of-distribution (OOD) generalization. Invariant Risk Minimization (IRM) aims to suppress such shortcuts by identifying predictive relationships that remain stable across environments, but its practical utility for NLP remains debated. We use a causality-driven framework to evaluate IRM under three shortcut-generating mechanisms: label-generated features, confounding, and selection bias. Our results show that IRM successfully rejects shortcuts across the evaluated causal and anti-causal structures, including under limited environmental variation and increasing label noise. We then extend our analysis beyond controlled synthetic artifacts to two less constrained settings: gender-profession associations in Bias in Bios and semantically loaded actor-name shortcuts in ActorCorr. These experiments show that invariant learning can mitigate more realistic textual shortcuts, while semantically meaningful features require careful calibration of the invariance penalty.
16. 【2611.17091】Optimal Single-History Tokenization Disambiguation for Provably Secure Linguistic Steganography
链接：https://arxiv.org/abs/2611.17091
作者：Feng Jiang
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：Provably secure linguistic, secure linguistic steganography, linguistic steganography assumes, tokenizations break extraction, Provably secure
备注： 19 pages, 4 figures
点击查看摘要
Abstract:Provably secure linguistic steganography assumes that the receiver recovers the sender's tokens, but a text channel delivers only text, and ambiguous tokenizations break extraction. Existing fixes change the distribution, synchronize whole pools of tokens at a capacity that collapses with large vocabularies, or track several token histories. We prove that if extraction is exact and error-free across full-support language models, a single-history receiver is confined to a prefix-free candidate set at every step -- even if it reads the entire future text and the sender constrains later steps -- and must therefore give up the stop entropy, the entropy of deciding whether each prefix token ends there. Fixing these stop decisions on the prefix forest with shared randomness yields coin projection: a closed-form scheme that attains the bound, works with any distribution coder in one model call per token, preserves ordinary sampling, and refines SyncPool for every key. Across English, Chinese and Japanese, ambiguous text is rare (at most 11 in 1,000 tokens), yet the stop entropy at word and morpheme prefixes takes 7.2-9.0% of the entropy at every step; SyncPool's further loss comes from space and single-byte UTF-8 hubs that merge subtrees while carrying almost no stop uncertainty. Coin projection keeps 91-93% of the string entropy for the coder at every vocabulary size; with the full vocabulary, it turns 2.16-6.85 times as much entropy into message bits as SyncPool and recovers every completed message.
17. 【2611.17072】Reasoning Supervision and Capability Retention in LoRA Domain Adaptation
链接：https://arxiv.org/abs/2611.17072
作者：Saleh Ashkboos,Dhruv Desai,Lavinia Ghita
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：including identifying event, identifying event types, Fine-tuning foundation models, range of applications, including identifying
备注：
点击查看摘要
Abstract:Fine-tuning foundation models on financial data has a wide range of applications, including identifying event types from news, monitoring risk and compliance language, and answering questions over filings and earnings calls. In this setting, the main challenge is to improve task performance without degrading the generalization capabilities of the model. In this paper, we present an extensive set of ablations for fine-tuning Qwen3-8B with low-rank adaptation (LoRA). We compare three training regimes: (1) response-only LoRA, where the supervised response is the label alone; (2) single-adapter reasoning, where reasoning traces from a teacher model are included alongside the labels in the training loss; and (3) dual-adapter composite training, where separate LoRA adapters are trained on traces and labels. Response-only LoRA improves in-domain performance and leaves general capabilities near those of the frozen model. The in-domain change is largest for calibration and argmax accuracy. Under single-adapter reasoning, the in-domain metrics remain behind those of the response-only regime, while MMLU-Pro can rise slightly and the other retention benchmarks stay within ordinary variation. Dual-adapter composite training remains on the same side of this comparison and yields no further gain. Finally, we compress the teacher traces by summarizing them before training, and show that shorter summaries move calibration toward the response-only regime without reaching it.
18. 【2611.17068】Discovering Effective Agent Memory Designs through Program Evolution
链接：https://arxiv.org/abs/2611.17068
作者：Xinheng Ding,Seyyed Saeid Cheshmi,Ziyang Zhang,Tairan Chen,Wenya Xie,Yu Hou,Rui Zhang,Zirui Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：underlying their effectiveness, promising approach, approach to discover, study the choices, choices underlying
备注： 24 pages, 8 figures, 10 tables
点击查看摘要
Abstract:Program evolution provides a promising approach to discover agent memory designs and study the choices underlying their effectiveness. We introduce MAPE, a framework that evolves whole memory programs from minimal seeds through a standardized lifecycle interface and an iterative diagnosis-proposal loop. Experiments on LoCoMo and LongMemEval yield an absolute accuracy gain of up to 12% over manually designed baselines at 35% of the serving cost, with further evaluations supporting transfer across serving backbones and benchmarks. Empirical analyses and ablations identify and validate two recurring design patterns: retaining raw conversations as retrievable evidence preserves details omitted from extracted memories, while composing retrieved evidence according to query intent helps the answering model use it effectively. Transplanting the composition module into five existing memory systems improves accuracy across all five. Beyond these patterns, the search objective shapes where computation goes: optimizing serving cost alongside accuracy shifts computation from LLM-based memory construction to selective processing at query time while retaining competitive accuracy. Together, these findings offer empirical lessons for agent memory design. Code is available at this https URL.
19. 【2611.17053】Evaluating Pretrained Language Semantics for Structured EHR Prediction Tasks
链接：https://arxiv.org/abs/2611.17053
作者：Ashvin Gupta,Brendan Delaney,Alessandra Russo
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Structured Electronic Health, Electronic Health Records, Structured Electronic, Health Records, Electronic Health
备注： Accepted for publication in Proceedings of Machine Learning Research (PMLR), Vol. 346, 2026
点击查看摘要
Abstract:Structured Electronic Health Records (EHR) models typically treat each clinical concept as a dataset-specific token, discarding the natural-language semantics associated with the event. As a result, relationships between concepts must largely be learned from EHR co-occurrence, without directly exploiting any prior semantic knowledge. We investigate how pretrained causal language models can be adapted for longitudinal EHR prediction by developing tEHR. Here, we represent events with their natural language description and use this text stream to apply EHR-adaptive continued pretraining, followed by task-specific discriminative fine-tuning using LoRA, utilising the LLM as a longitudinal patient-encoder. We evaluate this approach across four prediction tasks on the MIMIC-IV dataset and pancreatic cancer prediction on the CPRD dataset at 1 to 12 month horizons, with tEHR using the Mistral-7B-v0.3 backbone achieving the strongest overall performance. Ablations show that performance declines when clinical descriptions are removed or misaligned, when numerical values are omitted, and when either stage of adaptation is removed, while explicit elapsed-time descriptions provide little additional benefit. Analysis of the learned patient representations further reveals clinically coherent structure associated with distinct patterns of disease risk and clinical history.
20. 【2611.17052】Auditing AI peer reviewers: a benchmark on real scientific papers
链接：https://arxiv.org/abs/2611.17052
作者：Íñigo Zubeldia,Boris Bolliet,Francisco Villaescusa-Navarro,Pablo Villanueva-Domingo,Miles Cranmer
类目：Computation and Language (cs.CL); Instrumentation and Methods for Astrophysics (astro-ph.IM); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL)
关键词：LLM-based peer review, evaluation remains limited, LLM-based peer, production scale, remains limited
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:LLM-based peer review is now used at production scale, but its evaluation remains limited. We introduce a benchmark that injects objective, localisable errors of four types (general issues, mathematics, numerics, citations) at three severity levels into real papers and measures each reviewer's detection rate by error type and severity, together with its false-positive rate on clean copies. We also present Skepthical, a multi-agent reviewer that verifies citation-backed claims by retrieving the cited papers, mathematics with computer algebra, and numerical claims with executed code. We apply the benchmark to two corpora of 15 recent arXiv preprints each, one in astrophysics and one in machine learning (ML), injecting a total of 357 errors, and evaluate twelve reviewer systems: six single-LLM reviewers, two Claude Code configurations, three publicly available reviewers, and Skepthical. The choice of model has the largest impact on detection rate: given the same prompt, three frontier LLMs differ by about 50 percentage points in total detection on both corpora. Tools and scaffolding help when they contribute what the model cannot supply on its own. In particular, on astrophysics, Claude Code improves on a single Claude call in mathematics and numerics detection, and enforced citation retrieval gives Skepthical the highest citation error detection rate of all systems by a large margin. This citation lead, however, is not observed on ML, where the models appear to know the literature better and Skepthical's citation detection rate is statistically indistinguishable from that of the best single LLM. False-positive rates are below 10% for most systems, but vary with prompt, model, and scaffolding, with mathematics flags the main source of false positives. The evaluation pipeline, the injected errors, and the adjudication logs are released as a benchmark.
21. 【2611.17030】Similar but Not Redundant: Embedding-Gated Refinement for High-Granularity Topic Models
链接：https://arxiv.org/abs/2611.17030
作者：Daniel Denley,Robert L. Nicol,Mike J. Chantler
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：coherent themes fragment, modelling extracts hundreds, failure mode, topic modelling extracts, extracts hundreds
备注： 24 pages, 6 figures, 13 tables
点击查看摘要
Abstract:High-granularity topic modelling extracts hundreds of niche topics from a corpus, yet this regime is rarely studied and is more commonly framed as a failure mode: "over-clustering," in which coherent themes fragment into redundant subtopics. We argue that this framing conflates genuine redundancy with topics that are semantically similar but meaningfully distinct, and that the central challenge in high-granularity modelling is separating the two. Recent post-hoc refinement methods address topic redundancy through either embedding-based similarity thresholding or LLM-guided merging. We show that neither suffices in high-granularity settings and propose embedding-gated iterative merge (EGIM), a hybrid approach that iteratively generates context-rich topic representations, uses embedding similarity to propose candidate merges across the topic space, then applies LLM judgement to accept only genuinely redundant pairs while preserving niche distinctions. Across two patent corpora and one legal corpus, LLM judgement rejects 83% of embedding-identified candidates as non-redundant. EGIM improves discriminability on merged topics by 25-55% over a prior iterative LLM baseline while better preserving the original topic distribution.
22. 【2611.16968】Morphological Simplification in Alzheimer's Disease: Computational Analysis and Identification From Connected Speech
链接：https://arxiv.org/abs/2611.16968
作者：Mohamed Zakaria Kurdi
类目：Computation and Language (cs.CL)
关键词：rarely modeled, Cookie Theft descriptions, Fifty-five automatic measures, ADReSS Cookie Theft, BERT-based models
备注：
点击查看摘要
Abstract:Purpose: Morphology is often regarded as relatively spared in Alzheimer's disease (AD) and is rarely modeled in connected speech. This study asked which morphological features distinguish speakers with AD from healthy controls, how well morphology classifies AD compared with other linguistic levels and BERT-based models, and whether the signal exceeds transcript length and vocabulary. Method: Fifty-five automatic measures in eight families, seven of them new and theory-motivated, were computed from participant speech in the ADReSS Cookie Theft descriptions (78 AD, 78 controls) and analyzed with group comparisons, equivalence tests, SHAP, family ablation, likelihood-ratio tests, feature-selection classifiers, and BERT-based models. The automatic measures were validated manually, and models were transferred to two other corpora. Results: Nineteen of 38 measures differed between groups: speakers with AD produced fewer suffixed and inflected words, shorter verbs and nouns, and fewer present-progressive but more past-tense forms (largest effect r = -0.42), whereas errors were rare and statistically equivalent between groups. Eight measures survived adjustment for length and lexical frequency. With test-set feature selection, morphology reached a macro-F1 of 0.85, on par with syntax and above fine-tuned BERT (0.80 over five seeds); fully cross-validated selection gave 0.62. Adding morphology to BERT improved AUC (0.91 vs. 0.89) but not macro-F1. Transfer was limited, although two thirds of the effects kept their direction in mild cognitive impairment. Conclusions: AD connected speech shows morphological simplification and temporal reanchoring rather than breakdown. Morphology is more informative than its reputation suggests. Keywords: Alzheimer's disease; morphology; connected speech; ADReSS; inflection; tense and aspect; SHAP; machine learning; BERT
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2611.16968 [cs.CL]
(or
arXiv:2611.16968v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.16968
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
23. 【2611.16956】Lara Mini Base: Language Diversity as a Resource, Not a Trade-off
链接：https://arxiv.org/abs/2611.16956
作者：Translated,Maria Pia Adinolfi,Isabelle Andrieu,Grazia Fiorella Anfuso,Melania Annunziata,Daniele Antonini,Marta Arena,Luca Barone,Dana Barras Franco,Francesca Basiricò,Francesca Bee,Sofia Bertini,Nicola Bertoldi,Giorgio Biancini,Alessandra Bigi,Giulia Boccalini,Tommaso Bonomo,Enrico Boscardi,Sebastien Bratieres,Francesco Brigante,Giulia Brignola,Romolo Buondestino,Brenda Patricia Byrne,Giorgia Campora,Edoardo Cappelli,Veronica Carascosi,Francesca Carducci,Cody Carlson,Davide Caroselli,Ambra Cascio,Dario Cascio,Mauro Cassani,Andrea Castro,Alessandro Cattelan,Giulia Ceccacci,Paola Cellini,Giulia Chiriatti,Federico Cialini,Valentina Ciarlariello,Daniele Cocozza,Emanuela Coghe,Kathleen Compares,Marco Comunità,Davide Conti,Helen Rebecca Corfield,Michele Cortellessa,Anna Cracco,Aurora Cuppone,Arianna D'Andrea,Maurizio Davoli,Andrea De Angelis,Andrea De Blasi,Rebecca De Giorgi,Annalisa De Petra,Arianna De Pilla,Joris Demiraj,Elena Deufemia,Federica Di Antonio,Pierluigi Di Cianni,Vincenzo Di Cicco,Michela Di Clemente,Alan Di Francesco,Ylenia Di Gese,Federica Di Iulio,Claudia Di Lorenzo,Andrea Di Paola,Giulia Di Pilla,Jessica Dickson,Francesco Elefante,Ilaria Fabrizio,Alessandro Falappa,Viviana Fantozzi,Antonio Farina,Andrea Fernandez Tostado Ro.Diego Andrea,Andrea Ferrari,Sara Ferri,Simona Ferri,Fabio Fioramonti,Stefano Florio,Mariachiara Fornaro,Anna Maria Foti,Niccolò Fransoni,Alessandro Fusacchia,Emma Gamba,Francesco Gasperoni,Davide Gattini,Marta Giani,Claudia Giannetti,Valerio Giannini,Antonella Giudici,Mara Gramendola,Michele Grandinetti,Eleonora Graziani,L'Meese Hope Greaney,Dario Gubernari,Filomena Guglielmi,Jonathan Hammond,Stephen William Harris,Rowena Elizabeth Hogg,Marta Hontanon Del Olmo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：non-English pretraining data, pretraining data makes, Lara Mini base, Lara Mini, Mini base
备注： 51 pages, 14 figures, 29 tables. Model weights: [this https URL](https://huggingface.co/translated/Lara-4-Mini-Base)
点击查看摘要
Abstract:General-purpose language models are trained mostly on English: over open models we review, at most, non-English pretraining data makes up only a 12% share. Models built for European languages give them far more, but score well below general-purpose models of the same size. A common concern is that, in small models, languages compete for capacity. We present Lara Mini base, a model trained from scratch on 6T tokens in English and 44 other languages, which together cover all 24 official languages of the European Union. As training progresses, the 44 other languages together come to outweigh English. To give these languages enough capacity at low cost, Lara Mini base uses a mixture of experts architecture with 7.2B total and 0.6B active parameters. Among open base models with up to 2B active parameters, it achieves the highest average score across standard English, multilingual, math, and code benchmarks, ahead of models trained on 4 to 6 times as many tokens. Its margin is largest on multilingual benchmarks in the languages it supports and on math benchmarks. It supports contexts of up to 128k tokens. We find that our MoE architecture reduces capacity competition between languages. For a single user on one GPU, without quantization, it generates text at least 1.8 times faster than any model with a higher average score. We release the weights of Lara Mini base under the CC BY-NC-SA 4.0 license. In addition, we will release T-HellaSwag, a higher-quality machine translation of the commonsense reasoning benchmark HellaSwag into 110 language variants.
24. 【2611.16929】SPADE: Soft Prompts for Ai-text DEtection
链接：https://arxiv.org/abs/2611.16929
作者：Alex Jiang,Didier Schwab,Chuyuan Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, Language Models, Large Language, web increasingly ubiquitous, making AI-text detection
备注： 24 pages (8 main), 10 figures, 22 tables
点击查看摘要
Abstract:The easy access to Large Language Models (LLMs) has made AI-generated texts on the web increasingly ubiquitous, making AI-text detection a crucial task. Prompts greatly influence the generation process, but existing detectors focus solely on the generated texts --- supervised methods learn from labeled texts only, and zero-shot methods rely on the text's probability distributions --- ignoring the underlying generation process, which limits their robustness in open-world scenarios. We introduce SPADE: Soft Prompts for Ai-text DEtection, a novel framework for detecting AI-generated text that transfers better across datasets. Specifically, we measure the prompt's influence and use it as a discriminative signal. We characterize the prompt's influence by introducing a Pointwise Mutual Information (PMI) term that captures how much a prompt explains a text. Based on this quantity, SPADE trains one soft prompt per class to amplify the separation, and predicts the class whose prompt best explains the candidate text. Extensive experiments on several benchmarks against various detectors demonstrate the robustness and effectiveness of our method, achieving state-of-the-art (SOTA) performance on out-of-distribution (OOD) datasets.
25. 【2611.16919】Beyond Word Error Rate: A Failure Taxonomy of Streaming Dictation ASR
链接：https://arxiv.org/abs/2611.16919
作者：Harras Mansoor,Muhammad Wisal,Hassan Bhatti,Masood Shakir
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：recorded files, capital letters, format are removed, letters and number, number format
备注： 35 pages, 27 tables, 2 figures. Code: [this https URL](https://github.com/heylemon-ai/streaming-dictation-asr) Data: [this https URL](https://huggingface.co/datasets/hey-lemon/streaming-dictation-asr)
点击查看摘要
Abstract:Speech recognition (ASR) systems are usually compared by word error rate (WER) on recorded files, after punctuation, capital letters and number format are removed. In dictation, the audio is streamed live and the text goes into the user's message as written, so what matters is which mistakes the user has to fix. The test set, streamed to eleven ASR systems, comprises 106 scripted English dictations from one speaker (read in a quiet room, with a fan on, and whispered), 20 clips in each of eleven other language and dialect sets, and 400 recordings that join clips in two languages. Every error was sorted by a fixed rule into four levels: recognition, output formatting, language handling and, for the self-hosted models, audio dropped before the model. Systems with similar WER failed in different ways. Zoom Scribe and OpenAI's GPT-Live-Transcribe have almost the same WER on quiet English (7.4% and 7.3%), but 34.7% and 8.8% on whispered English. Zoom and both AssemblyAI models left out 26-28% of whispered words, and still 21-26% with their end-of-turn detection relaxed or off; seven other systems left out at most 3%. Qwen3-ASR's 32% came from the speech detection in our own deployment (6% when relaxed). Across 107 EARS speakers, the same four systems lost 7-31% of whispered words, while six others lost under 2%. With only English selected, Gemini, Deepgram and our self-hosted Whisper lost the non-English part of a two-language recording in 86-99% of recordings, against 33-46% with both languages selected, while GPT-Live-Transcribe, OpenAI's realtime Whisper and Meta lost it in at most 20%. Running Whisper behind a Silero voice activity detector that drops audio judged to be silence raised whispered WER from 10.1% to 51.4%. Most English results come from one read speaker. The code, the recordings, both references and every transcript are released.
26. 【2611.16895】Human or Synthetic? What a Fixed Budget Buys for Post-Training
链接：https://arxiv.org/abs/2611.16895
作者：Shourik Banerjee,Ethan Mendes,Mohit Raghavendra,Wei Xu,Alan Ritter
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Direct Preference Optimization, combines supervised fine-tuning, typically combines supervised, Preference Optimization, large language models
备注： 20 pages, 9 figures. Code: [this https URL](https://github.com/shourikb/human-or-synthetic) , Data: [this https URL](https://huggingface.co/datasets/liteshadow4/synthetic-pref-tulu3)
点击查看摘要
Abstract:Post-training of large language models typically combines supervised fine-tuning (SFT) with preference-based fine-tuning such as Direct Preference Optimization (DPO). Human-annotated and synthetically generated preference data differ substantially in per-sample cost, but prior work typically holds sample count fixed when comparing the two. In this work, we explicitly study the interplay between cost and performance by comparing the effect of post-training with human and synthetic preference data under a fixed, dollar-matched annotation budget. We train and evaluate multiple base model families across helpfulness and summarization tasks. We find that synthetic data is far more cost-efficient at low-to-moderate budgets, achieving high win rates with as little as \$200--\$400. On helpfulness, human data closes the gap only at budgets roughly two orders of magnitude larger; on summarization, it does not close the gap at any tested budget. We also find that human-annotated data varies in reliability: one widely used human preference source substantially underperforms another, and the gap persists even after standard remedies such as domain restriction and deduplication.
27. 【2611.16890】Look It Up: Multi-bit LLM Watermarking via Codebook Search
链接：https://arxiv.org/abs/2611.16890
作者：Jarosław Janas,Paweł Morawiecki,Josef Pieprzyk
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Attributing short LLM-generated, recover payloads reliably, existing multi-bit watermarking, require long generations, specific source remains
备注： 16 pages, 8 figures, 6 tables. Submitted to IEEE Transactions on Information Forensics and Security. Code: [this https URL](https://github.com/jaroslawjanas/llmw-codebook)
点击查看摘要
Abstract:Attributing short LLM-generated texts to a specific source remains challenging for existing multi-bit watermarking methods, which often require long generations or costly decoding to recover payloads reliably. We propose a codebook-based watermarking scheme that maps an $n$-bit payload to a longer $u$-bit codeword and embeds it during generation through token-level logit biasing. During extraction, the received bit sequence is matched to the nearest codeword in a precomputed secret codebook using Hamming or Levenshtein distance. Experiments show that our method achieves near-perfect recovery for 16-24 bit payloads on 200-token generations and strong performance on 127-token generations for base models. Results are weaker on some instruction-tuned models with very short texts, where low-entropy output distributions reduce embedding reliability. We also study a BCH-based variant that avoids codebook storage but generally reduces robustness. The Levenshtein variant improves resilience to deletions and light paraphrasing, while insertions and stronger rewrites remain challenging. We analyze collision probability, codeword separation, extraction time, tokenization consistency, and text quality, highlighting both the practicality and limitations of codebook-based watermarking for short-form attribution.
28. 【2611.16882】Pretraining Data Statistics Shape the Phases of Learning Entity Comparison in Language Models
链接：https://arxiv.org/abs/2611.16882
作者：Yik Siu Chan,Jing Huang,Yanai Elazar,Atticus Geiger
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：data shape language, shape language model, shape language, France and Brazil, entity
备注： 29 pages, 20 figures. NeurIPS 2026
点击查看摘要
Abstract:How does data shape language model (LM) behavior throughout pretraining? We investigate this question through a case study on entity comparison, e.g., Between France and Brazil, which country is larger?, across nine comparison tasks spanning five entity types. We begin with controlled experiments in which we train small LMs (163M parameters) on mixtures of natural text from pretraining corpora and synthetic task data. Our analysis identifies three distinct phases of learning: (1) an early phase where the LM selects entities by frequency, (2) a middle phase where the LM selects entities by position in the prompt (first vs. last mentioned entity), and (3) a late phase where the LM selects the entity that is the correct answer. We show that the emergence of these three phases is causally determined by statistical properties of the training data. With small amounts of task-specific synthetic data, we observe only the first two phases and the model fails to learn the task; with large amounts, the model jumps directly from the frequency-based heuristic to solving the task correctly. Moreover, changing the entity frequency distribution from a naturally occurring Zipfian distribution (a small number of entities are very common and the vast majority are rare) to a uniform one weakens the frequency phase and speeds up learning of the task. Lastly, we show that the three phases of training dynamics from our controlled experiments appear in the open source model OLMo-2 32B. Together, our findings demonstrate that properties of pretraining data are causal drivers of heuristic learning and show that small-scale synthetic experiments can predict training dynamics at larger scales.
29. 【2611.16843】Shortcuts or Memorisation? Revisiting Data Corruption in Natural Language Understanding with Large Language Models
链接：https://arxiv.org/abs/2611.16843
作者：Aarne Talman,Stergios Chatzikyriakidis
类目：Computation and Language (cs.CL)
关键词：natural language inference, Pre-trained encoders fine-tuned, language understanding tasks, Pre-trained encoders, input is perturbed
备注：
点击查看摘要
Abstract:Pre-trained encoders fine-tuned on natural language inference (NLI) and other language understanding tasks keep much of their accuracy after the input is perturbed, e.g. by removing all nouns or shuffling the words. Does the same hold for large language models (LLMs), and if so, is it because they have seen the benchmarks during pre-training? In this paper we revisit these perturbation experiments with eight LLMs alongside fine-tuned encoders on GLUE and the three rounds of ANLI. Regardless of model size, every system that answers directly retains 36-72% of its above-chance performance without nouns on MNLI compared to only 14-29% on ANLI. Only a model that reasons before answering departs from this pattern. We also check contamination indicators (including exact $n$-gram counts in the public pre-training data of two of the models) and find no link between exposure and robustness. Our strongest evidence comes from 368 new, human-validated items that none of the models can have seen. All eight LLMs keep more of their performance without nouns on items written in MNLI's style than on items written without its cues. When the perturbation instead removes the function words carrying such cues, this advantage reverses. In light of these results, we argue that robustness to perturbation on familiar NLI benchmarks reflects dataset shortcuts rather than memorisation, and tells us more about the benchmark than about the model.
30. 【2611.16816】Outcome-Mass Alignment: Controlling Length-Dependent Trajectory Influence in Multi-Turn LLM Agent Reinforcement Learning
链接：https://arxiv.org/abs/2611.16816
作者：Dawei Zhang,Yubin Huangfu,Jessica Fan,Boyu Wei,Likang Wu,Hongke Zhao,Ming He,Zhu Teng
类目：Computation and Language (cs.CL)
关键词：multi-turn LLM agents, LLM agents materializes, stepwise group-relative training, interaction contexts tractable, long interaction contexts
备注： 18 pages, 6 figures, including appendices
点击查看摘要
Abstract:To keep long interaction contexts tractable, stepwise group-relative training for multi-turn LLM agents materializes each source trajectory into multiple response rows and valid tokens. This expansion creates an outer-accounting problem distinct from within-trajectory credit assignment: row-based outcome statistics can count one episode outcome multiple times, while token-level reduction can assign unequal aggregate objective mass across trajectories. We term these effects outcome-statistics multiplicity and objective-mass imbalance. We introduce Outcome-Mass Alignment (OMA), a two-component method that makes both accounting choices explicit. Outcome Alignment computes outcome statistics over unique source trajectories, while Mass Alignment controls aggregate objective mass after within-trajectory aggregation of optimizer-native token objectives. Neither redesigns the base optimizer's credit assignment, importance ratios, or clipping. Across matched ALFWorld GRPO comparisons at two model scales, where failed trajectories typically expand much more than successful ones, OMA improves matched-horizon endpoint success by 7.0-9.4 percentage points. Ordinary WebShop exhibits weak or reversed expansion-outcome coupling and correspondingly mixed effects, whereas in a success-oriented WebShop setting, WebShop-SOL, OMA improves success nAUC from 0.399 to 0.511. Component ablations and GiGPO and GSPO comparisons further support component separability and cross-optimizer compatibility. These results show that trajectory expansion always defines an implicit weighting rule, but its practical effect depends on how expansion couples to outcomes and optimizer-native updates.
31. 【2611.16803】Detection Is Not Early Warning: Evaluating Token-Level Alarms on Language Model Failures
链接：https://arxiv.org/abs/2611.16803
作者：Marco De Negri(1),Luca Sartori(1),Lorenzo Baggi(1),Moritz Reihs(1),Eduard Frank Ďurech(2),Mennatallah El-Assady(1),Valentina Pyatkin(1 and 2),Anna Hedström(2 and 3) ((1) ETH Zurich, (2) ETH AI Center, (3) Solaris Research)
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：onset, language models begin, monitor, language models, models begin
备注： Accepted at the NeurIPS 2026 Workshop on Interpretability as a Science. 30 pages (10 main text), 6 figures, 16 tables. Code: [this https URL](https://github.com/swiss-ai/degeneration-probe)
点击查看摘要
Abstract:Many failures of language models begin at a specific token, the onset. A monitor that reads the model during generation can classify the finished response, detect the failure once it is under way, or warn before it begins, and only a warning leaves time to stop or steer the generation. Monitors are usually evaluated with response-level metrics such as AUROC, which ignore when the monitor fires. We introduce PREWARN, an evaluation protocol for any failure with an annotated onset. It calibrates each monitor's threshold on validation data to an error rate chosen for the application, runs the monitor, and scores its alarms relative to the onset on all three tasks. As a case study we apply it to repetitive degeneration in three open language models, with early warning as the main task, using linear probes on activations and six untrained baselines. Response-level metrics saturate on this failure, and a rule that reads only the response length scores almost perfectly, while probes that AUROC ranks as equal warn very differently under PREWARN. Probes warn before the onset on most degenerate responses of two of the three models, low-rank adapters below the probe more than double the share of tokens just before the onset that it flags, largely by flagging degenerate responses long before the onset, and no untrained baseline warns much more often than random alarms. We release the probes with calibrated thresholds at this https URL
32. 【2611.16714】owards Green Text Generation: Memory-Based Speculative Decoding
链接：https://arxiv.org/abs/2611.16714
作者：Antal van den Bosch
类目：Computation and Language (cs.CL)
关键词：single forward pass, large language models, large verifier checks, accelerates text generation, large language
备注： 11 pages, 2 figures, 7 tables. Published at the 19th International Natural Language Generation Conference (INLG 2026). Code: [this https URL](https://github.com/antalvdb/olifant-speculative) ; models: [this https URL](https://huggingface.co/antalvdb/olifant-speculative-ibases)
点击查看摘要
Abstract:Speculative decoding accelerates text generation with large language models by letting a cheap draft model propose tokens that a large verifier checks in a single forward pass. We introduce Olifant, a draft model built on a memory-based classifier. It predicts the next token from a four-token window in under 0.3 ms on CPU, requiring no GPU, no backpropagation, and no accelerator memory. We measure throughput and energy under two verifier regimes on consumer hardware. Without a KV cache, drafting is nearly free: a domain-matched Olifant model reaches 38.1% acceptance on EU legal text, delivering 2.43x throughput and 2.51x lower energy per token than the neural verifier model alone. With a KV-cached verifier, itself a ~10x energy saver, drafting costs matter: a TinyLlama draft model halves throughput and triples energy despite high acceptance, whereas Olifant still yields 1.25x throughput and the lowest energy in the study (93 J per 100 tokens, 14x below the uncached baseline). We further show that KV caching decouples time from energy: verification of longer drafts raises power draw, shifting the energy-optimal draft length below the speed-optimal one. Speculative decoding is not dead in the age of fast verifiers, provided drafting is nearly free.
33. 【2611.16704】Forecasting Sales Delay through Time-aware Analysis of Sales Events in Textual Reports
链接：https://arxiv.org/abs/2611.16704
作者：Masaya Tsunokake,Yuta Koreeda,Yuhei Niwa,Terufumi Morishita,Teppei Inoue,Hiroaki Ozaki,Yasuhiro Sogawa
类目：Computation and Language (cs.CL)
关键词：scheduled order dates, sales, product in response, scheduled order, develop and deliver
备注： 9 pages
点击查看摘要
Abstract:Business-to-business (B2B) companies develop and deliver a one-of-a-kind product in response to a client's orders. To prepare resources for development beforehand, companies estimate dates when they will receive orders from clients in their sales process, called scheduled order dates. However, dates when the companies actually receive orders can differ from the scheduled order dates. This difference increases costs in the development. If the difference could be forecasted before receiving orders, companies could optimize their resource preparation. Towards reducing the costs, we introduce sales delay forecasting, a novel task of forecasting delay days from the scheduled order dates during sales process where sales representatives (sales reps) interact with the clients to receive orders. Sales delay forecasting is challenging because the sales process progress inherently involves uncertainty and depends on the client's willingness to order. To address this task, we propose confidence features which represent sales reps' confidence as a proxy measure of the client's willingness to order. To represent it, our method extracts dates of future sales events anticipated by sales reps from textual reports. To consider whether the confidence objectively looks reasonable, we also introduce status features which describe sales process status based on current date and past events. In experiments using real sales data, our method achieved a 16% lower mean absolute error compared with a feature-based baseline similar to a prior work. Moreover, our method outperformed non-feature-based baselines using large language models, indicating that it is crucial to explicitly create our features.
34. 【2611.16694】When Expert Disagreement Hurts: Prestige and Selectivity in LLM Decision Revision
链接：https://arxiv.org/abs/2611.16694
作者：Yupeng Tang,Mingfeng Lin
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：final accuracy shows, language models revise, abandoning correct answers, agent disagrees, fixing mistakes
备注： Accepted at NeurIPS 2026. 38 pages, 7 figures, 36 tables. Code and data: [this https URL](https://github.com/yupengtang/when-expert-disagreement-hurts)
点击查看摘要
Abstract:When language models revise a decision after another agent disagrees, neither reversal counts nor final accuracy shows whether they are fixing mistakes or abandoning correct answers. We introduce a controlled two-pass audit that holds the question, the evidence, and the model's initial answer fixed and varies only the revision context: neutral reflection, anonymous disagreement, or disagreement attributed to a domain expert. For binary decisions the accounting is exact: revision raises accuracy only if it is selective enough, reversing wrong answers more than $a/(1-a)$ times as often as correct ones, where $a$ is initial accuracy (nine times at 90%). Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, no model clears this bar under expert disagreement, and accuracy falls by up to 16.1 points. The expert label, a prestige cue, adds reversals for four of the five models, yet its effect on accuracy ranges from a 5.2-point loss to a 2.4-point gain, so reversal counts are a poor proxy for harm. With identical arguments from both sources, the label still raises reversal for three proprietary models and in a pooled analysis of four newer models. Models also respond to stated source reliability. Revision pipelines should therefore be evaluated with paired, conditional metrics, per model and protocol.
35. 【2611.16662】MuSeToM: Multi-Sensory Evaluation of Belief Revision with Textual Cues Across Six Senses
链接：https://arxiv.org/abs/2611.16662
作者：Chunkit Chan,Kawai Chung,Sze Heng Douglas Kwok,Yuxuan Liu,Yauwai Yim,Tianshi Zheng,Haochen Shi,Qing Zong,Wong Kai Chung,Pak Hin Lau,Calvin Yang,Yifan Gao,Xiaoman Pan,Ginny Wong,Simon See,Yangqiu Song
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Theory of Mind, human social cognition, pivotal for human, social cognition, infer mental states
备注：
点击查看摘要
Abstract:Theory of Mind (ToM), the ability to infer mental states in others, is pivotal for human social cognition. Existing evaluations of ToM in large language models (LLMs) mainly focus on static belief attribution and false-belief reasoning, leaving a critical aspect of social reasoning underexplored: can LLMs decide whether perceptual evidence is sufficient to justify another person's belief revision? To address this gap, we present MuSeToM, a human-validated, text-based benchmark for evaluating epistemic belief revision in ToM reasoning. MuSeToM contains 2,415 instances adapted from BigToM and OpenToM, with textual cues spanning six sensory categories, and tests whether models can determine when a protagonist should revise a belief and infer the resulting updated belief state. Using MuSeToM, we systematically evaluate state-of-the-art LLMs under direct and chain-of-thought prompting, revealing a pronounced dissonance: while models often detect that a belief may change, they struggle to identify the updated belief and frequently over-update on perceptually salient but epistemically insufficient cues.
36. 【2611.16612】Unibuc - NLP at "Voight-Kampff" Generative AI Detection PAN 2025
链接：https://arxiv.org/abs/2611.16612
作者：Teodor Marchitan,Claudiu Creanga,Liviu P. Dinu
类目：Computation and Language (cs.CL)
关键词：PAN at CLEF, Generative AI Detection, NLP team, Detection Sensitivity, paper describes
备注：
点击查看摘要
Abstract:This paper describes the approach of the Unibuc - NLP team in tackling the "Voight-Kampff" Generative AI Detection task from PAN at CLEF 2025. In the Subtask 1: Voight-Kampff AI Detection Sensitivity we have explored different approaches of leveraging embeddings extracted from LLMs, using either classical ML models or further fine-tuning LLMs with a classification head for the downstream binary classification task. Our experiments showed that using a majority vote ensemble of classical ML models (Light GBM, XGB, Logistic Regression and SVM) is comparable with fine-tuning for downstream task achieving around 99.4% F1 score. For the Subtask 2: Human-AI Collaborative Text Classification we explored a way of combining features at different layers extracted using transformer backbone with layer-wise projection and attentive pooling which proved modest results.
37. 【2611.16581】Do the Details Help the Whole? One-Way Transfer from Person Actions to Group Intent in VLMs on JRDB-Social
链接：https://arxiv.org/abs/2611.16581
作者：Chengguang Gan,Zhixi Cai,Yunhao Liang,Hanjun Wei,QingHao Zhang,Shiwen Ni
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Social scene datasets, scene datasets label, Social scene, datasets label people, scene datasets
备注：
点击查看摘要
Abstract:Social scene datasets label people at two levels: what each person is doing and what the group is there for. Training on both levels at once is often assumed to help each of them. We test this assumption for vision-language models (VLMs) on JRDB-Social, treating person actions as the details and group intent as the whole. We fine-tune Qwen3.5 4B under eight training arms with three seeds, repeat the core arms on Qwen3.5 9B and Qwen3-VL 4B, and judge every arm with a verdict rule fixed before testing. Writing each member's actions before the intent raises intent macro-F1 from 30.1 to 31.0, and writing the intent first reaches 31.2, while action F1 stays within 0.2 points of an action-only model. Under the selected recipe, no arm trained with intent improves actions. The gain requires correct, image-grounded actions: empty action lists or actions borrowed from another group with the same intent lower intent F1. Forced-prefix tests, occlusion, member masking, linear probes and component grafting show that the intent follows the written actions, relies more on people and partly resides in the vision tower. Supplying actions as input instead of as targets hurts both levels.
38. 【2611.16526】Lost in Delegation: Studying the Effectiveness of Task Orchestration in Generative Search
链接：https://arxiv.org/abs/2611.16526
作者：Tamara Stojanovska,Elisabeth Kirsten,Leon Swazinna,Muhammad Bilal Zafar
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：solve complex assignments, complex assignments, quickly evolved, systems that delegate, solve complex
备注：
点击查看摘要
Abstract:LLMs have quickly evolved from models used in isolation to agentic systems that delegate tasks to external tools and other LLMs to solve complex assignments. This agentic augmentation has led to impressive capability gains. However, when and how delegation improves performance remains poorly understood. For example, it is unclear whether delegation helps when tasks involve post-cutoff information that the orchestrating LLM cannot reliably resolve from its own knowledge. In this work, we use purpose-built datasets with pre- and post-cutoff splits to compare various delegation modes. We find that delegation provides no consistent accuracy improvement over non-delegated setups, with effects varying across models and tasks. When tasks involve knowledge unavailable to the orchestrator, delegation can substantially degrade accuracy, while direct tool use with the same LLM performs much better. Our analysis identifies distorted delegated queries, inefficient tool use, and failures to preserve and use information between agents as recurring failure modes. These findings suggest that effective orchestration requires both well-calibrated delegation decisions and effective exchange of information between agents.
39. 【2611.16500】EvenVLM: A Text and Multimodal Dataset for the Even Language with Vision-Language Fine-Tuning
链接：https://arxiv.org/abs/2611.16500
作者：Daniil Makovetskii,Ivan Bondarenko
类目：Computation and Language (cs.CL)
关键词：endangered Northern Tungusic, Northern Tungusic language, Tungusic language spoken, Northern Tungusic, people in Siberia
备注： Published in Proceedings of the Workshop on Open Reasoning Across Cultures Languages (ORACLE) at EMNLP 2026
点击查看摘要
Abstract:We present EvenVLM, the first text and multimodal (VQA) dataset for Even (Lamut), an endangered Northern Tungusic language spoken by approximately 6,800 people in Siberia. Our dataset comprises 50,521 structured Even-Russian entries extracted from dictionary and phrasebook sources via GPT-4o Mini-based parsing, from which we synthetically generate 107,543 training examples spanning translation, grammar, reading comprehension, and semantic classification. To address tokenization inefficiency on Even's agglutinative morphology, we propose a three-step tokenizer expansion algorithm that adds Even-specific graphemes (eng, oe, o-umlaut), whitelisted vocabulary, and BPE merges, reducing average tokens per word by 27% (4.99 to 3.64). Using LoRA fine-tuning of Qwen3-VL-4B, we adapt the model for text tasks (0.53% trainable parameters, rank 32) and separately for visual question answering (rank 64, frozen vision encoder). Our best configuration achieves 11.4% exact match and a 13.6 weighted score on text benchmarks, 0.1283 chrF for sentence translation, and 65% accuracy on VQA (up from 0% for the base model and text-only fine-tuning). We release our datasets, evaluation benchmarks, and training pipeline to support further research on Even and other low-resource languages.
40. 【2611.16477】Where in the Input Does a One-Pass Decision Encoder Look?
链接：https://arxiv.org/abs/2611.16477
作者：Mohammed Nayeem Khan,Allan Kevin T
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：English release, answers a multiple-choice, form one sequence, released checkpoint, text
备注： 25 pages, 19 figures, 23 tables
点击查看摘要
Abstract:Laya is a small model that answers a multiple-choice question about a text in one pass: the question, the options (each with a name and a description) and the text form one sequence of at most 512 tokens, the window, in the English release. A longer text is silently cut at the end, and we measure what that costs. Test documents place a held-out row's text, the evidence, at a chosen token offset among distractor text; 177 items, five tasks, three checkpoints (released, short-row fine-tune, long-document fine-tune), four window sizes and 93,275 scored requests. When the evidence lies beyond the window, accuracy falls to 26.4% for the released checkpoint (27.2% for both fine-tunes), near the 27.0% of guessing and below the 35.6% of always giving the commonest label. Confidence gives no warning (AUROC 0.50 to 0.55 for telling cut from read requests; 0.5 = chance), and the runtime's truncation flag also fires on requests whose evidence was visible. The released checkpoint reads visible evidence badly once text precedes it: 38.5% pooled against 60% when the evidence comes first, so a larger window alone gains +6.2 points. Fine-tuning on long documents adds +27.6 points on visible evidence over the short-row fine-tune (95% interval +22.3 to +33.1) and nothing on cut evidence. That is an in-family result: training rows and test documents share generator and question types, and the main filler is of the training kind. With encyclopedic filler never seen in training the gain is +13.2 (+9.9 to +16.6), with rows of other tasks as filler -2.0. Among training-free rearrangements a 312-token window scan helps most (+11.9 points over the default for the released checkpoint) at six to eleven forward passes. Documents are synthetic, labels are LLM-made and one backbone is studied, so these diagnose this model, not long documents in general.
41. 【2611.16466】How Should Planning Agents ReSHAPE Their Search Space?
链接：https://arxiv.org/abs/2611.16466
作者：Yilin Zhang,Xinran Zhao,Tong Chen,Ziming Yuan,Tongshuang Wu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：user initial specification, plans, Planning, initial specification, user initial
备注：
点击查看摘要
Abstract:Planning agents and benchmarks treat a user's initial specification as fixed. Yet the requests users write exclude plans they would gladly take, since they rarely discover the possible trade-offs they would accept until seeing the options. Agents already revise requests through interaction, but whether this helps planning is unknown. We formalize this step as the ReSHAPE task, which judges a revision by whether its search space matches the acceptable plans and a planner finds one there. Using ReSHAPE Planter, which builds instances from planning benchmarks with a human-validated simulated user, we analyze 5,800 agent-revised specifications in travel and shopping. We find that reshaping matters: one correct trade-off makes the same planner reach an acceptable plan up to 4.6x as often, and search space quality predicts what the planner finds. Current agents, however, admit at most 32% of the acceptable plans, where that trade-off alone admits over 52%, because they ask about preferences instead of showing plans; in travel, showing plans raises F1 by 9.7 points over asking, with two model families. Planning agents should thus treat a request as a hypothesis to test against the user's reactions to concrete plans to recognize user trade-offs.
42. 【2611.16433】daVinci-Prover: Agent-Native Mid-Training for Formal Theorem Proving
链接：https://arxiv.org/abs/2611.16433
作者：Wenhong Zhu,Xuefeng Li,Jiashuo Zhang,Yu Chen,Tiantian Mi,Qipeng Guo,Pengfei Liu
类目：Computation and Language (cs.CL)
关键词：rapidly transforming formal, Advances in large, transforming formal theorem, large language models, formal theorem proving
备注：
点击查看摘要
Abstract:Advances in large language models (LLMs) are rapidly transforming formal theorem proving. Yet further progress remains constrained by the lack of a transparent and effective data recipe for systematically improving theorem-proving models. In this work, we argue that effective agentic provers require strong mathematical skill priors to ground theorem proving and agentic trajectories to enable long-horizon, interactive proof construction. To this end, we synthesize an agent-native 33.7B-token mid-training corpus covering decomposition, search, self-verification, and revision, together with verifier-grounded agentic trajectories. We further introduce the daVinci-Prover harness, which enables models to construct proofs and interact with a Lean verifier in an isolated workspace, and use it to collect approximately 36K high-quality agent trajectories for supervised fine-tuning. Our mid-training recipe yields an average improvement of 13.7 points over the matched Qwen3-8B SFT-only baseline across MiniF2F, FATE-M, and ProofNet. When applied to the Qwen3.5 series, our approach also yields strong performance across theorem-proving benchmarks and achieves near-saturating MiniF2F performance with memory compaction. The results highlight agent-native mid-training as an effective foundation for developing stronger interactive theorem-proving agents.
43. 【2611.16425】RMIT-ADM+S at TREC RAG 2026: Research Agents, Retriever Ablations, and Open-Weight Replication
链接：https://arxiv.org/abs/2611.16425
作者：Oleg Zendel,Kun Ran,Chenglong Ma,Nguyen Khoi Vo,Shuai Wang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Retrieval-Augmented Generation, describe the RMIT-ADM, ClimbMix corpus, team participation, RAG
备注：
点击查看摘要
Abstract:We describe the RMIT-ADM+S team's participation in the TREC 2026 Retrieval-Augmented Generation (RAG) track using the ClimbMix corpus. We submitted seven research-agent runs using proprietary OpenAI and open-weight models, exploring different retrieval strategies, writer models, and agent workflows. Pre-submission ablations identified writer selection and adjacent-chunk expansion as the main factors affecting answer quality. In the official NIST evaluation, six of seven runs exceeded the track median across all three rubric/nugget collections. Our best-performing run, brief-hybrid, achieved the highest all-item coverage among our submissions and tied the track maximum (0.892) for Batch-1 vital coverage. Human side-by-side preferences differed across evaluation batches: the open-weight owa-glm5 led Batch 1 despite lower automated coverage, while sol-research-first led Batch 2. These findings highlight differences between automated coverage measures and human preferences, as well as the potential of lower-cost open-weight models for research-agent systems.
44. 【2611.16409】Experience-Handoff Reinforcement Learning for Recursive Self-Improvement
链接：https://arxiv.org/abs/2611.16409
作者：Doyoung Kim,Byeongguk Jeon,Kailin Zhang,Sherry Yang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Large Language Models, train Large Language, Reinforcement Learning, Large Language, tasks with Reinforcement
备注：
点击查看摘要
Abstract:It is common to train Large Language Models (LLMs) for agentic tasks with Reinforcement Learning (RL) from scalar rewards. However, this throws away the fine-grained information about the environment that the agent experienced during the trial (e.g., error logs). To utilize this rich information, recent works wrap the agent in a harness that refines its own inputs through reflection or compaction and hands past experience to future rollouts, but the construction of the handed-off artifacts (e.g., a playbook) is itself not learned. We want the best of both worlds: gradient updates from a scalar reward, while also utilizing environment information to hand off experience. As a concrete testbed, we fix the Agentic Context Engineering (\ace{}) harness and train one model to act, reflect, and curate task-local playbooks. Our method, \acerl{}, evaluates candidate experience-handoff artifacts by their downstream effect on future actor rollouts, and co-optimizes the role-specific behaviors (action generator, insight reflector, and playbook curator) under a fixed scaffold. Across agentic benchmarks, \acerl{} achieves higher held-out performance than baseline methods. The results suggest that agent training should optimize not only the actions in the current rollout, but also the model-written experience that future rollouts inherit.
45. 【2611.16399】Saidzoda-Kazakh-EmbeddingGemma-300M: How Far One Epoch of Generated Questions Takes a Small Kazakh Embedder
链接：https://arxiv.org/abs/2611.16399
作者：Tohir Saidzoda,Madina Abdusalomzoda,Abubakr Abdullozoda,Amin Jalilov,Faroiz Bobokhon,Aibek Shokanuly
类目：Computation and Language (cs.CL)
关键词：Kazakh Belebele retrieval, Belebele retrieval questions, Kazakh Belebele, Kazakh, English and Russian
备注： 12 pages, 8 tables, 2 figures. Technical report. Model: [this https URL](https://huggingface.co/Tohirju/Saidzoda-Kazakh-EmbeddingGemma-300M)
点击查看摘要
Abstract:EmbeddingGemma-300M is a small open embedder, and used as released it finds the right passage first for 60.8% of the Kazakh Belebele retrieval questions. We present Saidzoda-Kazakh-EmbeddingGemma-300M, the same model fully fine-tuned for one epoch on 208,511 pairs: 166,263 Kazakh questions that our own language model wrote about source passages from encyclopedias, Wikipedia, news and books, each checked by a second model, plus English and Russian replay. On Kazakh Belebele, recall@1 rises from 60.8% to 78.0% and recall@10 from 76.3% to 91.4%. Our model scores above 161 of the 194 models with a published MTEB score on the same test, among them OpenAI text-embedding-3-large (47.1%). The other 33 score higher: the ten best are large multi-billion-parameter or closed models, reaching up to 92.2%, and at least 9 are open models of up to 0.6B parameters, the smallest with 339M. We also scored 6 Kazakh-specific embedders shared on Hugging Face with the same code in one run: our model (77.3% there) is ahead of 4 of them, including the two E5-base models of similar size (72.6% and 69.0%), and behind kaz-embedder (86.0%, three towers with 1,695M parameters in total) and a BGE-M3 fine-tune (81.0%); at recall@10 its interval overlaps those of its nearest neighbours on both sides. Our four-language model, trained with a capped share of the same Kazakh pairs, is 2.8 points lower at recall@1, with overlapping recall@10 intervals. The Kazakh model also scores higher than the released model on the Uzbek and Kyrgyz versions of Belebele, but our Tajik model, trained without any Turkic pairs, gains as much there, so these gains are not specific to Kazakh training. Our Kazakh Wikipedia test questions come from the same generator family as the training questions, so we rest the main claims on Belebele.
46. 【2611.16384】Beyond Compressing Everything: Contrastive Memory Learning for Selective Context Compression
链接：https://arxiv.org/abs/2611.16384
作者：Sikui Zhang,Haowei Liu,Ziyun Gan,Chunfeng Yuan,Guangze Gao,Nian Liu,Boyu Cai,Bo Li,Xiaolei Lv,Jun Gao,Bing Li,Weiming Hu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：increasingly long inputs, converting long inputs, large language models, long inputs, soft context compression
备注： WSDM camera ready
点击查看摘要
Abstract:As large language models (LLMs) advance toward increasingly long inputs, soft context compression offers a promising approach to efficient inference by converting long inputs into compact memory slots. Under limited memory budgets, effective context compression remains challenging because task-relevant evidence varies substantially across queries, ranging from localized evidence to multiple distant spans or information dispersed throughout the full document. Instead of compressing everything indiscriminately, we propose CoMem, a query-guided selective context compression framework that learns memory representations conditioned on both the document and the query. CoMem develops Contrastive Compressor Learning to achieve query-sensitive yet context-preserving memory representations. To inject a strong prior over query-dependent evidence distributions, we devise a same-context hard negative mining strategy by pairing a single document with multiple queries, requiring the compressor to selectively retain information according to each query's distinct evidence needs. To address the restricted information flow imposed by causal masking, we further enable bidirectional attention among memory slots. Experiments demonstrate that CoMem consistently outperforms existing context compression methods across compression ratios on question answering and RULER-NIAH benchmarks. Our code is available at this https URL.
47. 【2611.16375】Recursive State-Augmented Language Models: Persistent Latent-State Adaptation of Pretrained Language Models
链接：https://arxiv.org/abs/2611.16375
作者：Omer Haq
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)
关键词：Language models rely, Language models, State-Augmented Language Models, pretrained language model, finite token contexts
备注： 13 pages, 2 figures. Preprint
点击查看摘要
Abstract:Language models rely on finite token contexts, limiting access to earlier interactions. We introduce Recursive State-Augmented Language Models (Recursive SALM), a framework in which a persistent latent state evolves with each observation and generates adaptations of a pretrained language model. A modular read-transition-write architecture separates observation encoding, latent dynamics, and predictor adaptation. We develop deterministic and stochastic formulations. The experiments evaluate only deterministic SALM with frozen GPT-2 small and exclude earlier evidence from its decoder context. On a four-turn hypothesis-inference task, latent-gated LoRA reaches 89.1% accuracy, comparable to 88.0% for a trained full-context LoRA baseline, with earlier evidence available solely through a 64-dimensional state. Zeroing or shuffling the state substantially reduces accuracy. In a two-turn task with codewords unseen in training, several interfaces improve candidate ranking over chance, but rarely generate the exact codeword under the evaluated training schedule. These experiments show that persistent latent-conditioned adaptation can support sequential inference when earlier evidence is absent from the decoder context.
Comments:
13 pages, 2 figures. Preprint
Subjects:
Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)
Cite as:
arXiv:2611.16375 [cs.LG]
(or
arXiv:2611.16375v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2611.16375
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
48. 【2611.16359】IsharaBART: An efficient BART-Based Framework for Low-Resource Bangla Sign Language Translation
链接：https://arxiv.org/abs/2611.16359
作者：Aonmoy Das,Ananna Dev Aishi,Md. Fazlul Kader
类目：Computation and Language (cs.CL)
关键词：users lack reliable, lack reliable automatic, Bangla Sign Language, automatic translation tools, reliable automatic translation
备注： 36 pages
点击查看摘要
Abstract:Millions of Bangla Sign Language (BdSL) users lack reliable automatic translation tools. Existing systems are limited by data scarcity, unidirectional design, and computationally expensive architectures that are not suitable for low-resource deployment. We introduce IsharaBART, a bidirectional generative framework for gloss-sentence translation in BdSL. IsharaBART uses Bidirectional and Auto-Regressive Transformers (BART)-based conditional language modeling with denoising learning objectives. We developed a parallel dataset of 1,000 professionally annotated gloss-sentence pairs, balanced across tenses and structures. We expanded the dataset to 4,831 pairs through four augmentation techniques: rule-based tense transformations, masked token substitutions, back-translation, and one-shot prompting. A compact denoising sequence-to-sequence model was pre-trained from scratch on monolingual Bangla text from six different corpora, then fine-tuned on the annotated and augmented datasets. We compare IsharaBART against four larger baseline models under identical conditions, where it achieves comparable or superior bidirectional performance. On the gloss-to-sentence (G2S) task, it attains Bilingual Evaluation Understudy (BLEU-4) score up to 51.7, and on the sentence-to-gloss (S2G) task, it achieves 61.40, outperforming multilingual models despite having fewer than 10% of the parameters. Ablation studies demonstrate that pre-training provides 62.5-90.4% faster convergence and 11.5-118% higher BLEU-4 than scratch. Low-rank adaptation (LoRA) reduces trainable parameters by 99.3%, but with 28.0-52.2% loss of BLEU-4 compared to full-parameter fine-tuning.
49. 【2611.16323】Does Deep Knowledge Tracing Learn Semantic Relations Between Knowledge Components?
链接：https://arxiv.org/abs/2611.16323
作者：Kia Karbasi,Mahdi Saiedi,Kevin Hong,Gregory Pottie
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Deep Knowledge Tracing, Knowledge Tracing, Deep Knowledge, shared latent state, knowledge component
备注：
点击查看摘要
Abstract:Deep Knowledge Tracing (DKT) is a knowledge tracing (KT) model that updates a shared latent state from sequences of interactions, each pairing a knowledge component (KC) with a response. An interaction with one KC can therefore affect predictions for other KCs. We ask: Are the KC relations learned by DKT semantic? We construct text-derived semantic KC representations using nine pipelines to test whether the conclusions hold across alternative ways of constructing those representations. The first test compares DKT-derived KC relation graphs with semantic relation structures induced by pairwise cosine similarities among the KC representations. Across the evaluated datasets, embedding models, and pipelines, the two structures align only weakly and inconsistently. The second test introduces semantic information into DKT; the pretrained text-derived representations do not consistently outperform the standard DKT baseline. In the reduced-data experiments, semantic initialization yields a higher test area under the ROC curve (AUC) than the baseline at eight of nine nested sample sizes for ASSISTments 2017. KC-supervised fine-tuned BERT produces small positive AUC differences in some matched comparisons, but the study does not establish their stability across runs. These effects remain limited and inconsistent. The findings suggest that behavioral, temporal, structural, or psychometric signals may also shape DKT's learned relations. DKT-derived relations are not primarily semantic: the tested text-derived semantic structures do not strongly recover the DKT-derived relation structure.
Subjects:
Machine Learning (cs.LG); Computation and Language (cs.CL)
Cite as:
arXiv:2611.16323 [cs.LG]
(or
arXiv:2611.16323v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2611.16323
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
50. 【2611.16321】From Large Language Models to Efficient System One Models via Adaptive Computation
链接：https://arxiv.org/abs/2611.16321
作者：Minh-Anh Nguyen
类目：Computation and Language (cs.CL)
关键词：Transferring LLMs, LLMs into System, language modeling head, models typically replaces, typically replaces
备注：
点击查看摘要
Abstract:Transferring LLMs into System One decision models typically replaces the language modeling head with a decision head while retaining the full backbone, making every decision pay for all layers. Yet it remains unclear how much depth such decisions require. We find that decision information is concentrated in intermediate layers, with early layers building essential features and the final six layers removable without loss, while independently trained smaller models largely mimic the full model rather than developing specialized decision capabilities. These findings suggest that efficiency requires not simply smaller backbones, but shared computation across different depths. Building on this, we propose \method{}, which jointly trains a full model with prefix sub-models that share its final layers and decision head through self-distillation. A lightweight gate reads the hidden state at each exit to determine whether additional computation is needed, allowing one model to operate at multiple layers. Across seven decision benchmarks, our approach matches or outperforms independently trained models at every depth, while achieving better accuracy-efficiency trade-offs through adaptive computation.
51. 【2611.16289】Eliciting and Mitigating Specification Satisficing in Coding Agents
链接：https://arxiv.org/abs/2611.16289
作者：Ruixin Wang,Tianyi Zhang
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：task description, agent, SWE-bench Pro, SatisFix, specification satisficing
备注： 12 pages, 2 figures, 7 tables
点击查看摘要
Abstract:Coding agents often fail to meet all requirements in the task description. In some of these failures, the agent considers an implementation choice that meets a requirement, but later decides to commit to another one that does not meet the requirement for a reason it finds acceptable. We call this specification satisficing. It is challenging to identify and mitigate specification satisficing because the agent accepts such choices for its own reasons, and existing self-correction methods are biased toward them. We propose SatisFix, which guides a coding agent to report these choices and their reasons, and then check each choice against the task description. We evaluate SatisFix on DeepSWE and SWE-bench Pro with five LLMs as backbones and two different agent frameworks, and compare it with three self-correction methods. SatisFix improves the pass@1 of the base agent by an average of 5.09% on DeepSWE and 7.06% on the hard subset of SWE-bench Pro. On DeepSWE, it outperforms the best baseline by 3.98%. Our ablation study shows that both steps of SatisFix contribute to the improvement.
52. 【2611.16270】SMIC: Shared Multiscale Input-Reference Conditioning across Transformer Layers for Natural Language Inference
链接：https://arxiv.org/abs/2611.16270
作者：Xin Zhang,Victor S. Sheng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Natural Language Inference, Language Inference models, Natural Language, Language Inference, sensitive to localized
备注：
点击查看摘要
Abstract:Natural Language Inference models can be sensitive to localized lexical changes. We introduce Shared Multiscale Input-Reference Conditioning (SMIC), which constructs a single input-dependent multiscale reference and reuses it across Transformer layers. Each layer applies its own multiscale transformation to the shared reference and injects the resulting conditioning feature before the attention update. We instantiate SMIC in a token--context Transformer (TCT) and conduct from-scratch comparisons against decoder-based and Multi-Layer Perceptron (MLP) baselines across all three ANLI rounds. TCT-SMIC attains the highest observed ten-seed mean accuracy on all three ANLI rounds. The ablations further support the contribution of SMIC. We evaluate a real-valued Llama-style plug-in and extend deletion/insertion diagnostics to pretrained ModernBERT encoder and Llama decoder models with and without SMIC. Across the evaluated perturbation protocols, TCT-SMIC exhibits comparatively low pooled-attention redistribution and smaller signed accuracy changes. We further establish a finite-sample bound on average subset-mass redistribution in terms of the mean Jensen--Shannon divergence between the restricted and renormalized attention distributions.
53. 【2611.16264】Label-Efficient Document-Grounded Factuality Detection via Cross-Paraphrastic Invariance Learning
链接：https://arxiv.org/abs/2611.16264
作者：Chao Chen,Shanshan Lin,Dongsheng Hong,Sibo Ju,Wenjie Yang,Sihong Xie,Xiangwen Liao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, generate fluent claims, document-grounded factuality detection, efficient document-grounded factuality, language models
备注： Accepted to IEEE TASLP 2026
点击查看摘要
Abstract:Large language models (LLMs) can generate fluent claims that are unsupported by a given source document, motivating accurate and efficient document-grounded factuality detection. Existing LLM-based evaluators often require repeated inference and incur high computational cost, whereas compact factuality detectors are efficient at inference time but commonly rely on large labeled or synthetically generated corpora. We propose CPIL (Cross-Paraphrastic Invariance Learning), a two-stage Siamese framework that converts a small labeled set into relational supervision without acquiring additional factuality labels. CPIL constructs positive pairs from distinct label-preserving paraphrastic views of the same document-claim instance and negative pairs from opposite-label examples associated with the same source document. It further introduces quantile-aware semi-hard negative mining, which derives a boundary from the positive-pair similarity distribution and balances informative negatives with broader coverage. In the two-stage training procedure, Stage 1 learns an encoder from these task-aware pairs, and Stage 2 jointly fine-tunes the encoder and a linear classification head for binary factuality prediction. At inference time, CPIL requires no paraphrase generation, pair construction, or Siamese comparison and uses only one encoder-classifier forward pass. On the 11-task LLM-AggreFact benchmark, CPIL-2% and CPIL-3% achieve macro-F1 scores of 81.04 and 81.60 while using only 2-3% of the FactCG-released labeled pool. Both settings outperform all compared compact detectors and two vanilla LLM references. Ablations and sensitivity analyses support the contributions of task-aware pair construction, dynamic negative mining, and multi-pivot paraphrasing.
54. 【2611.16260】Low Language Transfer Speech-to-Text
链接：https://arxiv.org/abs/2611.16260
作者：Husein Zolkepli
类目：Computation and Language (cs.CL)
关键词：multilingual speech recogniser, speech recogniser, recogniser has heard, language, points
备注：
点击查看摘要
Abstract:A multilingual speech recogniser has heard much speech in its own languages. We ask how much of that it brings to a language it was never trained on, when it is fine-tuned on the little that language has. We score 28 open multilingual models untouched on Low-Language-TTS, 50 low-resource languages in 11 writing systems, and fine-tune 24 of them on at most 1,000 clips a language, 82 hours in all, with a dev set choosing every epoch. Fine-tuning lowers every model's macro character error rate (CER), by 16.6 to 53.1 points, to 9.5 at best, and a word language model takes three CTC models 1.2 to 1.4 points lower; WER is still 34.4 at best. On the 12 languages that no model lists, every model starts at 46 or worse and the best ends at 11.7. The same architectures from random weights stay 60 points or more behind, so the gain is transfer, and an encoder left untouched already gives a Whisper or Qwen decoder most of what it needs. It is the language, not the corpus: on FLEURS recordings that ours do not share, the median model keeps 79% of its gain. It costs the languages the models knew, 5.7 points of CER on English, Spanish, French and German in the median model. Low-rank adapters on 4% of the weights come within 1.1 points of tuning everything, and on 2 of 3 models forget less. Seq2seq and language-model decoders are done within three to five epochs, while a new CTC head is still improving at twenty or thirty. Data beats epochs: 25 clips a language take Qwen3-ASR 0.6B from 60.9 to 39.3, and at equal clips presented, ten times the data is worth 9.7 points. A model that first learned forty of the languages learns the other ten no faster. On a public Malay benchmark, untouched Whisper large-v3 scores 8.9 when it detects the language and 14.9 when told the clip is Malay, because it then translates the English that speakers mix in; trained on the Scicom telephony dataset it scores 6.0.
55. 【2611.16228】Indic-Task Gains and Regressions after Reinforcement Learning
链接：https://arxiv.org/abs/2611.16228
作者：Sutanshu Saksena Raj,Daksh Maan,Avinash Benki,Parijat Chatterjee,Pasunuti Prasanjith,Purusharth Malik
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：run reinforcement learning, model covering English, reinforcement learning, covering English, GRPO
备注： Accepted at the GlobalSouthAI Workshop, NeurIPS 2026
点击查看摘要
Abstract:We run reinforcement learning (RL) with GRPO across four environments, starting from a supervised fine-tuned 30B-A3B mixture-of-experts model covering English and eight Indic languages. We compare the model before and after RL across 34 benchmarks in one evaluation campaign. MATH improves by 36.07 points, and most Indic benchmarks also improve. Yet XQuAD-Indic F1 falls 19.32 points as English answers rise from 8.7% to 91.7%; IndicQA falls 8.64, while English XQuAD gains 11.71 F1. A second RL run from the same supervised initialization adds an Indic environment together with language and repetition rewards. Compared with the released model, it improves both passage-answering and instruction-following benchmarks, along with preserving MATH performance. But it loses ground on reasoning and coding benchmarks. Several training choices changed together, so we cannot isolate the effect of any one of the reward terms. Script compliance remains unresolved. Adding a language reward did not ensure use of the requested script. Passage answering and script compliance therefore need direct evaluation, even when other benchmark scores improve.
56. 【2611.16223】We Are What We Remember: Mental-State-Driven Memory for Long-Term Character Dialogue
链接：https://arxiv.org/abs/2611.16223
作者：Zhicheng Jia,Shuchen Wu,Zhuoshi Tong,Haisen Liao,Sicheng Zhou
类目：Computation and Language (cs.CL)
关键词：mutual understanding, human dialogue, foundation of evolving, conversational memory systems, memory systems rely
备注： Zhicheng Jia, Shuchen Wu, and Zhuoshi Tong contributed equally to this work
点击查看摘要
Abstract:Shared history in human dialogue is not merely a repository of facts, but the foundation of evolving relationships and mutual understanding. However, mainstream conversational memory systems rely on passive semantic similarity over external fact stores, frequently retrieving topically similar records while missing relationally pivotal experiences. Inspired by cognitive psychology's Self-Memory System (SMS), we propose MindMem, a mental-state-driven memory framework that asynchronously consolidates shared experiences into source-linked mental states of the character, the user, and their relationship. At each turn, a specialized mental-state reasoner (Mind) contextualizes these persistent states to anticipate latent user needs, form proactive intentions, and recover supporting episodic evidence that surface-level matching overlooks. To evaluate history-sensitive adaptation beyond factual recall, we introduce MemReal-Bench, a longitudinal benchmark grounded in month-long real-user interactions across dyadic and group scenes. By pairing Direct Question Answering (DQA) with Situated Memory Realization (SMR), it tests whether agents bridge the gap between knowing past facts and naturally using shared history, world rules, and relational trajectories. On MemReal-Bench, MindMem reaches 59.03% SMR and 82.58% DQA, exceeding the strongest memory baseline by 24.19 and 9.19 percentage points, respectively, and outperforming oracle target-memory injection on SMR. Code and dataset are available at this https URL.
57. 【2611.16183】Data-Efficient LLM Safety Alignment Guided by Interpretable Features
链接：https://arxiv.org/abs/2611.16183
作者：Hongyu Li,Zhan Yu,Zhe Zhao,Kimmo Yan,Xiong Kuang,Renfen Hu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Existing large language, large language models, language models typically, models typically rely, Existing large
备注： 36 pages, 16 figures
点击查看摘要
Abstract:Existing large language models typically rely on massive fine-tuning datasets for safety alignment, which results in higher costs for safety alignment and often leads to the problem of over-refusal. We propose Less is Safer (LIS), a compact yet highly effective dataset for safety alignment, constructed through interpretable feature-guided selection and adversarial synthesis. Specifically, we leverage Sparse Autoencoder (SAE) activations to efficiently select prompts that cover diverse and interpretable safety features. Then, we employ a multi-agent adversarial synthesis framework to generate harmless prompts that nevertheless elicit unnecessary refusals. LIS contains only 2.4K samples, yet outperforms much larger datasets, e.g., TRIDENT-Core (26K), TRIDENT-Edge (19K) and WildJailbreak (262K), in overall performance on four safety and five over-refusal benchmarks. Through ablation experiments, we demonstrate that neither safety data nor over-refusal data alone can achieve optimal results. We also used safety features from SAE, annotated by an LLM, for data filtering, but the results were inferior to those obtained using the pipeline proposed in this paper.
58. 【2611.16174】JudgeMix: Judge-Guided Mixed-Rollout Data Synthesis for LLM Agents
链接：https://arxiv.org/abs/2611.16174
作者：Cheng-Yu Hsieh,Ting-Yao Hu,Sanjoy Chowdhury,Oncel Tuzel,Raviteja Vemulapalli
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：training LLM agents, Supervised fine-tuning, LLM agents, target model, training LLM
备注：
点击查看摘要
Abstract:Supervised fine-tuning (SFT) on expert trajectories is a standard paradigm for training LLM agents. However, it suffers from a well-known training-inference distribution mismatch, calling for target-aware data synthesis strategies that ground the training data in the target model's native state distribution. To bridge this gap, emerging approaches incorporate the expert either to guide mixed rollouts alongside the target model, or to provide dense step-wise supervision. Nonetheless, existing methods apply expert assistance blind to the target model's inherent behavior: they either disrupt the rollout using sub-optimal random intervention heuristics, or they enforce indiscriminate uniform supervision that unnecessarily overwrites the model's already-correct actions. We introduce JudgeMix, a judge-guided data synthesis framework that dynamically interleaves the target model and expert based on step-wise semantic evaluations. JudgeMix queries expert guidance precisely when the target model struggles, ensuring high trajectory success rates while keeping the state distribution aligned with the target model. It additionally uses the judge evaluation to reweight expert supervision on different steps, preserving model's inherent valid behavior while correcting its errors. On two agentic tool-use benchmarks, AppWorld and AutomationBench, JudgeMix demonstrates consistent superior performance to existing methods, with improvements up to 10 pass@1 points.
59. 【2611.16139】mporal Context-Aware Spam Detection Using Transformer-Based NLP Models
链接：https://arxiv.org/abs/2611.16139
作者：Fariz Zeynalov,Razim Mammadli
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：ignoring behavioral patterns, SMS spam detection, outbound SMS spam, Spam detection, single-message classification
备注： 7 pages, 2 figures, 5 tables
点击查看摘要
Abstract:Spam detection is usually treated as single-message classification, ignoring behavioral patterns that emerge across sequences of messages from the same sender. We study outbound SMS spam detection at the carrier level, where the goal is to predict at send time whether a carrier will flag a message as spam. Using a proprietary production database of 43,741 outbound SMS messages with UTC transmission timestamps and carrier delivery statuses, we report three sets of results. On an 8,749-message held-out test set, a TF-IDF + logistic regression baseline reaches AUC-ROC 0.8721, and a text-only DeBERTa-v3-base classifier reaches AUC-ROC 0.9011 and F1 0.8412. A deployed DistilBERT model augmented with inter-message temporal features reaches accuracy 0.8238, spam-class F1 0.8382, and recall 0.9128 at threshold 0.5 on a separate, class-balanced 20,000-message production evaluation set; these results are not directly comparable with the held-out test results. We also describe TemporalBertSpam, an architecture that encodes each sender's message history with a causal Transformer, and outline the same-split evaluation needed to measure its contribution.
60. 【2611.16104】Show Your Work in Swahili: Reinforcement Learning for Native-Language Mathematical Reasoning
链接：https://arxiv.org/abs/2611.16104
作者：Jessica Lundin,Katherine Rosenfeld,David Adelani,Geoffrey Mosoti Nyakiongora,Halfan Ngowo,Sloan Coffin,Ralph Abboud,Guillaume Chabot-Couture
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：present Fikiria, two-stage SFT, GRPO recipe, Swahili mathematical reasoning, Swahili mathematical
备注：
点击查看摘要
Abstract:We present Fikiria, a two-stage SFT+GRPO recipe for Swahili mathematical reasoning. Its reward multiplies a format gate by a weighted sum of answer accuracy and the ChrF\texttt{++} similarity of the Swahili reasoning to an in-language reference chain of thought, so that training targets the surface fidelity of the reasoning trace and not only the final answer. We train on a 2.3k-problem Swahili dataset created by translating GSM8K with GPT-4.1 and filtering with SSA-COMET. On AfriMGSM Swahili, Fikiria-AfriqueQwen-14B reaches 79.2\%. Under the same fixed prompt and strict answer-format scoring, GPT-4o reaches 68.0\%, partly because it often fails the required answer format; IrokoBench reports 78.8\% for GPT-4o using a best-per-model prompt, a figure numerically close to ours but not directly comparable. In a small human evaluation with co-author annotators, GPT-4o's outputs were preferred overall. ChrF\texttt{++} measures surface fidelity, not the validity of individual reasoning steps.
61. 【2611.16064】Privileged Information Does Not Guarantee Privileged Guidance: Auditing On-Policy Self-Distillation for Reasoning Models
链接：https://arxiv.org/abs/2611.16064
作者：Haoyi Qiu,Akshat Agarwal
类目：Computation and Language (cs.CL)
关键词：On-policy self-distillation, additionally receives privileged, student, receives privileged information, solution
备注： Work in progress
点击查看摘要
Abstract:On-policy self-distillation (OPSD) trains a student on next-token targets from a teacher, a frozen copy of the student that additionally receives privileged information, such as a worked solution, hidden from the student. Whether student gains reflect that information remains unclear. Taking the worked solution as privileged information, we audit four stages across three Qwen3 scales on mathematics: Source, whether the teacher can use the solution; Encoding, whether the resulting token targets are useful; Transmission, whether the student learns from the targets; and Expression, whether the student applies the learned behavior without the solution. With the solution, the teacher solves hard problems and recovers from student errors, yet the teacher does not reliably recognize errors, and its token targets do not favor correct trajectories. Repeated training makes successes within the student's reach more frequent rather than unlocking new ones, and corrections the student learns to predict are not reliably expressed in free generation. To isolate the solution's contribution, we vary its availability separately from teacher and student thinking modes. The largest gains occur when a teacher in thinking mode supervises a student trained and evaluated without an explicit thinking trace, and problem-only teachers often match or exceed privileged-solution teachers: the gain tracks the teacher's thinking mode rather than the solution, a pattern we call reasoning arbitrage. Accuracy gains alone therefore do not establish transfer of reasoning from privileged solutions: bottlenecks lie after Source, across Encoding, Transmission, and Expression. Future evaluations must measure what the solution adds to otherwise identical training.
62. 【2611.16051】Human-Likeness and Conversational Preference Diverge for Synthesized Agent Speech in Customer-Service Calls
链接：https://arxiv.org/abs/2611.16051
作者：Jeffrey M. Girard,Antony D'Avirro,Jason Z. Zheng,Jacqueline R. Vertino,Benjamin Peloquin
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
关键词：human it sounds, conversational preference, conversational, preference, human-likeness
备注： 5 pages, 3 figures
点击查看摘要
Abstract:Listeners can judge an agent's speech on how human it sounds (human-likeness) and on how much they would want to talk to it (conversational preference). Listening tests rarely ask about conversational preference, so the relation between the two judgments is unclear. We compared them in paired-choice tests on 120 turns that actors improvised as customer-service representatives. On each trial, two agents spoke the same turn. In Study 1, both agents came from six commercial text-to-speech systems, each with eight voices. In Study 2, one was the actor's original recording and the other a system. Some systems ranked higher on human-likeness, and others on conversational preference. Listeners chose systems over actors in 19% of human-likeness trials but 36% of conversational preference trials (and 49% for the most preferred system). On both judgments, variation among a system's voices was about three-quarters of that between systems. Of three automatic naturalness scores, two predicted lower human-likeness, and none predicted conversational preference. In this setting, listeners tended to favor faster speech and fewer pauses between clauses on both judgments, and more pitch variation for conversational preference. Thus, measuring only human-likeness or testing one voice per system can misjudge which agents listeners would rather talk to.
63. 【2611.16028】Scaling public input on AI policy with pluralistic agents
链接：https://arxiv.org/abs/2611.16028
作者：Jacy Reese Anthis,Ken Burke,David Madras,Crystal Qian,Meredith Ringel Morris,Logan Cross,Caroline Pantofaru,Utsav Prabhu
类目：Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：pluralistic agents, cultural environments, agents, application domains, vast range
备注：
点击查看摘要
Abstract:AI is being deployed across a vast range of application domains, cultural environments, and human stakeholders. Safe and responsible AI development requires continuously accounting for diverse perspectives. We develop and test pluralistic agents, AI agent representatives that deliberate on behalf of individuals to align AI systems with diverse human perspectives. Pluralistic agents could help people contribute to many more discussions than they could directly participate in, on technical topics that would require training, and on policy choices that rely on private information that corporations and governments cannot readily share. Our experiments identify opportunities, risks, and perceptions of pluralistic agents. Agents were able to reliably shift policies in the direction of their represented persona's preferences, but the extent of each agent's influence was sensitive to the instructions from its persona, such as having more influence when instructed to be more verbose or less cooperative. This suggests that influence in AI-assisted deliberation could vary based on how participants prompt their agents and how the system is designed. In a preregistered study, 746 humans participated in the pluralistic agents process. Participants viewed pluralistic agents as useful and fair, preferring agents over the baseline of providing input to a single AI reasoning model. Most participants preferred participating themselves over either pluralistic agents or the baseline, but pluralistic agents recovered 68% of the baseline-direct gap in reported satisfaction and 82% in fairness. Because pluralistic agents can be used in many real-world contexts where direct discussion is not, they could be a promising tool to scale AI safety policy development. We encourage cautious exploration of this method, playing to its strengths as an amplifier of human input rather than a replacement.
64. 【2611.15989】What Roles Do System Prompts Really Assign? Validating and Steering Occupational Role Vectors in LLMs
链接：https://arxiv.org/abs/2611.15989
作者：Jose L. Sampedro Mazon,Ilmi Yoon,Nadim Saad
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Applications built, large language models, language models assign, role, intending to shape
备注： 11 pages main text, 35 pages total including references and appendices. Code and data: [this https URL](https://doi.org/10.5281/zenodo.23992923)
点击查看摘要
Abstract:Applications built on large language models assign the model a role through its system prompt, intending to shape how it responds for their use case. We introduce a validation framework for extracting and injecting occupational role vectors, activation-level directions that capture how someone in a given occupational role would distinctively respond to a task or question. We validate these vectors through two complementary lenses, on Qwen2.5-7B-Instruct and Llama-3.1-8B-Instruct. The interpretability lens asks whether each vector is a stable, separable, domain-consistent representation of its role: extracted vectors are highly reproducible across repeated runs and sampling temperatures, remain separable even for very similar roles, and agree more with themselves across in-domain and out-of-domain questions than with other roles' signal. The control lens asks whether injecting a role vector during generation makes the model express the role, and sustain it over a conversation, as well as a role prompt does. On Qwen, injecting the vector alone makes the model express the intended role substantially more often than unsteered, but at best matches a role prompt; on both models, adding the vector to the prompt strengthens the role in single answers but did not slow the role's decline over 30 turns. Together, the two lenses show why both are needed: out of domain the role is expressed only subtly, yet the activations still encode it; and a vector that is stable and separable can still barely steer the model's behavior.
65. 【2611.15971】Better Boundary Prediction Does Not Guarantee Better Structural Representation
链接：https://arxiv.org/abs/2611.15971
作者：Michael Zhou,Markus Frohmann,Junghyun Min,En-Shiun Annie Lee
类目：Computation and Language (cs.CL)
关键词：carrying linguistic information, mark phrase boundaries, phrase boundaries, Punctuation marks, carrying linguistic
备注： Presented at LP4FM @ NeurIPS 2026
点击查看摘要
Abstract:Punctuation marks often mark phrase boundaries, carrying linguistic information. Therefore, punctuation marks' abundance and feasibility as proxies of linguistic structure has led to suggestions that using punctuation marks to optimise on phrasal structure may help language models (LMs) improve their representations of argument, semantic, and syntactic structures. In this paper, we test the above claim in English across three primary LM architectures: decoder-only, encoder-only, and encoder-decoder LMs, by complementing traditional token prediction with punctuation restoration (PR). Our evidence, collected at the 1B parameter scale, suggests that optimising for boundary prediction does not necessarily guarantee higher-quality structural representation in decoder-only, encoder-decoder, and encoder-only LMs, failing to improve performance on downstream tasks that require understanding structure in linguistic input.
66. 【2611.15961】Is Spoken Hungarian Low-resource?: A Quantitative Survey of Hungarian Speech Data Sets
链接：https://arxiv.org/abs/2611.15961
作者：Péter Mihajlik,Katalin Mády,Anna Kohári,Fruzsina Sára Vargha,Gábor Kiss,Tekla Etelka Gráczi,A. Seza Doğruöz
类目：Computation and Language (cs.CL)
关键词：data sets, Hungarian, data, speech data sets, sets
备注： LREC 2024
点击查看摘要
Abstract:Even though various speech data sets are available in Hungarian, there is a lack of a general overview about their types and sizes. To fill in this gap, we provide a survey of available data sets in spoken Hungarian in five categories (e.g., monolingual, Hungarian part of multilingual, pathological, child-related and dialectal collections). In total, the estimated size of available data is about 2800 hours (across 7500 speakers) and it represents a rich spoken language diversity. However, the distribution of the data and its alignment to real-life (e.g. speech recognition) tasks is far from optimal indicating the need for additional larger-scale natural language speech data sets. Our survey presents an overview of available data sets for Hungarian explaining their strengths and weaknesses which is useful for researchers working on Hungarian across disciplines. In addition, our survey serves as a starting point towards a unified foundational speech model specific to Hungarian.
67. 【2611.15925】ShadowBench: Exposing Lexical Anchoring and the Illusion of Forgetting in Large Language Models
链接：https://arxiv.org/abs/2611.15925
作者：Sujan Maharjan,Lu Liu
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large Language Models, Large Language, Latent Entity Association, Language Models, emerged as primary
备注： Accepted at NeurIPS 2026 Evaluations and Datasets Track
点击查看摘要
Abstract:Large Language Models (LLMs) have emerged as primary interfaces for factual retrieval, yet current evaluation paradigms rely almost exclusively on explicit entity names. In this work, we demonstrate that LLM knowledge is fundamentally lexically anchored: models possess extensive factual information but find it significantly difficult to retrieve without explicit name tokens. To quantify this limitation, we introduce ShadowBench, a rigorously hardened, shortcut-resistant benchmark designed to evaluate Latent Entity Association via a novel Dual-Trait Association (DTA) task. Our evaluation reveals a pervasive "Shadow Gap" across all model scales$\unicode{x2013}$up to the frontier models GPT-5.4 and Claude-Sonnet-4.6$\unicode{x2013}$where removing lexical anchors causes performance drops of over 20%. Furthermore, we demonstrate that this lexical dependency exposes a critical vulnerability in AI safety. Applying ShadowBench to Machine Unlearning, we find that state-of-the-art algorithms (e.g., Gradient Difference, NPO) achieve only superficial lexical erasure. While unlearned models fail on direct queries, our novel Latent Entity Leakage Rate (LELR) metric reveals that for popular entities, models explicitly reconstruct the "forgotten" entity in their internal reasoning traces in over 74% of cases, utilizing residual shadow knowledge to solve associative tasks. Conversely, for niche entities, models retain high shadow accuracy (60-90%) via implicit attribute correlation despite 0% LELR. Ultimately, ShadowBench indicates that current unlearning paradigms create an "Illusion of Forgetting," demonstrating that existing methods act as superficial output filters and are not yet reliable for achieving true parametric erasure.
68. 【2611.15904】HeriKGQA: Grounded Knowledge-Graph Question Answering over Cultural Heritage Sensor Data
链接：https://arxiv.org/abs/2611.15904
作者：Lingxiao Kong,Vasileios Arampatzakis,Vasileios Sevetlidis,George Pavlidis,Zeyd Boukhers
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR)
关键词：requires database expertise, Cultural heritage sites, data requires database, Large Language Models, Cultural heritage
备注： Submitted to NAACL 2027 industry track
点击查看摘要
Abstract:Cultural heritage sites are increasingly monitored by sensor networks, but querying their data requires database expertise. Large Language Models (LLMs) offer a natural-language interface, yet over raw sensor records they lose track of which sensor, site, and time each value belongs to, and silently miscompute. We present HeriKGQA, a knowledge-graph question-answering method that confines the LLM to interpreting questions and phrasing answers, leaving computation to SPARQL and deterministic code. Questions are parsed into intents constrained by a heritage ontology aligning W3C SOSA/SSN with CIDOC-CRM, compiled into SPARQL, and answered from query results and temporal, spatial, and anomaly facts derived by a grounding layer, with error correction guarding each LLM step. On 500 questions over real data from five heritage sites, HeriKGQA reaches 99.0% accuracy, 18.2 points above the strongest of three baselines using the same LLM and receiving the same anomaly rules and answer conventions, with comparable answer quality while running almost four times faster. Without grounding, accuracy drops by 12.2 points and on anomaly questions from 99% to 66%. We report lessons from development and live deployment.
69. 【2611.15809】Fine-Grained Generative Hallucination Detection and Correction for Aerial Image Captioning
链接：https://arxiv.org/abs/2611.15809
作者：Debolena Basak,Somsubhra De,Maunendra Sankar Desarkar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large-scale environmental monitoring, unmanned aerial vehicles, disaster response, plays a vital, environmental monitoring
备注： Accepted at ACCV 2026
点击查看摘要
Abstract:Aerial imagery captured by unmanned aerial vehicles (UAVs) plays a vital role in applications such as surveillance, disaster response, and large-scale environmental monitoring. Automatic generation of textual descriptions for such imagery is essential for reducing manual inspection overhead and enabling better downstream decision-making. However, Multimodal Large Language Models (MLLMs), despite their impressive captioning capabilities, are prone to hallucination, producing descriptions that are inconsistent with the visual input. This problem is significantly amplified in aerial imagery due to its unique challenges such as extreme viewpoint variation, small objects, class imbalance, and ambiguous visual entities. Existing hallucination detection approaches either rely on computationally expensive large external models such as GPT-4, which perform poorly on aerial domains, or treat the problem as a rigid binary classification task, ignoring the inherent uncertainty in ambiguous cases. To address these limitations, we propose a lightweight, reference-free framework for hallucination detection and correction in free-form aerial image captioning. Our method leverages state-of-the-art MLLMs, specifically InternVL3 and Qwen2.5-VL, to detect hallucinated content in generated captions with minimal computational overhead. Detected hallucinations are corrected through a dedicated refinement module that improves the factual consistency of the original captions. Extensive experiments on the Labelled Illusion Dataset (LID) demonstrate that our framework significantly reduces hallucination rates while remaining practical for real-time deployment in resource-constrained environments. Code is available at: this https URL.
70. 【2611.15804】Computational Explanations of Semantic Universals
链接：https://arxiv.org/abs/2611.15804
作者：Shane Steinert-Threlkeld,Jakub Szymanik
类目：Computation and Language (cs.CL)
关键词：express meaning, world share, share many deep, deep features, semantic universals
备注： submitted to Cambridge Elements in Semantics
点击查看摘要
Abstract:Despite their differences, the languages of the world share many deep features when it comes to how they express meaning. These semantic universals are likely to reflect shared aspects of human cognitive, communicative, and social structure. Recent advances in cross-linguistic semantics and computational linguistics allow us to develop explanations of the sources of such properties. This Element presents a body of work doing just that: we explicate a framework for providing computational explanations of semantic universals and then describe several such explanations using principles of ease of learning and efficient communication. Empirical domains include quantifiers, color terms, modals, and indefinites. After providing these explanations, we provide a discussion of future directions for advancing the explanatory power of computational methods in semantic typology.
71. 【2611.15779】Honesty Is a Race: Predicting When Verifiable-Reward RL Teaches a Model to Bluff
链接：https://arxiv.org/abs/2611.15779
作者：Nathaniel Bottman,Alexei Oblomkov
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：model, opposite places, honest, honest verdict, run
备注： 34 pages, 10 figures
点击查看摘要
Abstract:Two rewards with the same expected payoff at the start of training can end a reinforcement-learning run in opposite places, with an honest model or one that bluffs. We study rewards that pay $b$ for a verdict that a checker cannot verify ("this program is correct") and $r$ for a certificate that it accepts (an input revealing a bug). To first order, a GRPO step makes the model more honest exactly when $\tilde{p}\,r/b1+\kappa$. Here $\tilde{p}$ is the rate at which the checker accepts the model's certificates, weighted toward the items on which the model still gives both verdicts, and $\kappa$ is the pull of the items on which the unverifiable verdict is right. Both terms move during training. A checker raises $\tilde{p}$, so near the threshold honesty is a race, which a run just below the threshold can win and a run under a lottery (random pay with the same mean) cannot. The term $\kappa$ starts large and falls as the other items settle, so a run just above the threshold first dips toward bluffing, on code nearly to zero, before climbing back. Paying the honest verdict also pulls the other items toward it, which predicts a ceiling on the payoff ratio, above which the model gives the honest verdict where it is wrong. On propositional Datalog, two code models, and abstention on grade-school math, with $p$ the model's success rate before RL, no run above $pr/b=1$ ends collapsed, and runs under the checker can survive slightly below it. At $pr/b=3$, above the ceiling, both code models call about half of correct programs buggy. On depth-3 Datalog, training generously under the checker and then cutting the payoff keeps the model at least 67% honest in three seeds, at a ratio where the same model trained from the start falls to 4-15% and is at most 47% honest after 160 steps. On depth-2 Datalog, when honesty collapses, a linear probe fit before RL still reads the truth.
72. 【2611.15777】SO-Arena: Benchmarking the Capability Spectrum and Reliability of System One Models
链接：https://arxiv.org/abs/2611.15777
作者：Lichen Li,Ziping Dong,Sicheng Feng,Qi Li,Xinchao Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：lengthy token generation, models promise fast, capability spectrum, promise fast, token generation
备注： 32 pages, 10 figures, 7 tables. Project page: [this https URL](https://lichenlillc.github.io/SO-Arena)
点击查看摘要
Abstract:System One models promise fast, general-purpose decision-making without lengthy token generation. However, understanding their capability spectrum and decision reliability requires more than aggregate performance on current benchmarks. Existing evaluations often provide limited insight into the breadth of model capabilities and the reliability of their decisions. We introduce SO-Arena, a benchmark characterizing the capability spectrum and decision reliability of System One models across 11 domains and five capability families. For the capability spectrum, SO-Arena offers evidence-grounded evaluation through reliable sources and manual verification of reference labels against model-visible inputs; fine-grained capability assessment through domain-specific difficulty criteria; and realistic interactive evaluation, where models iteratively execute actions in sandboxes. Reasoning-intensive tasks further enable system one-two comparison. Beyond accuracy, SO-Arena assesses decision reliability through two complementary measures: decision stability under controlled option-set changes and missing-answer recognition when no valid option is available. Evaluations across 21 models reveal that the benefits of scaling and additional reasoning vary substantially across domains. More importantly, strong overall performance does not necessarily imply reliable decision-making: the best-performing System One model ranks only seventh in reliability. Together, these findings highlight the need to characterize capability spectrum and decision reliability as complementary dimensions, providing a systematic view of the strengths and limitations of System One models.
73. 【2611.15735】Where Is Uncertainty Observed? A Mechanistic Understanding of Uncertainty Quantification in LLMs
链接：https://arxiv.org/abs/2611.15735
作者：Xiaoyu Liang,Virginia Ceccatelli,Aliai Eusebi,Tobias Braun,Nils Loose,Carlo Malagnino,Lorenzo Cavallaro
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：large language model, large language, trusted is critical, lens observes, Knowing
备注：
点击查看摘要
Abstract:Knowing when a large language model's (LLM's) response can be trusted is critical for its safe use. Uncertainty quantification (UQ) can help LLMs recognize if their responses may be unreliable. Existing taxonomies organize UQ methods by uncertainty source or estimation mechanism. They leave unresolved the question of where uncertainty is observed in the model's computation. The answer matters because the observation point determines whether an estimator has access to enough information to recover a given target, and how well it can recover it. Drawing on mechanistic interpretability, we define four mechanistic observation lenses: the structural lens observes component updates, the representational lens observes hidden states, the distributional lens observes token probabilities, and the semantical lens observes distributions over meanings. We relate these lenses through the residual stream and order them by the information they carry, which gives a principle for selecting UQ methods for different targets. We survey existing methods through the four lenses. Furthermore, we distinguish evaluation targets, criteria, and metrics to clarify different UQ evaluation protocols. Finally, we identify open problems and research directions to connect uncertainty estimation to the internal computation and downstream use of LLMs.
74. 【2611.15717】Outside the Purview of the Reward: Capability Drift in Multilingual Post-Training
链接：https://arxiv.org/abs/2611.15717
作者：Sutanshu Saksena Raj,Purusharth Malik,Pasunuti Prasanjith,Daksh Maan,Parijat Chatterjee,Avinash Benki
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：weakening capabilities users, improve rewarded behavior, rewarded behavior, behavior while weakening, weakening capabilities
备注： Accepted at the Foundations of LLM Post-Training in Changing Environments, NeurIPS 2026
点击查看摘要
Abstract:Post-training can improve rewarded behavior while weakening capabilities users still need. We study two GRPO branches from a shared supervised checkpoint in a multilingual mixture-of-experts model. The released branch gains 36.07 points on MATH but loses 19.32 F1 points on XQuAD-Indic, while XQuAD-English improves under the same scoring rule. An independently trained sibling adds Indic instruction following and language-aware shaping. It recovers the regressing Indic task scores and preserves MATH, but does not restore script compliance and trades off competition mathematics and code. In a later round, judge training is followed by a sharp extraction decline from the Indic branch; reward-free distillation from its earlier checkpoint restores most of the lost F1. A MATH score decomposition associates most of the measured gain with increased boxed-answer emission; accuracy among boxed answers changes little. These results show why benchmark scores should be read alongside the response forms they reward.
75. 【2611.15710】Curiosity-0826-4B: Generative Medical Event Sequence Modeling Across Pediatric and Adult Populations
链接：https://arxiv.org/abs/2611.15710
作者：Mani Nagarathnam,Luke Benham,Paul Blazek,John Cashy,Kevin Chung,John Muenning,Hank Voeller,Shane Waxler,Davis White,Alison Callahan,Kevin Dysart,Andrew Loza,Michal A. Mankowski,Mattheus Ramsis,Nigam H. Shah,Karen K. Wong,Rahul Shah
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Epic Cosmos, trained on Epic, Cosmos that simulates, generative medical event, medical event foundation
备注：
点击查看摘要
Abstract:We introduce Curiosity-0826-4B, an updated version of the generative medical event foundation model trained on Epic Cosmos that simulates patient timelines to produce zero-shot clinical predictions. Curiosity-0826-4B incorporates a broader patient population and richer clinical event representations, while generally matching or exceeding Curiosity-0226-1B, the largest model in the previous Curiosity-0226 series, on evaluated tasks supported by both models. Laboratory value prediction improved, with MAE 18--46% lower than that of Curiosity-0226-1B. We evaluated prediction of disease events across pediatric cohorts aged 2--17 years. AUROCs for new asthma diagnosis (0.742--0.785) and asthma exacerbation (0.829--0.852) were comparable to those in the adult reference cohort, while AUROCs for sickle cell crisis (0.820--0.847) were lower than in adults (0.915). Explicit representation of documented death enabled new mortality prediction tasks among adults across hospice, inpatient, and ambulatory settings (AUROC 0.821--0.942). Scaling-law analysis guided compute-optimal initial pretraining followed by continued pretraining with context extension. The resulting Curiosity-0826-4B model has more parameters (4.3B versus 1B) and a longer context window (16K versus 8K). It processes 56% fewer training tokens and requires 2.2 times the training floating point operations (FLOPs) compared with its predecessor. By extending a common zero-shot prediction strategy to pediatric patients and additional outcomes, Curiosity-0826-4B broadens opportunities to develop clinical and operational applications without training separate task-specific models. Further validation should assess local calibration, performance across patient subgroups and event frequencies, timeline completion rates, and generalization to new settings, alongside prospective evaluation of clinical and operational utility.
76. 【2611.15691】Dynamic Block-Online Streaming ASR for Low-Resource Agglutinative Code-Switching Speech with Morphology-Aware Evaluation
链接：https://arxiv.org/abs/2611.15691
作者：Kazi Rafat,Afifa Imran,Md. Ismail Hossain,Md. Romzan Ali,Fuad Rahman,Sifat Momen,Shafin Rahman,Nabeel Mohammed
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：suffixes cross code-switch, grapheme order diverges, cross code-switch boundaries, challenge low-latency ASR, languages challenge low-latency
备注： Published at Interspeech 2026 (oral). 5 pages, 3 figures, 1 table. Code: [this https URL](https://github.com/King-Rafat/Dynamic_Streaming_ASR)
点击查看摘要
Abstract:Low-resource, agglutinative languages challenge low-latency ASR, as fixed lookahead windows fail when grapheme order diverges, suffixes cross code-switch boundaries, or code-switching data is imbalanced. We present the first comprehensive study of streaming ASR for intra-sentential Bangla-English code-switching, identifying a mismatch between strict causal streaming and long-range morphological dependencies. We introduce a Dynamic Block-Online framework with VAD-aligned inference that balances semantics, latency, and context, enabling global bidirectional attention to preserve morphological integrity. To mitigate data scarcity, we propose Script-Anchored Loanword Injection, augmenting training text with English loanwords to model phonotactic transitions. We introduce CS-WER to diagnose switch, root, and suffix errors, and show that flexible latency budgets enhance recognition of agglutinative and mixed-language speech, with successful transfer to menstrual-medical domains.
77. 【2611.15661】ALMeD: Medieval French Gold-Standard
链接：https://arxiv.org/abs/2611.15661
作者：Ragini Menon,Sabine Tittel
类目：Computation and Language (cs.CL)
关键词：Romance vernacular languages, Romance vernacular, Medieval French, vernacular languages, significant history
备注：
点击查看摘要
Abstract:Medieval French is one of the Romance vernacular languages with a significant history of transmission and an enormous influence on other vernacular languages of the time. The sources convey valuable knowledge about all aspects of culture. The study of Medieval French has, over the last few years, increasingly benefited from NLP-based methods. There have been numerous efforts to parse medieval French; however, these efforts use corpora comprising legal texts and -- primarily -- literary texts as their foundation and training data. This means that, except for juridical resources, scientific literature is overlooked. We present ALMeD, an annotated, semantically rich corpus (work-in-progress) of medical and surgical treatises produced in medieval French, i.e., Old and Middle French, including Anglo-Norman. Our semantically disambiguated gold standard goes beyond existing resources, focusing on medical terminology, and accounts for morphological development, evolving syntactical structures and the lack of spelling normalisation in these languages.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2611.15661 [cs.CL]
(or
arXiv:2611.15661v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.15661
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Journalreference:
HLAI 2026 Conference Companion, pp. 1-6 (2026)
Related DOI:
https://doi.org/10.5281/zenodo.20757705
Focus to learn more
DOI(s) linking to related resources</p>
78. 【2611.15655】Can Agents Relive Past Experiences? Diagnosing Event-Affect Decoupling in Affective-Episodic Retrospection
链接：https://arxiv.org/abs/2611.15655
作者：Tingna Xie,Ming Wang,Shi Feng,Yongkang Liu
类目：Computation and Language (cs.CL)
关键词：memory-augmented agents increasingly, agents increasingly support, increasingly support long-term, personalized interactions, memory-augmented agents
备注：
点击查看摘要
Abstract:As memory-augmented agents increasingly support long-term and personalized interactions, reliable recall of emotional experiences while preserving their associated affect becomes necessary. However, existing evaluations usually assess emotion accuracy and factual memory grounding separately, overlooking event-affect correspondence. In this work, we formulate Affective-Episodic Retrospection (AER) as a task that explicitly evaluates the recovery of past events, associated affects, and their correspondence, and define Event-Affect Decoupling as a failure mode where the correct emotion is recalled but associated with the wrong episode. To diagnose Event-Affect Decoupling, we propose EM-TRACE, a stage-wise framework that decomposes AER into retrieval, affect recovery, and realization. On a controlled GoEmotions-based benchmark, Emotion-only retrieval achieves 28.65% affect recovery but retrieves the target episode for only 4.44% of queries, yielding a UAR of 24.21%. Further analysis reveals that event retrieval and affect assignment introduce distinct binding failures. These findings show that reliable AER requires grounded recall of emotional experiences, where episode retrieval, affect recovery, event-affect binding, and generation quality should be evaluated jointly. Our code is available at this https URL.
79. 【2611.15642】Differential Backpack Language Models: Sense Inhibition via Signed Contextualization Weights
链接：https://arxiv.org/abs/2611.15642
作者：Konstantinos Skianis,Giannis Nikolentzos,Polykarpos Meladianos,Michalis Vazirgiannis
类目：Computation and Language (cs.CL)
关键词：non-negative contextualization scores, Backpack language models, per-word sense vectors, non-contextual per-word sense, strictly linear combination
备注：
点击查看摘要
Abstract:Backpack language models predict with a strictly linear combination of non-contextual per-word sense vectors, weighted by non-negative contextualization scores. We show that non-negativity conflates two properties: the linear readout, which carries the interpretability, and the conic combination, which merely restricts it. We relax the latter by computing the sense weights with differential attention, a difference of two softmax maps with a learned per-sense gain, so context can actively inhibit a sense; we call the result a differential Backpack. At equal parameters on WikiText-103 this cuts the Backpack's perplexity gap to a Transformer by 31%, improves over the softmax Backpack at every sense count, persists with a shrinking margin up to 350M parameters on OpenWebText, and is localized at the sense layer by ablations and controls. The learned inhibition is directly interpretable (a financial context drives the river sense of bank to -0.50), and the preserved per-sense attribution predicts counterfactual removals exactly. We tested a number of combination rules, showing the linear interface is nearly free. Making the readout nonlinear gains only 0.43 perplexity points while invalidating two thirds of the decomposition. The differential Backpack's senses are also better representations, improving zero-shot sentence similarity by up to 33%.
80. 【2611.15639】ChJGBench: A Comprehensive Benchmark for Chinese Legal Judgment Generation with Diagnostic Evaluation
链接：https://arxiv.org/abs/2611.15639
作者：Yinghao Hu,Linggang Kong,Qian Xiao,Yuting Huang,Yunlong Zhang,Yujie Zhang,Yiquan Wu,Fei Duan,Kaisong Song,Jun Lin,Kun Kuang,Fei Wu
类目：Computation and Language (cs.CL)
关键词：valid judicial documents, reliably generate complete, legally valid judicial, development of LLMs, increasing attention
备注： 25 pages, 3 figures. Published in EMNLP 2026 (main conference)
点击查看摘要
Abstract:With the rapid development of LLMs, increasing attention has been paid to whether they can reliably generate complete and legally valid judicial documents. This calls for a benchmark capable of evaluating whether models can accurately apply statutes and resolve outcome-critical issues, including claims, charges, penalties, and monetary obligations. However, existing benchmarks typically focus on isolated legal tasks or coarse-grained evaluation. We introduce ChJGBench, a benchmark for generating the reasoning and dispositive sections of Chinese judgments across civil, criminal, and administrative cases. Built from 3,462 real-world judgments, ChJGBench provides a case-type-aware diagnostic evaluation framework comprising 13 metric types and adopts a hybrid paradigm. Experiments reveal no uniform advantage for legal-domain models over general-purpose models, with model strengths varying across diagnostic dimensions. Performance is generally stronger on criminal cases, while civil and administrative cases continue to present substantial challenges.
81. 【2611.15597】When Local Definitions Are Missing: Stable Errors in Language Models
链接：https://arxiv.org/abs/2611.15597
作者：Zengqing Wu,Chuan Xiao
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：technical manuals, online communities, words special meanings, definition, special meanings
备注：
点击查看摘要
Abstract:Contracts, technical manuals, and online communities often give familiar words special meanings and define them in one place. A language model that reads a passage without that definition may use the usual meaning and give an answer that sounds right but is wrong. We study this with multiple-choice questions whose correct answers depend on a local definition. The questions come from a synthetic vocabulary, commercial contracts, Reddit community glossaries, and the documentation of a decentralized exchange. We ask three language models each question with and without the definition. Without using the answer key, we then test whether their repeated answers and stated confidence reveal their own errors. Separately, we give a small open model the answer key and test whether it can predict which questions larger models get wrong. We report three findings. (1) Familiar words that a source redefines cause the most errors. Models often repeat the same wrong answer, and neither repeated answers nor stated confidence reliably flag it. (2) The source definition fixes most errors on synthetic questions, but a definition drawn from the model's own prior knowledge does not. In real contracts, the source definition fixes only about half of the errors. (3) Given an answer key, a small model can rank questions by how likely larger models are to get them wrong. These results call for tests that check answers against the full source, including its local definitions.
82. 【2611.15587】VWEN: A Curated Small Language Model for Vietnamese Paraphrasing
链接：https://arxiv.org/abs/2611.15587
作者：Sang Quang Nguyen
类目：Computation and Language (cs.CL)
关键词：Vietnamese paraphrasing, related tasks, register transfer, present VWEN, paraphrase judgement
备注：
点击查看摘要
Abstract:We present VWEN, a 0.8B-parameter model for Vietnamese paraphrasing at a requested level of change and for five related tasks: generating several paraphrases, simplification, gist, register transfer and paraphrase judgement. VWEN is Qwen3.5-0.8B fine-tuned on about 7k samples chosen by a four-stage pipeline: rules and deduplication, a bidirectional entailment filter, a divergence score that assigns low and high paraphrase levels, and selection for coverage and instruction-following difficulty. We compare it with paraphrase-only recipes from the same pipeline and with training on the ViSP corpus under matched and larger step budgets. On high-divergence paraphrasing, VWEN reaches a success rate (requested level reached and meaning preserved) of 0.61 against 0.46 for the ViSP model at matched compute, a difference that holds on inputs resembling ViSP. Given four times more training examples, the ViSP model closes the gap on such inputs but not on questions, which ViSP lacks and which it often turns into statements. Across all comparisons the entailment filter is the most effective stage. Training on paraphrases alone erases abilities of the base model that the multi-task data preserves.
83. 【2611.15572】Learning a calibrated decision head from logged bandit feedback
链接：https://arxiv.org/abs/2611.15572
作者：Ye Yuan
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：decision head reads, forward pass, reads a state, decision head, head reads
备注： 40 pages, 6 figures. Code at [this https URL](https://github.com/yuan-phd/jevmark) (tag v5-paper); adapters at [this https URL](https://huggingface.co/yuanphd/jevmark;) logs and per-record results at [this https URL](https://huggingface.co/datasets/yuanphd/jevmark-runs)
点击查看摘要
Abstract:A decision head reads a state and a list of options and returns a probability per option in one forward pass. Once deployed, it usually observes only whether the option it chose was right: logged bandit feedback. We adapt such a head, LoRA on Qwen3-0.6B-Base and 1.7B-Base, from that feedback and report three results. First, the Brier or log score of the sampled action's own probability is not a usable REINFORCE reward: every wrong action earns at least gold's reward, with a mean baseline the lowest-probability wrong action gets the largest advantage, and at two options the signal is zero; in one run it cut accuracy on ordered-scale questions from .636 to .111. Scoring the probability as a loss by the pathwise gradient avoids the collapse, as do the REINFORCE rewards r and r minus p. Second, with full labels, none of four tested bandit arms beat cross-entropy plus one temperature on mean expected calibration error (ECE) over four unseen label schemas. Third, from logged feedback alone, Chosen-Action Proper Scoring (CAPS), the direct method with a proper score on the chosen action's probability, beats fine-tuning on confirmed answers only, which discards negatives: on Banking77 by 2.6 accuracy points, .053 lower ECE and lower selective risk (three seeds against one baseline seed), and by 21.7 points on one seed on emotion data with an often-wrong logger. At N 5000, CAPS stays 1.5 points below full-label training at 0.6B and .6 points at 1.7B against one full-label seed, and propensity weights add nothing on this log. Under feedback flipped at a known rate, one seed per rate, CAPS's confidence tracks the noisy channel on average, backward correction recovers most of the clean calibration, and early stopping on held-out logged outcomes prevented memorising noisy draws in all three runs. Code, adapters, logs and per-record results are public.
84. 【2611.15568】Can We Make an LLM Dumber, or Is It Just Playing Dumb? An Empirical Study of Believable Performance Throttling
链接：https://arxiv.org/abs/2611.15568
作者：Chengguang Gan,Yunhao Liang,Hanjun Wei,QingHao Zhang,Shiwen Ni
类目：Computation and Language (cs.CL)
关键词：commonly read, model capability, naturally weaker model, model, score
备注：
点击查看摘要
Abstract:A benchmark score is commonly read as a proxy for model capability. We study the inverse problem: can a model be driven to a target score, and do its failures resemble those of a naturally weaker model? We operationalize believable performance reduction along three axes: target calibration, item-difficulty structure, and error-distribution similarity to a real weak reference. We introduce CapLadder, an IRT-calibrated suite of 1,985 items spanning mathematics, code, multiple-choice reasoning, and tool use. A simple weak-teacher LoRA dial reaches unseen target levels on reasoning with a 1.9-point held-out calibration error, whereas prompting, temperature, and weight noise cannot combine comparable range and precision. Yet on multiple choice, the dial converges to an answer-token attractor: up to 97% of its newly introduced errors land on one letter, with the attractor changing from D in Qwen to A in Llama. Logit interventions identify a dominant near-constant shift: subtracting the estimated shift on held-out items recovers 52 to 59% of lost accuracy and removes the dominant attractor, while option permutation confirms that the bias tracks token position rather than option content. With high inter-annotator agreement ($\kappa=0.94$), human-coded error-category distributions nonetheless match the weak reference on reasoning (JS = 0.00), showing that local plausibility and aggregate detectability differ. Structured tool calls exhibit more natural degradation in the Qwen family (JS = 0.09), while a globally calibrated dial transfers poorly across benchmarks (14.2-point error on two usable benchmarks). Precise score control, therefore, does not imply a portable or believable reduction in skill.
85. 【2611.15538】Faithful in Steps: Improving Generalization and Citation in RAG via Query Decomposition
链接：https://arxiv.org/abs/2611.15538
作者：Yue Liu,Zhongying Ru,Shimin Di,Jipeng Zhang,Ruiyuan Zhang,Xiaofang Zhou
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Retrieval-augment generation, hallucinations of LLMs, prevalent strategy, strategy to mitigate, mitigate hallucinations
备注： Accepted by AAAI 2026
点击查看摘要
Abstract:Retrieval-augment generation is a prevalent strategy to mitigate hallucinations of LLMs. The attributable RAG (RAGQ) generates quotes for its answers. The quotes indicate which input contexts support the RAG to derive the answers, enhancing the answer's verifiability and trustworthiness. However, existing RAGQs exhibit significant degradation when dealing with questions that require multi-hop reasoning and multi-modal understanding, suffering from over-citation, implicit entity identification failure, and poor generalization. In this paper, we propose a novel RAGQ framework, namely QDRAG. QDRAG breaks down the input question into atomic subquestions to identify the implicit entities. Then, the reranker prunes context distractors to eliminate the downstream over-citation. To facilitate query decomposition, we propose two zero-shot approaches: QD-C and QD-R, which guide the QD MLLM to decompose the question based on context knowledge and retrieval rewards, respectively. One interesting finding is that finetuning on the QD task shows better generalizability compared to directly finetuning on the downstream RAGQ task. Experiments on four multi-modal QA benchmarks demonstrate QDRAG's efficacy in grounding answers and generating faithful citations. The framework significantly outperforms all the baselines on both in-domain and out-of-domain tests, even surpassing Gemini-Pro.
86. 【2611.15521】DecArena: Evaluating Large-Scale Decentralized Multi-Agent Collaboration
链接：https://arxiv.org/abs/2611.15521
作者：Jiali Cheng,Oleg Rokhlenko,Joo-Kyung Kim,Hadi Amiri,Xingzhi Guo
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：raise fundamental scalability, Emerging personal, centralized multi-agent systems, agents raise fundamental, raise fundamental
备注：
点击查看摘要
Abstract:Emerging personal AI agents raise fundamental scalability and privacy concerns for centralized multi-agent systems (MASs), which rely on a global orchestrator with broad access to agents, resources, and communication. In decentralized environments, global visibility is unavailable. Agents need to proactively discover non-local resources (e.g. tools, skills), and collaborate with other agents to solve tasks. We study decentralized multi-agent collaboration under graph-constrained communication, a natural reflection of human structures. Each agent observes only its local state and can interact only with neighboring agents. We introduce a benchmark with synthetic scalable distributed tool calling with 100K+ tools. Our experiments reveal that recent LLM agents struggle to discover non-local relevant resources and collaborate in decentralized setting. Moreover, standard reinforcement learning fails to reliably overcome this limitation, suggesting that decentralized MAS needs more explicit harness mechanisms for effective collaboration, even using SOTA LLMs. We then present a strong baseline \textbf{GraphHarness}, combining topology-aware warmup with self-improving LLM-based routing. Results show that GraphHarness substantially improves task success (+48.5) and produces higher quality collaboration (+30.6), while using fewer costs (+34.0) than baselines.
87. 【2611.15467】AutoOntic: Automatic Ontology Induction from Text for Knowledge Graph Construction
链接：https://arxiv.org/abs/2611.15467
作者：Alla Chepurova,Aydar Bulatov,Mikhail Burtsev,Yuri Kuratov
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Graph-based retrieval-augmented generation, retrieval-augmented generation depends, schema-free LLM-based extraction, typically produce flat, Graph-based retrieval-augmented
备注：
点击查看摘要
Abstract:Graph-based retrieval-augmented generation depends on the quality of the knowledge graph (KG) it retrieves over, yet schema-free LLM-based extraction pipelines typically produce flat graphs: deduplicated entities and relations with no type hierarchy and no domain/range constraints. We present AutoOntic, a pipeline that automatically constructs an ontology from text by canonicalizing open-vocabulary entity types and relations, inducing a hierarchy over the canonicalized types, and mining relation-level domain and range constraints. Its hierarchy induction procedure prioritizes types using corpus-derived relation-argument profiles and places them through local, LLM-adjudicated parent/child checks, allowing newly inserted types to trigger reassignment of existing parent-child links. The resulting hierarchy constrains entity deduplication and supports the induction of relation-level domain/range constraints. For intrinsic evaluation, we introduce a reference-based protocol that classifies induced ontology types as exact, broader, narrower, or unrelated to reference domain and range classes. On the Wikidata-TekGen and DBpedia-WebNLG subsets of Text2KGBench, over 90% of AutoOntic's induced endpoint types are semantically aligned with the reference classes across two LLM backbones: about half match exactly, while most remaining differences concern granularity. On MINE, knowledge graphs organized using an ontology built by AutoOntic achieve 88% retrieval accuracy. AutoOntic is available at this https URL.
88. 【2611.15426】SimRec: Learning to Search, Ask, and Recommend from Simulated Interaction
链接：https://arxiv.org/abs/2611.15426
作者：Yaxin Zhang,Xingyu Wu,Yuchen Yan,Yuqin Dai,Hong Zhao,Lixing Shen,Zhan Chen,Jian Shao,Yongliang Shen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：inspect products, LLM-based recommendation agents, revise rejected recommendations, LLM-based recommendation, search catalogs
备注： 19 pages,5 figures,16 tables. Code: [this https URL](https://github.com/ZJU-REAL/SimRec)
点击查看摘要
Abstract:LLM-based recommendation agents can search catalogs, inspect products, ask users, and revise rejected recommendations. However, these behaviors are often governed by hand-designed workflows, while existing training methods optimize isolated components such as query rewriting or list ranking rather than the interaction policy as a whole. We present SimRec, a reinforcement learning framework that trains the full interaction policy of a tool-integrated recommendation agent. SimRec introduces two components. A task-anchored user simulator provides feedback on every recommendation: conditioned on the current task need rather than on user profile, and it can be an external LLM or the recommender itself under self-play. A task-aligned reward optimizes the whole trajectory with GRPO, crediting natural retrieval quality and valid tool use alongside the final hit, with training-only target injection to handle sparse hits over large catalogs. On ESCI and Amazon C4, SimRec improves the NDCG@100 of a Qwen3-4B agent from 32.23% to 35.42% and from 22.94% to 24.72%}, outperforming training-free agents on far larger backbones and task-aligned baselines on NDCG. Analysis shows that the trained agent verifies candidates, uses preferences, and recovers from rejected recommendations far more often than its untrained counterpart. Our code is available at this https URL .
89. 【2611.15408】AraCrypto-ML: A Multi-Label Corpus of Communicative Functions in Arabic Facebook Cryptocurrency Discourse
链接：https://arxiv.org/abs/2611.15408
作者：Mabrouka Bessghaier,Mohamed Rashad Rouine,Md. Rafiul Biswas,Youssef Ayadi,Wajdi Zaghouani
类目：Computation and Language (cs.CL)
关键词：invoke Islamic jurisprudence, Islamic jurisprudence, invoke Islamic, promote investment, warn of scams
备注：
点击查看摘要
Abstract:Arabic cryptocurrency discourse on social media is communicatively heterogeneous: a single post may report prices, explain protocols, promote investment, warn of scams, or invoke Islamic jurisprudence. Yet no annotated resource captures this functional diversity. We introduce AraCrypto-ML, a 10,000-post multi-label corpus of Arabic Facebook cryptocurrency discourse (2014-2024) from 2,898 public pages using a set of related keywords. Collected posts are annotated into six categories: Market Commentary, Educational, Promotional, Skeptical-Warning, Religious Framing, and Other/Unclear, using Fanar-2-27B under a prompt-only multi-label protocol. We validate 1,000 posts against adjudicated gold labels (macro kappa = 0.74) and apply Rogan-Gladen calibration to correct labelling bias. The two annotators agree with each other at macro kappa = 0.62 before adjudication, below the model's agreement with either of them (0.70 and 0.69). Reaction profiles differ strongly by function: Love is about 70% of reactions per post on Educational and Promotional posts but about 33% on Skeptical-Warning, which draws the largest Haha share (about 39%).
90. 【2611.15404】Is the Importance Ratio Necessary for Stable Reinforcement Learning in LLMs?
链接：https://arxiv.org/abs/2611.15404
作者：Shuibai Zhang,Junhyuck Kim,Gyeongman Kim,Jaewoong Cho
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, Reinforcement learning, post-training large language, language models, large language
备注： 21 pages, 11 figures, 5 tables. Accepted at NeurIPS 2026
点击查看摘要
Abstract:Reinforcement learning (RL) has become central to post-training large language models (LLMs). However, popular RL methods like GRPO incur non-negligible overhead by computing both old-policy and current-policy likelihoods to form importance sampling ratios. In this work, we propose Likelihood-Gated Policy Optimization (LGPO), which enforces a soft trust region constraint via likelihood-based gating, eliminating the need to compute old-policy likelihoods. Empirically, we show that removing the importance sampling correction term does not harm training stability, whereas removing the trust region mechanism can lead to collapse. Moreover, ratio-based clipping can fail in fully on-policy training: the importance ratio stays at 1, so the ratio-based trust region constraint never activates. Under standard training settings where GRPO is stable, LGPO achieves comparable training stability and peak performance while reducing training time by ~18% on average relative to a standard implementation that recomputes old-policy likelihoods. In fully on-policy training, where GRPO fails, LGPO remains stable, enabling more efficient and robust LLM RL post-training across training regimes.
91. 【2611.15346】owards Better Legal Reasoning LLMs: Signal Balancing and Reward Scheduling
链接：https://arxiv.org/abs/2611.15346
作者：Yinghao Hu,Qian Xiao,Yuting Huang,Kaisong Song,Yiquan Wu,Ang Li,Junjie Cao,Jun Lin,Kun Kuang,Fei Wu
类目：Computation and Language (cs.CL)
关键词：generating explicit reasoning, reliability and interpretability, interpretability by generating, generating explicit, Group Relative Policy
备注： 21 pages, 6 figures. Published in Findings of EMNLP 2026
点击查看摘要
Abstract:In the legal domain, LLMs can improve reliability and interpretability by generating explicit reasoning traces. However, training LLMs to produce high-quality reasoning traces remains challenging. Existing supervised fine-tuning methods struggle when reasoning traces are significantly longer than final answers, as the learning signal for the answer becomes diluted. Meanwhile, reinforcement learning methods such as Group Relative Policy Optimization also have several limitations, including costly reward design, performance plateaus, and reward hacking. We therefore propose a two-stage training framework. In Stage I, JurisCoT-SFT employs a length-normalized dual objective to balance learning signals between reasoning traces and final answers. In Stage II, Lifecycle-Aware Backtrackable Policy Optimization dynamically evaluates and retires auxiliary reward signals based on their impact on final evaluation objectives, enabling efficient reward utilization. Our framework substantially improves legal reasoning performance on relevant tasks selected from multiple legal benchmarks, including ChJGBench, LawBench, and LegalBench. Experimental results demonstrate consistent improvements in both reasoning trace quality and final answer accuracy, while our models remain competitive with larger models.
92. 【2611.15341】Janus-MOPD: Tracing the Student Learning Dynamics in Multi-Teacher On-Policy Distillation
链接：https://arxiv.org/abs/2611.15341
作者：Zongji Yu,Ming Zhang,Dongcheng Zhang,Jiawei Zhou,Haotian Pang,Yiliu Sun,Xiang Wang,Youbang Sun,Chaochao Lu,Chen Gong
类目：Computation and Language (cs.CL)
关键词：applicable Large Reasoning, Large Reasoning Models, practically applicable Large, Large Reasoning, applicable Large
备注： 36 pages, 12 figures
点击查看摘要
Abstract:Multi-domain capabilities are critical for practically applicable Large Reasoning Models (LRMs). Therefore, Multi-teacher On-Policy Distillation (MOPD) has become a crucial part of the post-training process, integrating the capabilities of multiple domain-specific teacher models into a single student model. However, the student usually fails to acquire multi-domain capabilities simultaneously due to undesirable domain heterogeneity. Existing works have address this problem in view of temporal uneven efficiency and spatial hard allocation in external multi-teacher supervision. While in broader multi-domain training, varying degrees of performance degradation is still largely unexplained. In this paper, we shift the focus on how the student learns and integrates multi-domain capabilities internally, and then propose \textbf{\textsc{Janus-MOPD}}, a general learning dynamics framework of geometric representations for LRMs. Specifically, our main focus is on the internal performance of multi-domain capabilities on both temporal and spatial dimensions within the student. Temporally, our study shows that the student exhibits a Expansion-Consolidation-Optimization (ECO) three-phase learning dynamics, together with inherent limitations in learning efficiency and scaling. Spatially, we summarize two types of subspace locking within and across domains by tracing the representation space of the student, while explaining its clear learning directions but inherent cross-domain conflict. Therefore, \textsc{Janus-MOPD} yields a unified learning dynamics formulation, a geometric tracing methodology, and systematic findings of how the student learns and integrates multi-domain capabilities. Overall, we provide a \textsc{Janus} perspective to internally trace the continual evolution of the multi-domain capabilities within the model itself.
93. 【2611.15328】Vision-Grounded Semantic Learning and Alignment for Scalable Multilingual Text-Based Person Retrieval
链接：https://arxiv.org/abs/2611.15328
作者：Xinyu Zhou,Fan Li,Shasha Chen,Min Cao,Ahtamjan Ahmat,Qiaoming Zhu,Mang Ye
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Text-Based Person Retrieval, Multilingual Text-Based Person, Person Retrieval, Text-Based Person, aims to retrieve
备注： Accepted by ACM MM 2026 (Oral). 10 pages
点击查看摘要
Abstract:Multilingual Text-Based Person Retrieval (TBPR) aims to retrieve individuals with texts in multiple languages. Despite its practical importance, it has been overlooked by existing research, which mainly focuses on English-only retrieval. The only prior attempt at multilingual TBPR suffers from (1) the absence of a large-scale, multilingual pretraining dataset and (2) a suboptimal model architecture for multilingual text encoding and cross-modal alignment, which employs a shared encoder that overlooks linguistic heterogeneity and relies on English as a pivot for cross-modal alignment, introducing English-centric bias. For this, we contribute MultiPedes, the first large-scale, pedestrian-centric multilingual pretraining dataset. It contains 10 million image-text pairs across four languages, constructed by a multilingual quality-aware data construction pipeline. We also propose ViSeLA (Vision-grounded Semantic Learning and Alignment), a novel framework featuring: (1) a semantic-aware multilingual learning module that extends the mixture-of-experts architecture by routing language-invariant semantics to specialized experts for improved multilingual feature learning; and (2) a vision-grounded cross-modal alignment module that employs a semantic probe to capture fine-grained semantics across modalities, enabling direct cross-modal alignment without relying on a pivot language. Extensive experiments on both multilingual and English-only TBPR datasets demonstrate the effectiveness of ViSeLA. The dataset and code are available at this https URL
94. 【2611.15268】Knowledge in the Harness, Reliability in the Weights: Teacher-Free Co-Evolution of an LLM Agent
链接：https://arxiv.org/abs/2611.15268
作者：Yujia Zhang,Xinqi Ren,Shixiong Zhou,Jia Meng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Small open models, suit private customer-service, private customer-service deployments, Small open, open models suit
备注： 18 pages, 5 figures, 15 tables. Code, data, and run records: [this https URL](https://github.com/Brightendata/knowledge-in-the-harness)
点击查看摘要
Abstract:Small open models suit private customer-service deployments but trail frontier models in two ways: they miss what the written policy requires in a given situation, and they act inconsistently on what they know. We study whether such a model can close both gaps from its own deployment logs and their reference outcomes, without a stronger teacher model. Our starting point is a Gemma 4 12B agent that reads its domain policy from on-demand skills rather than from its system prompt. In each round, the deployed system serves a fresh batch of tasks; the base model diagnoses failed conversations and writes rules into the skills, and a rule survives only if it passes code checks, counterexample self-review, a paired retest, and a noise-calibrated validation gate. Reinforcement learning (GRPO) then trains a LoRA adapter on complete multi-turn, tool-using conversations. On the retail and airline domains of $\tau^2$-bench, without training or selecting on official tasks, the agent after two rounds improves on this starting point by 12.5 pass$^1$ points in retail and 19.5 in airline, and by 18.4 and 22.0 pass$^4$ points. It also exceeds the benchmark's reference agent, which runs the same model with the whole policy in its system prompt, by 11.8 and 8.0 pass$^1$ points and by 22.8 and 16.0 pass$^4$ points, closing most of the gap to three frontier models under the same protocol. A $2\times2$ ablation shows that the rules rescue tasks the agent never solved and carry policy knowledge that RL with the rules in context does not internalize, whereas the trained weights make solved tasks reliable.
95. 【2611.15267】A Closer Look at Language Model Introspection: Probing Information and Reporting
链接：https://arxiv.org/abs/2611.15267
作者：Dustin Rubin,Vincenzo Timmel,Xufeng He,Aritra Saha,JooMan Kim,Vijay Madisetti
类目：Computation and Language (cs.CL)
关键词：study language-model introspection, study language-model, model, language-model introspection, model activations
备注：
点击查看摘要
Abstract:One way to study language-model introspection is to test whether models can identify where their activations have been perturbed. We train a simple linear classifier to identify the perturbed sentence from the model's activations, then compare its predictions with the model's own answers across pretraining and injection strengths. This tests whether the model is being asked to report information that is already easy to recover. If so, successful localization may be less demanding than it first appears and may not extend to the broader uses that motivate introspection research, such as faithfully explaining a model's reasoning or helping researchers assess the reliability of its answers. With an injection four times the typical activation norm at layer 0 and probe readout at layer 24 in OLMo~3 32B, the supervised probe reaches 98.3\% accuracy after 8.4 billion training tokens, while the model's zero-shot answer remains at chance (11.1\%). At the released base checkpoint, these accuracies reach 99.1\% and 89.6\%, respectively. Across 7B and 32B, location is already decodable in randomly initialized networks, showing that the architecture can support these traces without pretraining. In these experiments, location information lies close enough to the surface for a simple linear probe to recover it, so successful reporting need not imply broader access to the model's internal computation.
96. 【2611.15234】Schedule-Calibrated Commitment Order in Blockwise Masked Diffusion Language Models
链接：https://arxiv.org/abs/2611.15234
作者：Gaurav Sarkar(1),Umang Pandey(2),Pratik Prabhanjan Brahma(2),Zicheng Liu(2),Emad Barsoum(2) ((1) International Institute of Information Technology, Hyderabad, (2) Advanced Micro Devices)
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：masked diffusion language, diffusion language models, Sequential block schedules, make token commitment, Sequential block
备注： 9 pages, 1 figure, 2 tables. Includes appendices and ancillary code for algebraic verification
点击查看摘要
Abstract:Sequential block schedules can make token commitment in masked diffusion language models appear strongly left-to-right even when within-block order is random or reversed. For equal contiguous blocks processed without interleaving in positional order, with untied irreversible commitments, we use a Spearman-rank identity to express global position-commitment correlation as a deterministic schedule reference plus a weighted mean within-block correlation. In a reported paired study of LLaDA-8B-Instruct on 500 math and code prompts with 256 generated positions and updates, increasing block size from 64 to 128 lowers mean global correlation from 0.9845 to 0.9149. Uniform-random within-block references are already 0.9375 and 0.7500. After calibration, mean within-block correlations are 0.751 and 0.660, so the larger raw residual at block size 128 does not indicate stronger local positional ordering. We give sharp bounds and derive calibrated intervals from reported summaries, while documenting the limitations of the aggregate-only empirical release. The analysis supports schedule-aware interpretation of commitment order; its empirical scope is one checkpoint and two schedules, without evaluation of output quality or inference speed.
97. 【2611.15194】he Neighbour's Label: Opposite Subgroup Effects of Same-Dialogue Exposure in Next-Act Evaluation
链接：https://arxiv.org/abs/2611.15194
作者：Ali Amini,Masoumeh Chapariniya,Rytis Maskeliunas,Robertas Damaševičius
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Window-based next-act evaluation, Window-based next-act, next-act evaluation, evaluation often aims, aims to measure
备注：
点击查看摘要
Abstract:Window-based next-act evaluation often aims to measure generalisation across dialogues, yet overlapping windows and similarity retrieval can expose labelled examples from the test dialogue. The nearest such example is the target's labelled predecessor, whose act is correct when the target continues it and wrong when the target changes act; a model that copies it can gain and lose in two subgroups that one aggregate averages. We induce this exposure under controlled designs on SGD, STAR and AMI, whose official splits are clean. Randomly including the predecessor's row in training raises a lexical classifier's continuation scores and lowers its transition scores in all three corpora, and purging the adjacent rows removes most of the gain. With TF-IDF-retrieved demonstrations, two 7B instruction-tuned models show the same opposite pattern in all eight model-corpus-sample arms (some single-cell intervals include zero; one replication is partial), while natural-weight accuracy changes by only -0.05 to +0.04. Exposure frequency depends on the retrieval pipeline. We evaluate two diagnostic comparisons without model retraining and find that excluding the test dialogue does not detectably reduce accuracy on SGD. All exposure is induced; no published system was re-evaluated.
98. 【2611.15172】Where Language-Model Vocabulary Rose on Stack Exchange
链接：https://arxiv.org/abs/2611.15172
作者：Fengming Liu
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Social and Information Networks (cs.SI)
关键词：Stack Overflow banned, Stack Exchange sites, Stack Overflow, Stack Exchange, Overflow banned answers
备注： 8 pages, 4 figures, 3 tables (one in the appendix)
点击查看摘要
Abstract:Stack Overflow banned answers generated by ChatGPT five days after the model's release, and many other Stack Exchange sites announced similar rules. I measure the vocabulary of the answers posted afterwards, 3.8 million answers on 170 sites from 2019 to 2024. A fixed list of 56 words that language models overuse rose about 14 percent above its pre-2023 trend, while the highest of 1,000 frequency-matched lists of ordinary words rose about 7 percent. In a screen of 15 site traits measured before the release, the strongest predictor of where the rise happened was the share of answers that received a body edit within 30 days of posting. On the least edited third of sites the list rose about 29 percent relative to matched controls, and on the most edited third it did not change. The gradient is also present among answers that were never edited. It follows the share of answers edited by their own authors, and the share edited by others adds little once that share is held fixed. Use of the model is unobserved, so these results cannot separate lower use on sites with a high self-edit share from any effect of editing on what the vocabulary records. Any vocabulary-based estimate for the network as a whole therefore pools sites where the marker vocabulary rose sharply with sites where it did not change.
99. 【2611.15130】Read Once, Answer Many: Parallel Prompting for Shared-Context LLM Inference
链接：https://arxiv.org/abs/2611.15130
作者：Zekun Zhao,Jeffrey Flanigan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
关键词：Parallel Prompting, LLM workloads, data labeling, LLM-based evaluation, labeling and LLM-based
备注： 17 pages, 6 figures. Code: [this https URL](https://github.com/jlab-nlp/parallel-prompting) . Project page: [this https URL](https://jlab-nlp.github.io/parallel-prompting/)
点击查看摘要
Abstract:LLM workloads sometimes ask many independent questions about the same long document, as in document QA, data labeling and LLM-based evaluation. Prefix caching removes the redundant prefill shared by these queries, but each decode step still reads the document's key-value (KV) cache once per question, so decoding is bound by memory bandwidth and scales with the number of questions. We present Parallel Prompting, which decodes P questions as P independent streams of a single request all at once, fixing this issue. In our method, every step reads the shared document once for all P streams, and a stream-id attention mask, evaluated inside the attention kernel, keeps each answer conditioned only on the document and its own question. We implement Parallel Prompting in SGLang by adding about 80 lines to three existing files and a small engine package; the mask needs no dense tensor, and every decode step has a fixed shape that is captured as a CUDA graph. With CodeLlama-7B, 8k-16k-token documents and 64-256 questions per document, Parallel Prompting is 3.7x faster than stock SGLang with its FlashInfer backend on an A100 and 5.9-6.0x faster on an RTX A6000, on two SGLang releases, including the most recent release. Timed on identical inputs, it is faster than stock SGLang in all 144 runs (2 GPUs x 2 releases x 6 workloads x 6 input sets). Code: this https URL
100. 【2611.15114】What Does Each Part of Speech Need? Contexts, Subspaces and Dimensions in Static Word Embeddings
链接：https://arxiv.org/abs/2611.15114
作者：Jintang Xue,Chengwei Wei,Yun-Cheng Wang,C.-C. Jay Kuo
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Static word embeddings, Static word, Static, word embeddings give, embeddings give
备注：
点击查看摘要
Abstract:Static word embeddings give a word one vector, ignoring its different functions as noun, verb or adjective. Training on part-of-speech-tagged text gives each function its own vector, at the cost of a larger table. Using nine controlled corpora, we ask which context words each part of speech needs, whether it needs its own subspace, and whether the number of dimensions a word keeps should follow its part of speech or its frequency. The tags raise verb similarity on SimVerb-3500 at every dimension from 50 to 300 but help nouns much less. Added to verb-only text, adverbs help verbs more than as many random words; adjectives help nouns only slightly. At a fixed dimension, per-part-of-speech PCA bases preserve verb and adjective similarity better than a global basis or frequency-band bases. Nouns need more dimensions than verbs only among frequent words. We therefore allocate dimensions by frequency with these bases: at a third of the original size, only rare words lose dimensions, SimVerb-3500 and SimLex-999 nouns match the uncompressed table, and verb-to-noun retrieval stays within 0.02. Part of speech decides what a word's vector should be; frequency decides how much of it to keep.
101. 【2611.15108】yped Knowledge over Constructive Institutions: A Proof-Relevant Type Theory for Verified Science
链接：https://arxiv.org/abs/2611.15108
作者：Hans-Martin Will
类目：Logic in Computer Science (cs.LO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Mathematical proof assistants, build proof irrelevance, proof irrelevance, Mathematical proof, definitional proof irrelevance
备注：
点击查看摘要
Abstract:Mathematical proof assistants such as Coq, Agda, and Lean 4 build proof irrelevance into definitional conversion ($p \equiv q$ for $p, q : P$ with $P : Prop$), erasing which derivation established a theorem. While natural for mathematics over fixed axioms, judgmental proof irrelevance is incompatible with verified scientific stores, which must inspect and compare independent derivations of the same claim to assess consilience and compute counterfactual retractions when an assay, reagent, or model is invalidated. Moreover, combining definitional proof irrelevance with subsingleton elimination breaks strong normalization and renders algorithmic conversion non-transitive. We present the type-theoretic and institutional foundations of Eigenius, a verified knowledge substrate for science. First, we formulate a dependent kernel with cumulative universes ($Prop, Set, Type_k$), impredicative $Prop$, inductive families with index-forced subsingleton elimination, and intensional identity types, where definitional equality $\equiv$ is untyped joinability under an orthogonal CRS and proof irrelevance is a witnessed propositional axiom ($irrel : \Pi P{:}Prop.\,\Pi p,q{:}P.\,Id\,P\,p\,q$). Second, we unify universe cumulativity, codomain-covariant $\Pi$-subtyping, and ontology class inclusions in a coercion-free subsumption judgment whose bidirectional fragments ($\mathcal{K}_0, \mathcal{K}_1$) satisfy subject reduction and are sound and complete for declarative typing. Third, we organize external verifiers into a three-level institutional hierarchy with explicit axiom policies (Adopt, Discharge, Relativize), internalize a justification logic with Why-provenance semiring support $supp(j,P)$, and embed Cooper's Type Theory with Records (TTR) to type open-world knowledge graphs. Finally, we prove consistency in Grothendieck universes and mechanize the metatheory in Lean 4 with zero sorry axioms.
Subjects:
Logic in Computer Science (cs.LO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
ACMclasses:
F.4.1; I.2.3; I.2.4
Cite as:
arXiv:2611.15108 [cs.LO]
(or
arXiv:2611.15108v1 [cs.LO] for this version)
https://doi.org/10.48550/arXiv.2611.15108
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
102. 【2611.15102】One Fabrication Is Enough: A Fake News Article Changes the Forecasts of LLM Forecasting Systems
链接：https://arxiv.org/abs/2611.15102
作者：Zeyu Zhang,Bradly C. Stadie
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：LLMs are increasingly, strengthen their predictions, evidence to strengthen, attack, model
备注： 18 pages, 2 figures, 13 tables
点击查看摘要
Abstract:LLMs are increasingly used for forecasting, and the best forecasting systems retrieve news as evidence to strengthen their predictions. This also opens them to attack. We study the weakest attacker of this kind, who knows only the forecasting question and publishes fabricated news articles, with no access to the model, the retriever or its queries. We evaluate how far this attack reaches on stock questions and real prediction-market questions. Once the article is in the model's context, it reverses 74% to 82% of the forecasts that opposed it, on every frontier model we tested. The model cannot verify the fabrication and follows it anyway. Retrieval is the attack's entry point, and the systems built to retrieve well are the most exposed: the architectures of two leading deployed forecasting systems, whose agents search for every related article, retrieve the fabricated one in about 90% of runs. Accuracy cannot reveal this harm: the attacked forecaster is right when the attacker's direction turns out right and wrong otherwise, so its average accuracy barely changes while its forecasts follow the attacker's guess. We also propose a second attacker, who publishes two articles that argue opposite directions to make the forecaster unsure. The model does not hedge; it returns a confident forecast in a direction the attacker no longer controls. We then evaluate the two strongest published retrieval-time defenses, passage filtering and partitioned retrieval. Each stops the one-article attack but is bypassed by a one-prompt change to the attack. Together they stop both bypasses at four articles, but sixteen distorted copies beat them, and they change 29% of clean decisions and discard 39% of the genuine news. Partitioned retrieval also requires control of the retrieval index. Systems that search the open web have no such control and are left with the filter alone. For them, the attack still works.
103. 【2611.15058】FIBER: Bayesian Fusion of Fast-DetectGPT and IRT-Informed Detector Evidence for LLM-Generated Text Detection
链接：https://arxiv.org/abs/2611.15058
作者：Yan Li,Guangsheng Bao,Zhipeng Chen,Guandong Zhang,Yanbin Zhao
类目：Computation and Language (cs.CL)
关键词：Detecting large language, Detecting large, generated text remains, large language model, text remains challenging
备注：
点击查看摘要
Abstract:Detecting large language model (LLM)-generated text remains challenging under domain and generator shifts. Supervised detectors may generalize poorly, while zero-shot methods often rely on individual statistical signals without leveraging historical detector behavior. We propose FIBER (Fast-DetectGPT with IRT-informed Bayesian Evidence Recalibration), which integrates continuous Fast-DetectGPT scores with auxiliary detector outputs through Bayesian evidence fusion. Item response theory (IRT) models historical detector-correctness patterns, providing class-conditional detector-output likelihoods through marginalization over latent text representations. These likelihoods are combined with Fast-DetectGPT score densities and a historical class prior for prediction. When historical Fast-DetectGPT scores are unavailable, a variant called FIBER-Stream estimates class-specific score distributions from an unlabeled batch. On a 32,000-text multi-domain benchmark, FIBER achieves the highest accuracy (0.620) and improves mean AUC over Fast-DetectGPT (0.664 versus 0.600) under five-fold cross-validation. FIBER also consistently improves AUC across four individual domains. Under out-of-distribution transfer, FIBER-Stream achieved an AUC of 0.911, compared with 0.889 for FIBER and 0.922 for Fast-DetectGPT alone. These results demonstrate the potential of integrating complementary detector evidence and historical information to improve detection performance across heterogeneous settings.
104. 【2611.15051】A Time-Frequency-Condition Multimodal Fusion Foundation Model for Universal Rotating-Machinery Fault Diagnosis under Multi-Element Heterogeneous Scenarios
链接：https://arxiv.org/abs/2611.15051
作者：Xinyu Zou,Jian Ma,Liang Ma,Chen Lu,Tao Peng,Yingjie Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Intelligent fault diagnosis, condition requires retraining, Intelligent fault, retraining from scratch, typically developed
备注：
点击查看摘要
Abstract:Intelligent fault diagnosis models are typically developed for a single machine under a specific set of operating conditions, such that each new machine or condition requires retraining from scratch. This one-machine-one-model paradigm scales poorly. Although transfer learning and domain generalization can reduce the labeling burden, they primarily seek domain-invariant commonality, potentially discarding machine-specific characteristics that are critical for diagnosis. This paper proposes TFC-MMFD, a time-frequency-condition multimodal fusion foundation model for rotating-machinery fault diagnosis under multi-element heterogeneous scenarios. Statistical indicators, time-frequency images, vibration sequences, and textual machine and condition descriptions are tokenized into a unified language-like space, allowing inputs of different physical origin to be represented as a single sequence. A LLaMA backbone, together with cross-modal bidirectional attention and a Q-Former, then distills this sequence into fault-mode queries. Diagnosis is performed by matching these queries against natural-language fault-mode anchors rather than fixed class indices, while regression-adversarial condition disentanglement and condition-conditioned masked pre-training improve robustness to changing conditions. Across four progressive tasks on ten public bearing datasets spanning diverse bearing types, speeds, and loads, TFC-MMFD attains 99.40% accuracy and 99.16% macro-F1, maintains over 80% accuracy on most interpolated unseen conditions without adaptation, and improves from 20.26% to 95.63% accuracy on an unseen machine with only five labeled samples per class. It outperforms the strongest of eight domain-generalization baselines by 10.57 percentage points and compares favorably with a recent bearing foundation model while using less than half of its fine-tuning data.
105. 【2611.15049】Science Prediction Universe
链接：https://arxiv.org/abs/2611.15049
作者：Zengji Tu,Xiang Liu,Jiarui Sun,Ruoyu Wu,Zhihui Qi,Chengda Wu,Yutao Zhou,Bo Yang,Ziyan Zhang,Jialong Wu,Liang Chen,Kuan Li,Steven Dillmann,Yuanqi Du,Soojung Yang,Shizhe Diao,Jianjun Wu,Junlang Liu,Xuming Hu,Lin Chang,Baobao Chang,Xiaowen Chu,Philip S. Yu,Tong-Yi Zhang,Hao Cheng,Qin Han,Yanye Feng,Chenru Duan,Chuncheng Liu,Yan Liu,Yuchen Gao,Zhao Li,Ronghua Zhang,Tory Xu,Renjian Song,Yaokai Fu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：explain natural phenomena, natural phenomena, long sought, sought to explain, explain natural
备注： 52 pages, 28 figures, 7 tables. Project page: [this https URL](https://spu.unipat.ai/)
点击查看摘要
Abstract:Humanity has long sought to explain natural phenomena. Reliable prediction of experimental outcomes is a central test of our understanding of the processes that produce them. If artificial general intelligence (AGI) is to surpass human scientific capabilities, it must also predict experimental outcomes more reliably than humans. Such capabilities could accelerate scientific discovery across disciplines, help address humanity's most pressing challenges, and improve human well-being. We introduce Science Prediction Universe (SPU), a benchmark of hidden experimental outcomes with 100 public verified tasks from chemistry, materials science, biology and medicine, and 16 private tasks from unpublished wet-lab experiments. Given an experimental setup and candidate conditions, an agent works with any resources it needs to rank the candidates by a measured outcome. We evaluate thirteen agent configurations spanning twelve frontier models across two harnesses (Codex and Claude Code). Current agents remain far from saturating wet-lab outcome prediction, with substantial performance disparities across models: on the public benchmark, configurations separate into two distinct tiers, with task-adjusted Spearman correlations ranging from 0.227 for the lowest-performing configuration to 0.478 for the best. Analysis of 1,155 scored public trajectories (227,103 tool calls) suggests that the bottleneck lies in scientific judgment rather than tool execution: agents rely on shared monotone priors, agreeing far more with one another than with experimental reality (0.52 vs. 0.33), and frequently compute trivial physical or chemical proxies that do not influence the final outcome.
Comments:
52 pages, 28 figures, 7 tables. Project page: this https URL
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2611.15049 [cs.AI]
(or
arXiv:2611.15049v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2611.15049
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
106. 【2611.15041】AROMA: Adaptive Representation-Oriented Multimodal Actuation for Vision-Language Model Control
链接：https://arxiv.org/abs/2611.15041
作者：Zhaoning Zhang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：accurate local direction, reachable numeral target, Adaptive Representation-Oriented Multimodal, Mechanistic localization, accurate local
备注： 39 pages, 16 figures
点击查看摘要
Abstract:Mechanistic localization does not by itself yield usable control: causal sensitivity may occupy little activation energy, an accurate local direction may fail at finite scale, and a reachable numeral target may be wrong. We introduce AROMA (Adaptive Representation-Oriented Multimodal Actuation), a frozen-VLM control framework separating where to intervene, which geometry and gain to use, how to reach a target, which target to pursue, and when to act. In Llama-3.2-11B-Vision-Instruct, four dimensions of a causally validated cross-attention head explain 89.82% of cardinality sensitivity but only 9.52% of median activation energy; magnitude-normalized causal subspace actuation converts this mismatch into finite control, improving exact-count accuracy on untouched procedural data by +8.00 pp. Iterative Minimal-Effort Actuation (MEA) reaches 81.25% of oracle targets versus 15.18% for a frozen direction under matched step budgets. With target and gate frozen before evaluation, targeted MEA improves the previous frozen policy from 34.444% to 38.730% on a new natural Stage-2 cohort (N=630; paired p=4.63e-7) and yields 65.741% versus 65.153% over all 7,992 examples while editing only 63 inputs. Prospective routing, replication across heads and models, and comparisons with attribution-steering baselines further characterize each stage, separating localization, actuation, reachability, target quality, and selective deployment as distinct control problems.
107. 【2611.15010】Calibrate, Don't Retrain: Decomposing the Value of Annotator Disagreement in Cyberbullying Severity
链接：https://arxiv.org/abs/2611.15010
作者：Arslan Bisharat,Katelyn Skees,Manuel Sandoval Madrigal,Mujtaba Nazari,Ayaan Khan,Deborah L. Hall,Mohammed Abuhamad,Yasin N. Silva
类目：ocial and Information Networks (cs.SI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)
关键词：Machine learning models, labeled data produced, Machine learning, multiple human annotators, labeled data
备注： 26 pages. Submitted to PACMHCI (CSCW). Code and data: [this https URL](https://github.com/arslanbisharat/severity)
点击查看摘要
Abstract:Machine learning models are often trained on labeled data produced by multiple human annotators. When those annotators disagree, their labels are commonly collapsed into a single majority vote, which discards information about the underlying disagreement. We examine the cost of this practice for cyberbullying severity, a subjective judgment on which annotators disagree heavily. In the corpus we study, all 5 annotators assigned the same severity label to only 4.1% of comments. Turning 5 judgments into one label hides this disagreement and obscures how much the annotators differed in their assessments. In this paper, we ask whether a model can preserve this information by predicting the distribution of annotator judgments instead of a single majority label. We find 3 main results. First, accuracy against the majority label cannot tell competent models apart: 2 models with similar accuracy can differ greatly in how well they match the distribution of annotator judgments. Second, predicting the full distribution requires little extra effort. Calibrating an existing model, which adjusts its output probabilities after training, captures most of the improvement without retraining, across 3 datasets covering severity, abuse, and irony, while training on label distributions adds a small further gain. Third, we examine a dataset that includes annotator demographics, where a single shared model has one advantage and one limit. The advantage is that a model predicting the distribution of judgments matches each demographic group's judgments significantly better than a model trained on majority labels, so both groups gain. The limit is that it does not narrow the gap in performance between the groups, because one shared model cannot encode which group is right on a given comment. Preserving annotator disagreement is therefore a low-cost step toward fairer moderation, though not a complete one.
108. 【2611.14996】Breaking Bad: "Going Badly" Activations Drive Reward Hacking
链接：https://arxiv.org/abs/2611.14996
作者：Natalia Fischl-Lanzoni,Punya Syon Pandey,Merlin Stein,David Demitri Africa
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Humans often cheat, goal feels, Humans, task badness, task
备注：
点击查看摘要
Abstract:Humans often cheat when a task is going badly and a goal feels out of reach. We explore and validate an analogous idea in language models: they exhibit a similar internal pressure state that precedes reward hacking. Using everyday stories (crucially, without any hacking examples), we extract a task badness direction that rises as failures accumulate across three models we study (Qwen3.6-27B, GPT-OSS-20B, and Gemma-4-31B). On impossible or difficult coding tasks, task badness rises over the turns leading up to a hack. Further, subtracting the direction a moderate amount reduces cheating in Qwen, more than steering against desperation or task impossibility. Subtracting task badness by an even larger amount blinds the agent to its own failures, causing it to interpret failing tests as passing. However, the relationship to hacking differs across models: in GPT-OSS, the state separates hacking runs from honest solves but not honest failures. Our results suggest monitoring and mitigation strategies based on tracking this state of task badness. Further, as agents are set on more difficult and long-horizon tasks, states like this may push them toward illegible and obscured chain-of-thought, so oversight will be needed on internal representations such as this.
109. 【2611.14980】CoLFA: Collaboration-Guided Lightweight Failure Attribution for LLM-Based Multi-Agent Systems
链接：https://arxiv.org/abs/2611.14980
作者：Yufei Luo,Yuchen Ling,Chunrong Fang
类目：Computation and Language (cs.CL)
关键词：systems requires tracing, multi-agent systems requires, decisive error step, requires tracing error, Lightweight Failure Attribution
备注： 23 pages, 4 figures, 15 tables
点击查看摘要
Abstract:Failure attribution in multi-agent systems requires tracing error formation to identify the decisive error step and the responsible agent. However, agents' division of work and information exchange lead to Interleaved Steps and Cluttered Content, requiring models to link executions and check details in lengthy records. This makes it difficult to balance localization accuracy and token cost. We find that multi-agent collaboration also leaves records of how executions connect and content passes between them as results are formed, providing evidence for tracing error formation. Based on this observation, we propose CoLFA (Collaboration-Guided Lightweight Failure Attribution), which uses collaboration cues to organize the attribution input according to how results are formed, determining which steps are examined and how their content is presented. Through Handoff-Guided Step Expansion and Cross-Referenced Content Organization, CoLFA helps the model focus on examining error formation and the role of each decision while reducing the processing of irrelevant and repeated records. Across five settings spanning WhoWhen and LongRCA and three backbone models, CoLFA achieves the highest exact step-localization accuracy with the lowest token consumption. Compared with individual baselines in each setting, CoLFA improves accuracy by up to 37.50% and reduces token consumption by up to 97.6%.
110. 【2611.14960】rmination Lag: Coding Agents Solve Early but Stop Late
链接：https://arxiv.org/abs/2611.14960
作者：Musa Cim,Burak Topcu,Mahmut Taylan Kandemir
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Coding agents, solve a task, stop working, Coding, Verified and Multilingual
备注：
点击查看摘要
Abstract:Coding agents can solve a task well before they stop working on it. We characterize \emph{termination lag}--the number of steps between an agent's first correct patch and the end of its run--across five models, two agent frameworks, and three SWE-bench datasets by recording and testing every distinct repository patch generated during execution. Our analysis reveals that 38--82% of successful runs achieve a correct solution on their initial source-code edit. However, agents continue to expend substantial effort after correct patches, with post-solution steps accounting for a median of 35--37% for Qwen3-Coder and 54--60% for Laguna-XS.2 in successful runs on SWE-bench Verified and Multilingual. Agents spend most of these additional steps verifying their work and exploring the repository. In a small fraction of cases (1--8%), this continued activity leads agents to undo their earlier correct patch, leaving the final solution incorrect.
111. 【2611.14935】Do Large Language Models Show Racial and Sex Bias in Pain Management? A Counterfactual Audit of GPT, Claude, Gemini, Llama, DeepSeek and Qwen
链接：https://arxiv.org/abs/2611.14935
作者：Richard J. Young,Alice M. Matthews
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Racial and ethnic, large language models, non-Hispanic White patients, ethnic minority patients, minority patients receive
备注： 31 pages, 5 figures, 14 tables. Code, vignettes, panel definition, spend ledger and all 58,080 raw model responses: [this https URL](https://github.com/ricyoung/qpain-llm-counterfactual-audit)
点击查看摘要
Abstract:Racial and ethnic minority patients receive less pain treatment than non-Hispanic White patients, and large language models (LLMs) used as medical AI could reproduce that bias. Prior audits tested a few proprietary models, stated race explicitly and rarely measured the models' own response instability. In exploratory, non-preregistered analyses, Study 1 had four open-weight LLMs assess six acute-pain vignettes in every combination of four races and two sexes, with identity stated or cued only by a name (two names per group), comparing each identity with a White male reference on the same case and sampling seed. In Study 2, 24 configurations of 17 models, including OpenAI's GPT-4.1 mini and gpt-oss, Anthropic's Claude Haiku 4.5, Google's Gemini 2.5 Flash, Meta's Llama, DeepSeek and Qwen, with reasoning on and off and at two precisions, answered the same vignettes and the 50 clinician-written Q-Pain cases. In this single-prompt, JSON-constrained task, no difference survived correction in Study 1, none of 1,386 comparisons survived the false discovery rate in Study 2, and every pain-severity difference was equivalent to zero within one point on a 0-10 scale (within a quarter point for 237 of 238 Q-Pain comparisons). Opioid decisions were bounded less precisely (Study 1 could not exclude differences of about 20 percentage points), so they show no detected difference, not proof of none. The few differences surviving correction within a model favoured Black patients. Models differed far more from one another and across their own settings than between patients (the reference patient received the high opioid dose in 6% to 93% of responses), although serving software, provider and prompt format also differed. Fairness audits of clinical AI should use several names per group, pair comparisons on the seed, report the noise floor and test each deployed configuration.
112. 【2611.14925】oolTurns: Benchmarking LLM Agents in Multi-Turn Dialogue
链接：https://arxiv.org/abs/2611.14925
作者：Milad Gholami,Brendan King,Jeffrey Flanigan
类目：Computation and Language (cs.CL)
关键词：large-scale tool-use benchmarks, tool-use benchmarks focus, Tool-using language models, Tool-using language, increasingly deployed
备注：
点击查看摘要
Abstract:Tool-using language models are increasingly deployed in conversational settings, yet most large-scale tool-use benchmarks focus on isolated requests. We introduce ToolTurns, a benchmark of 2,620 problems spanning 1,827 tools and 11,004 API endpoints across 47 categories. Each dialogue begins with an intentionally underspecified request and continues through two context-dependent follow-ups, testing clarification, tool use, and retention of conversational context. We also introduce an open-source user simulator that reveals withheld context through dialogue and generates follow-up requests, with a checker--fixer pipeline for improving its turns. Across nine language models, the best agent resolves 69.6% of individual requests but completes only 39.8% of full dialogues. Under this evaluation protocol, every evaluated model receives lower success scores on follow-up requests than on the initial request, and dialogue-quality rubric scores and task success can rank models very differently. Paired turn-level evaluation shows that the checker--fixer reduces detected dialogue defects, and blind human evaluation favors the revised turns. ToolTurns provides a testbed for evaluating whether agents sustain task success across multi-turn dialogue with tools.
113. 【2611.14910】MuEdit: An efficient multi-task editing method towards inter-domain knowledge conflicts
链接：https://arxiv.org/abs/2611.14910
作者：Songshi Liang,Ting-En Lin,Zixuan Huang,Yuchuan Wu,Yongbin Li,Zihe Wang,Rui Yan
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, require frequent knowledge, frequent knowledge updates, Large language, editing methods fail
备注： 30 pages,accepted by NeurIPS 2026
点击查看摘要
Abstract:Large language models (LLMs) require frequent knowledge updates across heterogeneous domains, but existing editing methods fail when applied sequentially to multi-task settings. We trace this collapse to inter-domain null-space misalignment: heterogeneous tasks induce distinct Jacobian geometries, causing their common null space to shrink dramatically and leaving insufficient admissible directions for conflict-free updates. We propose the Conflict Index to quantify this geometric interference, and introduce Mu-Edit, which mitigates multi-task conflicts via (1) conflict-aware ordering to minimize cumulative interference, and (2) dynamic low-rank approximation to expand the null space when ordering alone is insufficient. Experiments across five functional domains and three backbones show that Mu-Edit significantly outperforms existing baselines in multi-task editing performance while preserving general capabilities, and remains effective under incremental task arrival.
114. 【2611.14908】Hy ASR 3.0 Technical Report
链接：https://arxiv.org/abs/2611.14908
作者：Aoxiong Yin,Auden Li,Chao Huang,Chuanyang Hu,Eitan Wang,Ethan Zou,Fangming Feng,Guangyu Chen,Guinan Li,He Wang,Jiahong Li,Meng Yu,Mingyu Cui,Peng Wang,Rongjie Li,Steve Yves,Teddy Sun,Tian Zheng,Wei Liu,Yang Zhou,Yixuan Zhang,Zhennan Lin,Zhihang Xu,Zhuohao Li,Ziqiang Zhang,Anji Zhang,Bang Wang,Caisheng Ouyang,Chengqi Zhu,Chong Li,Conglian Xie,Dongdong Wang,Edward Wang,Evelynn Liu,Ferman Yang,Feng Lu,Gang Zhang,Jathon Zhang,Jaxl Liu,Jiachen Luo,Jian Li,Jingxi Gui,Kysun Wang,Liang Dong,Longsha Zhou,Na Hu,Qi Chen,Rilin Chen,Rui Yuan,Shanshan Sang,Siyu Yan,Steven Hong,Taihui Wang,Weiwei Li,Xiangyu Zhang,Xiaotong Yang,Xue Hu,Xue Jiang,Yameng Li,Yifu Sun,Yuhuan Zhou,Zhiang Chen,Zhibin Wang
类目：Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：supports Mandarin Chinese, based automatic speech, diverse speech conditions, Mandarin Chinese, flexible contextual conditioning
备注： 12 pages, Technical Report. Project Leads: Auden Li, Eitan Wang, and Steve Yves (listed in alphabetical order by first name)
点击查看摘要
Abstract:We present Hy ASR 3.0, a large language model (LLM)-based automatic speech recognition (ASR) system that delivers strong recognition accuracy, supports flexible contextual conditioning, and maintains robust recognition performance across diverse speech conditions. Hy ASR 3.0 supports Mandarin Chinese, English and 13 Chinese dialect groups, including Cantonese. Among the evaluated systems, it achieves the lowest aggregate error rates on public Mandarin Chinese, English, and Cantonese benchmarks and the lowest error rates on the corresponding internal test sets, alongside first-tier dialect recognition performance. Beyond audio-only transcription, Hy ASR 3.0 supports multiple forms of external context, including hotword lists, question--answer dialogues, and summaries, enabling the use of task-relevant information during recognition. The model also leverages intra-utterance context to disambiguate homophonic and phonetically similar keywords using information from other parts of the same utterance, without requiring a separate contextual input. Evaluations demonstrate strong contextual recognition in both external-context and intra-utterance settings, as well as robust recognition of long-form speech, children's and older adults' speech, low-volume speech, and speech in noisy environments. This report describes the model architecture and training methodology and presents evaluations across recognition accuracy, context utilization, and robustness.
115. 【2611.14861】Is Jev a Good Multilingual Judge?
链接：https://arxiv.org/abs/2611.14861
作者：Wei Liu,Yi Fan,Xiyan Fu
类目：Computation and Language (cs.CL)
关键词：received limited attention, generative LLM judges, Generative large language, directly output judgment, output judgment probabilities
备注：
点击查看摘要
Abstract:Generative large language models are widely used for multilingual text evaluation, yet whether decision models that directly output judgment probabilities can serve as multilingual judges has received limited attention. We evaluate Jev against generative LLM judges on four multilingual benchmarks with human annotations, covering up to 47 language varieties and three evaluation formats: binary decisions, pairwise comparisons, and graded ratings. At approximately $1/31$ to $1/61$ of GPT-6.1's evaluation cost, Jev is competitive on most multilingual judging tasks, but falls behind GPT-6.1 on knowledge-intensive answer verification. Further analysis shows that Jev is more likely to accept incorrect answers in low-resource languages than in English and that its probability outputs help identify errors across tasks. Based on these findings, we offer recommendations on evaluation instructions, confidence-based selection, and model routing, providing empirical guidance for using Jev as a multilingual judge.
116. 【2611.14850】Effective Teacher Support for Reasoning Distillation
链接：https://arxiv.org/abs/2611.14850
作者：Lavinia Ghita,Dhruv Desai
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：teacher targets expensive, computes dense teacher, stored teacher targets, Forward-KL language-model distillation, Forward-KL language-model
备注：
点击查看摘要
Abstract:Forward-KL language-model distillation normally computes dense teacher and student scores over the full vocabulary at every supervised position, making training and stored teacher targets expensive. We instead distill from the teacher's highest-probability vocabulary fraction, renormalizing the retained mass as we sweep support from 100% to 0.01%. Our main study distills Qwen3 4B - 1.7B. We confirm the broader support-reduction finding on larger Qwen3 8B - 4B and Nemotron Nano 12B - 9B pairs and under answer-only supervision. We evaluate generation primarily on MMLU-Pro and secondarily on GPQA-Diamond. Across the Qwen3 settings, retaining 0.01% of the vocabulary causes no observed MMLU-Pro degradation relative to full-vocabulary distillation, although disagreement with the complete teacher distribution increases. Nemotron Nano matches full-vocabulary MMLU-Pro at 0.1%, but smaller fractions fail to emit the closing reasoning tag, showing that the reliable cutoff depends on the model family. At 0.01% support, caching the retained next-token scores from the teacher forward pass cuts training step time by 38%, while restricting student output computation to those tokens cuts peak memory by 24%; neither causes observed MMLU-Pro degradation.
117. 【2611.14833】Do People Trust AI Assistants Even When They Are Consistently Wrong?
链接：https://arxiv.org/abs/2611.14833
作者：Cameron R. Jones,Julia Wong,Aaron S. Cohen,James Woolley,Benjamin K. Bergen
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)
关键词：increasingly using conversational, conversational AI systems, systems to make, make decisions, decisions despite concerns
备注： 51 pages, 14 figures, 11 tables. Preprint, not peer reviewed
点击查看摘要
Abstract:People are increasingly using conversational AI systems to make decisions despite concerns around their reliability. How well do people calibrate to AI systems' accuracy in multi-turn conversations? We measure how people's reliance on LLMs' advice changes across repeated interactions, varying whether the AI assistant is helpful (100% accurate), unhelpful (0% accurate), or mixed (50% accurate). Across 4 experiments, we find people learn to trust helpful models more than unhelpful ones (67% vs 21% of the time), but only when they receive external feedback on the models' accuracy. Without feedback, people continue to be persuaded 48% of the time by a consistently unhelpful model (vs 38% for helpful). Rather than gaining trust in helpful models, participant reliance on LLM advisors tended to be high in early trials and only fell with evidence of inaccuracy. Participants trusted LLM advisors more than they trusted human advisors (83% vs 65%, Experiment 4), and LLMs benefited more from having a helpful track record than humans did. In contrast with previous work, we find limited evidence of an advantage for arguing for the truth (versus a falsehood). Truth advantages emerged only when participants were already very confident in their position, and did not emerge at all for static hints. Collectively, the results suggest that people may be swayed by LLM advice, even when it is consistently false, unless they have access to timely ground-truth feedback. Unfortunately, in many domains such feedback may not be available, leading to overreliance on AI.
118. 【2611.14828】LLMs and the Homogenization of Teaching
链接：https://arxiv.org/abs/2611.14828
作者：Mei Tan,Hyunji Nam,Hari Subramonyam,Dorottya Demszky
类目：Computation and Language (cs.CL)
关键词：Large language models, open-ended text generation, Large language, disciplinary work students, open-ended text
备注： Revised version of a paper published at COLM 2026 under the title "Can LLMs Match Human Diversity in Educational Content Generation?"
点击查看摘要
Abstract:Large language models (LLMs) are known to lack diversity in open-ended text generation, a limitation that is especially consequential in education, where homogeneity can narrow the kinds of thinking and disciplinary work students are invited to do. We study diversity in two educational generation tasks: math items and essay feedback. We compare frontier and open-weight models with human-authored reference distributions using lexical, semantic, and domain-grounded measures. For math, we examine the mathematical activities students are asked to perform; for feedback, we examine the revision work requested and the rhetorical strategies used to communicate it. We evaluate direct prompting, two diversity prompting methods, and post-training. Across both tasks, directly prompted model outputs are markedly less diverse than human-authored content--78% higher on lexical (Self-BLEU) and 51% higher on semantic (embedding) similarity--and represent a narrower range of instructional forms. Diversity prompting and post-training increase variation largely through surface features without broadening the instructional repertoire. Models inherit and amplify the most normative routines of human instruction. Overcoming mode collapse in education will require richer instructional data and investment in teachers' creative capacity and professional judgment.
119. 【2611.14823】Discharge Summary Generation Is Not Just Summarization: A Reality Check for Evaluation
链接：https://arxiv.org/abs/2611.14823
作者：Radhika Dua,Frederick Wolff,Kyunghyun Cho,Eric Karl Oermann
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Discharge summaries combine, discharge-time decisions, Discharge summaries, summaries combine, combine a retrospective
备注： 20 pages, 8 figures. Radhika Dua and Frederick Wolff contributed equally. ML4H 2026
点击查看摘要
Abstract:Discharge summaries combine a retrospective account of hospitalization with discharge-time decisions. Physician-written references therefore contain both facts supported by prior clinical notes and reference-only content, potentially reflecting clinical synthesis, handoffs, or discharge planning. Reference-only evaluation can conflate failure to recover available information with failure to reproduce content absent from the model input. We introduce FairSumEval, an evidence-aware, fact-level framework that assesses whether each reference and generated fact is supported by the model's evidence and captured by the other summary. The resulting outcome map separates matches, omissions, and additions. Two complementary metrics, Soft IoU-S and Soft IoU-NS, measure reference-generation agreement for facts with and without identified evidence support. On 200 MIMIC-III admissions, 18.8% of physician reference facts have identified support in the prior evidence, compared with 65.4% and 63.5% of facts generated by a general-purpose and a medically specialized model. Overlap is substantially higher for supported content (0.255 and 0.236) than for content without identified support (0.030 and 0.026). The two scores are weakly correlated across admissions (rho = 0.22 and 0.17), and conventional metrics do not consistently capture both dimensions. FairSumEval distinguishes evidence-grounded summarization from agreement on content without identified support, revealing what models omit and add in each category.
Comments:
20 pages, 8 figures. Radhika Dua and Frederick Wolff contributed equally. ML4H 2026
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as:
arXiv:2611.14823 [cs.CL]
(or
arXiv:2611.14823v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.14823
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
120. 【2611.14818】What Do Tokenizer Comparisons Measure? Disentangling Granularity, Root Assignment, and Word-Level Readout across Amharic and Hausa
链接：https://arxiv.org/abs/2611.14818
作者：Abdul Rehman Antall,Baidya Nath Saha
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：morphologically rich languages, Morphology-aware tokenizers, byte-pair encoding, morphologically rich, BPE
备注： 19 pages, 6 figures, 7 tables
点击查看摘要
Abstract:Morphology-aware tokenizers are expected to help morphologically rich languages, and their reported gains over byte-pair encoding (BPE) are usually credited to their linguistic units. A comparison with BPE cannot support this attribution, since such a tokenizer also segments text more finely (granularity) and, on token-level tasks, changes how much the sub-token readout matters. We separate both factors from the effect of grouping words by their roots (root assignment) in Amharic, a Semitic language whose Ge'ez abugida hides consonantal roots inside syllabic glyphs, with Latin-script Hausa as an orthographic contrast. Our design combines a lossless root-and-pattern tokenizer with controls that change one factor at a time, in two independent implementations. In both, real root assignment improves Amharic named-entity recognition over scrambled roots (+4.9 and +4.7 F1), and root-frequency structure explains little of this gain. In small from-scratch models, the readout choice moves F1 by up to 13.4 points and reverses the sign of every comparison of the root-and-pattern arms with BPE, whereas in two pretrained encoders it moves F1 by less than one point. The granularity effect changes sign across languages and implementations. We recommend decomposing tokenizer effects, and reporting the readout, before a gain is attributed to linguistic structure.
121. 【2611.14801】Distributionally Robust BEST-RQ For Speech Representation Learning
链接：https://arxiv.org/abs/2611.14801
作者：Muhammad Khan,Xiaodong Cui,Brian Kingsbury,George Saon
类目：Computation and Language (cs.CL); Audio and Speech Processing (eess.AS); Optimization and Control (math.OC)
关键词：well-established self-supervised learning, large-scale unlabeled audio, unlabeled audio due, learn speech representations, self-supervised learning approach
备注：
点击查看摘要
Abstract:BEST-RQ, based on random projection and quantization, has been a well-established self-supervised learning approach to learn speech representations from large-scale unlabeled audio due to its high performance and efficiency. However, in BEST-RQ representations learned by random quantization can be sensitive to the choice of quantization targets. To address this issue, we propose a distributionally robust extension of BEST-RQ that seeks representations robust across multiple quantization configurations. Specifically, we define groups by codebooks and formulate the training as a group Distributionally Robust Optimization (DRO) problem. Rather than optimizing solely for the average loss across groups, our approach adaptively reweights groups to emphasize those performing poorly. Additionally, we regularize DRO with a Kullback-Leibler divergence to prevent excessive distribution deviation. We evaluate our approach on the Multilingual LibriSpeech dataset and show that the distributionally robust BEST-RQ achieves superior performance over the conventional uniform average across multiple codebooks.
122. 【2611.14794】When Is Proof-Step Verification Worth Its Cost? Operating Requirements of Certify-or-Decline Verification for Open-Weight Mathematical Reasoning
链接：https://arxiv.org/abs/2611.14794
作者：Abhinav Gupta,Ben Slivinski,Yashica Patodia,Michael Saldivar
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Proof-step verification rewrites, Proof-step verification, certify or decline, verification rewrites, rewrites a solver
备注： 13 pages, 1 figure, 13 tables. Accepted at the 6th Workshop on Mathematical Reasoning and AI (MATH-AI) at NeurIPS 2026. Code: [this https URL](https://github.com/yashica-patodia/certify-or-decline)
点击查看摘要
Abstract:Proof-step verification rewrites a solver's answer into typed steps and uses LLM judges to certify or decline. We evaluate this pipeline on open-weight models across GPQA, AIME-2025, and a MATH-500 subset. Certification raises answer-key-match precision by 31 percentage points on the strong GPQA configuration and 46 on AIME, while answering only 35% and 21% of attempts. On near-ceiling MATH-500, gains are at most 5 points at a loss of 13-27 points of coverage. An output-token-matched self-consistency selector obtains 82.9% precision at 35% coverage, compared with the verifier's pooled 87.6% (paired difference: +4.8 points, 95% interval [-8.2, 18.5]). A diagnostic sample reveals a distinct failure mode: 52 of 88 completed problems end in invalid proof construction without ever reaching a judge. Finally, external-LLM acceptance of rendered certified chains is 61.0-67.6%, compared with 87.6% answer-key match. These audits lack human or formal-kernel ground truth. Open-weight auditor pairs show near-zero chance-corrected agreement, which measures consistency rather than accuracy against proof truth. These results motivate separate reporting of execution failures, selected-answer precision, and independently assessed proof validity. We provide per-configuration results and evaluation details in the supplement.
123. 【2611.14774】An LLM Is All You Need: Data-Efficient Adaptation to Full-Duplex, Word-Level Spoken Dialogue
链接：https://arxiv.org/abs/2611.14774
作者：Tairan Chen,Richard Yucheng He,Yihang Liu,Baodong Cao,Chen Xu
类目：Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
关键词：Full-duplex spoken dialogue, spoken dialogue, hundreds of thousands, thousands to millions, millions of hours
备注：
点击查看摘要
Abstract:Full-duplex spoken dialogue, in which a system listens while it speaks and can backchannel, yield the floor, and be interrupted, is usually obtained by training on hundreds of thousands to millions of hours of speech. This is costly, rewrites the language model that supplies the system's knowledge, and still leaves turn-taking either implicit or decided coarsely rather than word by word. We show that a frozen, general-purpose multimodal LLM can instead be adapted into a word-level full-duplex system with little data. Our system is a thinker-talker cascade on an 80 ms frame clock. The thinker keeps the LLM frozen and trains only lightweight adapters and a few new token embeddings (97M parameters); at every frame it emits one token of agent text, with pauses, yields, and onsets represented as tokens of the same vocabulary and kept legal by a finite-state machine. A four-stage curriculum, each stage anchored to the model's own behavior under the previous format, performs the conversion in about 30 GPU-hours. The talker reads only the thinker's discrete tokens, so the two halves are trained independently. On Full-Duplex-Bench and InteractionBench, the system is competitive with open-source full-duplex systems built through large-scale speech training: among them, it is the least likely to take the floor when the user merely pauses, backchannels most often, and leads in spoken-task accuracy, groundedness, and coherence over long conversations.
124. 【2611.14766】Rational Use of Time for Social Coordination in Humans and AI
链接：https://arxiv.org/abs/2611.14766
作者：Xiulin Yang,Sirisha Gudavalli,Jennifer Hu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：humans, temporal cues, Abstract, social, others' mental states
备注： 30 pages, 16 figures
点击查看摘要
Abstract:All social interactions are situated in time. Previous studies have shown that humans are able to use implicit temporal cues, such as the duration of a pause, to infer others' mental states. But how do humans use temporal cues for dynamic, fine-grained social coordination? And can AI systems do the same, without ``experiencing'' continuous real-time as humans do? We study these questions using a cooperative card game task called The Mind, which requires players to achieve a shared goal across repeated interactions but forbids explicit communication: the only available signal is the passage of time. We evaluate 150 humans, and two classes of AI models which reflect different ways of operationalizing time in artificial systems: computer-use agents (CUAs), and standard text-prompted LLMs. We find that human behavior is best captured by a Bayesian strategy that infers a partner's belief from their timing---and similarly for frontier models. However, unlike humans, none of the tested models seem to efficiently adapt their behaviors to their partners' over the course of the game. From a cognitive perspective, our findings suggest that humans perform implicit probabilistic reasoning about continuous-time signals in dynamic social settings, and that such reasoning mechanisms may emerge without real-time experience. Practically, our study highlights new challenges for AI systems to coordinate efficiently with other agents by learning to interpret and adapt to their implicit signals in dynamic settings.
125. 【2611.14758】Benchmarking Multilingual Document Understanding in Vision-Language Models
链接：https://arxiv.org/abs/2611.14758
作者：Matteo Gabburo,Daniela Baiamonte,Stefano Simonazzi,Silvia Gardini,Sean Cesare Lazzeri,Andrea Zugarini
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：cover English documents, Recent Vision-Language Models, Document Understanding, Recent Vision-Language, English documents
备注： 18 pages, 4 figures
点击查看摘要
Abstract:Recent Vision-Language Models (VLMs) perform strongly on multimodal tasks, Document Understanding (DU) among them, but the benchmarks that measure them mostly cover English documents and narrow problems. How well current VLMs generalize across languages, tasks, styles and layouts therefore remains unclear. We introduce MDU, a multilingual DU benchmark of 23146 examples spanning 13 tasks and five languages: English, French, German, Italian, and Spanish. The tasks isolate complementary capabilities, from surface-level text and Markdown extraction through summarization, classification and named-entity recognition to layout-sensitive passage and layout extraction. We evaluate 45 state-of-the-art open-weight VLMs from 1.7B to 235B parameters, plus one commercial system under the same protocol. The benchmark is far from saturated: the best average is 69.0, only eight of the 45 evaluated systems reach 65, and the two best results come from 27B models rather than from the largest systems we evaluate. Performance is uneven in ways that scale does not fix. The gap between the strongest and weakest language does not close as models grow, and it survives controlling for the domain composition of each language. Capabilities also do not improve together: once we partial out overall model quality, per-task scores are largely uncorrelated, and transcription ability in particular trades off against semantic extraction.
126. 【2611.14704】Code as Explanations: Executable and Verifiable LLM Explanations
链接：https://arxiv.org/abs/2611.14704
作者：Nhi Nguyen,Shauli Ravfogel,Rajesh Ranganath
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)
关键词：increasingly make consequential, problems alongside humans, make consequential decisions, solve problems alongside, large language models
备注： 30 pages, 11 figures, 3 tables, The Fortieth Annual Conference on Neural Information Processing Systems (NeurIPS 2026)
点击查看摘要
Abstract:As large language models (LLMs) increasingly make consequential decisions and solve problems alongside humans, we must understand how models arrive at their conclusions. Understanding how an LLM behaves requires observing it across multiple inputs, yet free-text explanations such as chain-of-thought (CoT) are generated per instance and cannot be easily verified on new inputs. We propose {code explanations to address the mismatch in how LLM explanations are generated versus how they are evaluated: a program explains LLM behavior across a dataset of inputs, and its execution enables automatic verification. We define Consistency metric that measures the fraction of inputs on which the program reproduces the LLM's outputs, and use it to evaluate and select candidate programs. Across three open-source code-capable LLMs and eight tasks, we find that LLMs can produce highly consistent code explanations in several settings. Code explanations are also 6$\times$ to 100$\times$ shorter than CoT, and better align with model behavior in 9 out of 24 settings. However, consistency is significantly lower on tasks with more complex linguistic components, where generated programs reproduce model outputs no more frequently than an uninformative explanation baseline, and these programs often rely on longer hard-coded patterns. In experiments with Claude Opus 5.5, providing the model with consistency feedback and code execution improves explanation consistency across tasks, but consistency remains significantly lower on more complex tasks. Our findings establish executable code as a novel, verifiable, and compact approach to explaining LLM behavior and highlight verification feedback as a promising direction for improving explanation consistency. The code for this paper is at this https URL.
127. 【2611.14700】Probe What-If Worlds Before You Ship: Persona Simulation for Real-World Decision Making
链接：https://arxiv.org/abs/2611.14700
作者：Julie Zhu,Jianheng Hou,Zhixu Silvia Tao,Shi Bo,Yilan Fan,Yixuan He,Zhiyuan Hu,Shirley Huang,Fangyu Liu,Yijun Wang,Zibu Wei,Haimingyue Xu,Zhen Xu,Zichen Yuan,Jierui Zuo,Jintao Huang,Yifan Wang,Qianfeng Wen,Jiahan Li,Zhejian Peng,Bowen Yang,Shushu Liang,Yuexing Hao,Xiaomin Li
类目：Computation and Language (cs.CL)
关键词：recruiting specialized participants, bottleneck design iteration, services meet user, system testing reveal, designing controlled what-if
备注：
点击查看摘要
Abstract:User research and system testing reveal whether products and services meet user needs, yet recruiting specialized participants, designing controlled what-if comparisons, and repeating studies as designs evolve often bottleneck design iteration and data-driven decision-making. We present a framework and execution infrastructure that translates real-world industry inquiries into controlled experiments with simulated users. Our methodology formally defines the target cohort, experimental stimuli, and decision-relevant metrics, while the pipeline supports large-scale concurrent runs over cohort-stimulus-environment combinations (survey, web, chatbot, and OS app), auditable trial-level logging, cohort-level outcome aggregation, and cross-cohort and cross-variant statistical reports. Across twelve industry partner cases spanning five domains, we show how constructing hard-to-reach or what-if persona cohorts supports exploratory studies and distills simulated responses into testable design hypotheses. Cross-model comparisons on selected cases largely preserve primary conclusions, whereas perturbing or ablating persona attributes alters service outcomes, effect sizes, and inter-group differences, indicating that grounding target cohorts in detailed personas materially shapes simulation results. Together, these studies show that persona-enabled agents can test specified cohorts at design speed, diagnose systems under test, and deliver directional evidence that focuses problem definition, steers design and strategic decisions, and guides further study.
128. 【2611.14683】rait Hitchhiking in LLM Post-Training
链接：https://arxiv.org/abs/2611.14683
作者：Adil Soubki,Elizabeth S.Z. Tan,Miles Cranmer
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Reinforcement learning, growing rapidly, standard stage, compute devoted, Reinforcement
备注：
点击查看摘要
Abstract:Reinforcement learning (RL) is now a standard stage of language model post-training, and the compute devoted to it is growing rapidly. While it has been shown to improve capabilities, particularly for tasks with verifiable rewards, it can also change behaviours and internal properties that the reward does not explicitly target. We present a formalism to describe the evolution of "traits" during RL post-training and, in doing so, recover the Price equation from evolutionary biology. We use this to develop a mathematical model for what we call "trait hitchhiking": the amplification or suppression of non-targeted traits as training redistributes probability across completions. We evaluate this Price update expression on language models trained with GRPO and show that the Price estimates closely track the sampled trait dynamics. These results identify trait hitchhiking as a mechanism by which RL post-training can silently amplify undesirable traits.
129. 【2611.14675】MITRA-Swarm: Injecting Explicit Linguistic Structure into Foundation Models for Classical Machine Translation
链接：https://arxiv.org/abs/2611.14675
作者：Kayshav Bhardwaj,Pragun Seth,Kush Bhardwaj,Vijay Nagasamy,Kurt Keutzer
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Classical Sanskrit poses, morphophonemic fusion Sandhi, nominal compounding Samāsa, Classical Sanskrit, dense nominal compounding
备注： 17 pages, accepted to NeurIPS 2026 LP4FM Workshop
点击查看摘要
Abstract:Classical Sanskrit poses three challenges unresolved by single-call monolithic models: morphophonemic fusion Sandhi, dense nominal compounding Samāsa, and discourse-level zero-anaphora forced by poetic meter. We present MITRA-Swarm, a multi-agent architecture injecting explicit linguistic structure into an otherwise monolithic pipeline: a Sandhi-splitting agent, a parallel array of generalist gemma-4-26B-A4B-it and domain-specialized gemma-2-mitra-it translators, and a discourse-aware Ellipsis Restorer that consults corpus-derived register tags to avoid inventing active-voice subjects in impersonal legal and philosophical registers. Two separated judges evaluate quality: a routing judge ($J_{\text{route}}$, same model family as the generators) driving an internal critique loop, and an independent reporting judge ($J_{\text{report}}=$gpt-4o-mini, no shared vendor lineage) scoring every output exactly once. On a stratified benchmark of 1,000 verses across five registers (23,990 scored verdicts, 12-condition pre-registered ablation), the full swarm reaches $85.90$ MQM against a monolithic baseline of $85.27$ ($\Delta=+0.63$, $p_{\text{adj}}=0.0018$, 95% CI $[+0.30,+0.97]$), and isolated discourse restoration alone accounts for $+0.44$ MQM ($p_{\text{adj}}=0.0288$), outperforming a call-count-matched self-refinement baseline by $+0.51$ MQM ($p_{\text{adj}}=0.0288$). Severe per-verse failures (MQM$80$) fall from $9.0\%$ to $7.6\%$, at roughly $9\times$ the per-verse inference cost of the baseline. Additionally, $J_{\text{route}}$ scores its own family's outputs $2$-$7$ MQM higher than $J_{\text{report}}$ on every one of the 12 conditions, empirically motivating the two-judge split; and a preflight screen of a 192,151-entry retrieval index against all 12 evaluation works verifies 0 reference leaks across 269 runtime checks. These are small gains on a metric saturating near 85-86.
130. 【2611.14661】Abstention Is Not Threshold Compliance: Stated Scoring Rules in Open Language Models
链接：https://arxiv.org/abs/2611.14661
作者：Dongsun Moon
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：propose stating, Kalai, abstention, abstention format, format
备注： 34 pages, 3 figures, 29 tables
点击查看摘要
Abstract:Kalai et al. propose stating the scoring rule in the prompt with an explicit threshold t, so that a model should answer only when its probability of being correct exceeds t. We probe each requirement of compliance on shared items, in 12 checkpoints from three post-training stages of four fully open 3-8B recipes, with exploratory models up to 32B. At t = 0.75, a line limiting the reply to an answer or "I abstain" (the abstention format) raised the mean abstention rate from 20% to 91%. Yet within this format, raising t from 0.5 to 0.9 changed it by only -0.8 percentage points. Without the line, the higher threshold even lowered abstention, and up to 40% of a checkpoint's items received decisions that no compliant policy with threshold-independent beliefs could make. Given the probability that their answer was correct, the checkpoints barely responded to the threshold in a forced-choice probe. Comparisons with self-assessment signals such as P(True) depended on the grader and on answer drift between prompts. An external threshold on recalibrated P(True) made coverage non-increasing in t by construction. Calibrated on the evaluation distribution (post hoc), it beat the abstention format at t = 0.5; calibrated on TriviaQA and applied to PopQA, however, it fell below that format at 0.75. On OLMo 3 7B, decisions trained on threshold-conditioned targets did not follow unseen thresholds consistently. A post-hoc variant trained at four thresholds answered less as t rose but still failed a pre-specified test, mainly on agreement with its training rule. A high abstention rate is not evidence of compliance: evaluations using stated scoring rules should report how often models abstain, whether decisions respond to the stated threshold, and which items they answer.
131. 【2611.14654】Cleaning an Agent's History Hurts When the World Still Holds the Error
链接：https://arxiv.org/abs/2611.14654
作者：Egor Pakhomov,Anurag Koul,Hongjun Liu,Bo Pang,Shafiq Joty,Erik Nijkamp
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Tool-using language-model agents, Tool-using language-model, language-model agents accumulate, agents accumulate histories, world
备注： 23 pages, 6 figures; code and data in ancillary files
点击查看摘要
Abstract:Tool-using language-model agents accumulate histories of their own mistakes, and a system that compacts, repairs or hands off such a history decides what it says about those mistakes while their effects stay in the world. Prior work cleans the history at a fixed world, where showing a corrected step and saying it is done move together. We ask whether the same correct content helps or hurts depending on how the history states it and what the world holds. We freeze an agent mid-task with its exact world state, edit the history or the world, and let a receiver model continue. On AgentCE-Bench, after the agent commits a wrong value, we hold the world fixed and add the correct value by two natural edits: a truthful note beside the preserved error or the agent's own completed action. The note raises recovery, the share of remaining targets the receiver gets right, from 51% under a matched neutral note to 66%. The completed action lowers it below the unedited history, from 50% to 44%, so the value's presence alone does not predict the effect. On AppWorld, after a database write, we vary whether its receipt reports success or failure and whether its effect is present. A success receipt lowers whole-task success from 45% to 28% while the effect is absent and raises it from 38% to 49% once present. The two effects differ by 27 points pooled over two receivers, a difference positive in six of eight receivers at 97.5% and seven at 95%. A history edit's effect thus depends on the world it describes, and a history made to look clean while the world still holds the error can leave an agent worse off than no edit at all.
132. 【2611.14648】Evaluating the Performance of LLMs in Drafting NIH Data Management Plans
链接：https://arxiv.org/abs/2611.14648
作者：Nahid Zeinali,James ONeil,Xuebin Dong,Rebecca Hofstein Grady,Maria Praetzellis,Brian Riley,John Chodacki,Bhavesh Patel
类目：Digital Libraries (cs.DL); Computation and Language (cs.CL)
关键词：fuel scientific discoveries, Sharing research data, enable reproducibility, promote transparency, scientific discoveries
备注：
点击查看摘要
Abstract:Sharing research data is essential to promote transparency, enable reproducibility, and fuel scientific discoveries. To ensure consistent sharing, the National Institutes of Health (NIH) and other funding agencies require applicants to submit data management plans (DMPs) with their proposals. They aim to encourage researchers to consider their data management and sharing strategies early on. However, researchers often face challenges when developing DMPs due to a lack of knowledge about data-sharing practices. Here, we evaluated the performance of Large Language Models (LLMs) in drafting DMPs compliant with the 2023 NIH guidelines. The goal was to investigate whether LLM-supported DMP creation could reduce the burden on researchers and librarians. We compared Llama and GPT performance against NIH-provided DMP samples. We also asked domain experts to evaluate LLM-generated DMPs. Overall, we found that LLMs can accelerate the creation of initial drafts but still require expert review before submission to ensure clarity and completeness. Moreover, open-source LLMs may not be as ready off-the-shelf as commercial ones for drafting funder-compliant DMPs.
133. 【2611.17035】Prevalence Bounds for Edited Watermarked Text: Power Envelopes and Calibration Sensitivity
链接：https://arxiv.org/abs/2611.17035
作者：Kuancheng Ye
类目：Machine Learning (stat.ML); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：Watermark detectors decide, watermarked language model, language model, detectors decide, Watermark detectors
备注： 31 pages, 3 figures, 8 tables. Code and results: [this https URL](https://github.com/YYKKCC-kevin/watermark-prevalence)
点击查看摘要
Abstract:Watermark detectors decide whether one document came from a watermarked language model. Auditors often need a different number: the share of a corpus that did. We study this share for Gumbel-max and green-list (KGW) watermarks when every document may have been edited by an unknown amount. Without restrictions on the edits, the upper end of the identified set is 1. Combining a known least-favourable next-token distribution with a sequential coupling, we derive a power envelope indexed by three budgets: a retention floor, an entropy budget, and a budget for in-place substitutions, which for Gumbel-max make edited positions look less watermarked than human text. The envelope gives an identified set that is sharp for the alternatives it dominates, finite-sample bounds on the realized share of a fixed corpus with either the exact null or a null calibrated on an independent human sample, and confidence sequences for streams. In Gumbel-max simulations where the envelope binds, the bounds cover, and the threshold that maximizes the gap between envelope and null is generally as tight as twelve thresholds. On text from OPT-1.3B and Qwen3-1.7B, 12,000 fresh human documents scored under three keys show no robust departure from the exact null, and all bounds covered in resampling trials from finite pools of documents with random edits, substitutions and paraphrases; at a share of 0.2 the exact-null bound is about [0.14,0.38]. These results are fragile in two ways we make precise. LLM-paraphrased KGW pools fall below the envelope, yet at 2000 documents the bounds still covered in these trials. A simulated null error of 0.01, comparable to the largest deviation we observed at our thresholds, is likewise harmless at 2000 documents but breaks exact-null coverage at 100,000; a null calibrated on an independent human sample keeps coverage there, but needs a large reference sample to stay narrow.
134. 【2611.14975】Aggregate Accuracy Hides Diagnosis-Specific Failure in Medical Vision-Language Models
链接：https://arxiv.org/abs/2611.14975
作者：Shreya Ajay Kale,Angad Ripudaman Singh Bajwa
类目：Image and Video Processing (eess.IV); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：hide complete failure, Medical vision-language models, open medical VLMs, single diagnosis, hide complete
备注： Accepted at the NeurIPS 2026 Workshop on Medical Reasoning with Vision Language Foundation Models (Med-Reasoner). 16 pages including NeurIPS checklist, 1 figure, 5 tables
点击查看摘要
Abstract:Medical vision-language models (VLMs) are compared mainly by accuracy averaged across findings, a summary that can hide complete failure on a single diagnosis. We audit five open medical VLMs (MedGemma-4B, Lingshu-7B, HuatuoGPT-Vision-7B, Qwen2.5-VL-7B, and MedVLM-R1) on 6,048 ChestX-ray14 questions balanced by sex, age, finding, and label. On the 432 pneumothorax-positive X-rays, HuatuoGPT-Vision and Qwen2.5-VL detect zero cases while MedGemma and Lingshu detect 38% and 67% of the same images. The two failing models answer "no" to all 864 pneumothorax cases (balanced accuracy 0.500, chance), yet produce fluent, anatomically specific explanations that name the signs of a collapsed lung and then deny them, with no hedge or abstention. This failure is not an artifact of prompting, image resolution, label ambiguity, or model scale. It persists across four prompt formats, at native resolution, and on single-label cases. A within-model control shows the same forced prompt gives HuatuoGPT 79% recall on nodule but only 6% on pneumothorax. It survives a tenfold scale increase (Qwen2.5-VL-72B detects 4%) and replicates on SIIM-ACR, an independent dataset with radiologist-drawn masks, where the failing models detect 0 of 432 confirmed pneumothoraces, including 0 of the 144 largest lesions. Reading the models' logits and internal states shows this is not blindness. The two failing models are highly confident yet no better than chance and a linear probe recovers pneumothorax from their hidden representations even where recall is zero, so the finding is represented internally but suppressed at the output. Aggregate accuracy therefore cannot establish that a medical VLM can see a given finding, because a model that misses one can still describe it convincingly. Reporting per-finding recall and specificity on balanced cases is needed to tell the difference.
135. 【2611.14526】Partial pooling beats synthetic respondents as estimators, not as covariates: a preregistered small-sample tournament
链接：https://arxiv.org/abs/2611.14526
作者：Howard Kim
类目：Applications (stat.AP); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：growing literature offers, Survey estimates, large language models, sex and age, fill the gap
备注： 28 pages, 3 figures, 3 tables, supplementary information included. Preregistration: [this https URL](https://osf.io/w6s84) . Reproduction package: [this https URL](https://doi.org/10.5281/zenodo.22793037)
点击查看摘要
Abstract:Survey estimates for population segments, such as media use by sex and age, rest on few respondents per cell, and a growing literature offers synthetic respondents generated by large language models to fill the gap. That literature has not tested them against the small-area estimators a methodologist would otherwise use. We ran ten estimators, preregistered, on identical household-clustered splits of a Korean media panel across five calibration budgets and three holdout regimes. A multilevel partial-pooling model of the MRP family led every calibration-only estimator at every budget, matching at one hundred respondents what direct estimation reaches with roughly four times as many. On unobserved segments, information fixed as a per-segment prior was inert for synthetic panel and previous wave alike; attached as a bias correction it transferred, at the price of estimation noise. No registered synthetic advantage over MRP survived the paired decision rule. Entered instead as a covariate inside the multilevel model, an exploratory hybrid, the same panel improved on MRP on unobserved segments: the information survives where the registered constructions did not. Interval coverage stayed below nominal throughout and worsened with budget for partial pooling, contrary to prediction.
信息检索
1. 【2611.17226】Sheaf-Inspired Structured Scoring Extensions of LightGCN for Collaborative Filtering
链接：https://arxiv.org/abs/2611.17226
作者：Ksenia Belkovskaya,Timur Lidzhiev,Maria Stebliy,Alexander Tarakanov
类目：Information Retrieval (cs.IR); Computational Engineering, Finance, and Science (cs.CE); Computational Geometry (cs.CG); Machine Learning (cs.LG)
关键词：Graph-based collaborative filtering, collaborative filtering learns, filtering learns user, Graph-based collaborative, item interaction graph
备注：
点击查看摘要
Abstract:Graph-based collaborative filtering learns user and item representations by propagating embeddings over a user--item interaction graph. We investigate a modular, sheaf-inspired scoring extension placed on top of a three-layer LightGCN backbone. The motivation comes from cellular sheaves, where local vector spaces are related by linear restriction maps; here, this idea motivates structured, pair-dependent transformations of user and item embeddings rather than a change to graph propagation. We compare the identity inner-product scorer, diagonal, rank-one low-rank, and full matrix residual scorers, and a parameter-matched residual MLP baseline (\texttt{mlp\_full}) on Amazon-Book, Gowalla, MovieLens-1M, and Yelp2018. We report ranking quality and catalog coverage at cutoffs 10 and 20. The selected structured variants show modest, dataset-dependent changes in ranking quality and sometimes substantial changes in coverage. Our method is inspired by sheaf geometry but does not construct a cellular sheaf or implement sheaf-Laplacian diffusion; the experiments therefore do not establish a causal benefit from sheaf geometry itself.
2. 【2611.17070】Evaluation of Music Version Retrieval Methods for Setlist Identification in Live Concerts
链接：https://arxiv.org/abs/2611.17070
作者：Andres Ferraro,Albin Correya
类目：Information Retrieval (cs.IR); Sound (cs.SD)
关键词：Automatic setlist identification, live concert recordings, Automatic setlist, setlist identification aims, reference tracks
备注：
点击查看摘要
Abstract:Automatic setlist identification aims to identify the songs performed in live concert recordings by matching noisy and variable-quality audio against a database of reference tracks. This task presents challenges beyond conventional music version identification, including substantial arrangement differences, background noise, and the need to process continuous recordings efficiently at large scale. In this work, we evaluate modern music version retrieval methods for setlist identification using the ASID benchmark, comparing the established Re-MOVE system with CLEWS and NAVE, an internal neural audio version embedding model. Our results show that NAVE and CLEWS substantially outperform Re-MOVE. Notably, NAVE uses 256-dimensional embeddings, compared with 1024 dimensions for CLEWS, providing a four-fold reduction in embedding storage while achieving better retrieval performance. We further evaluate music/non-music gating and find modest improvements in detection and temporal coverage, while qualitative analysis suggests that such preprocessing can improve recognition boundaries beyond what the standard ASID metrics capture. Overall, the results demonstrate that segment-level audio embeddings provide a strong basis for scalable setlist identification and that compact representations can achieve strong accuracy under realistic live-concert conditions at much lower storage and serving cost.
3. 【2611.17030】Similar but Not Redundant: Embedding-Gated Refinement for High-Granularity Topic Models
链接：https://arxiv.org/abs/2611.17030
作者：Daniel Denley,Robert L. Nicol,Mike J. Chantler
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：coherent themes fragment, modelling extracts hundreds, failure mode, topic modelling extracts, extracts hundreds
备注： 24 pages, 6 figures, 13 tables
点击查看摘要
Abstract:High-granularity topic modelling extracts hundreds of niche topics from a corpus, yet this regime is rarely studied and is more commonly framed as a failure mode: "over-clustering," in which coherent themes fragment into redundant subtopics. We argue that this framing conflates genuine redundancy with topics that are semantically similar but meaningfully distinct, and that the central challenge in high-granularity modelling is separating the two. Recent post-hoc refinement methods address topic redundancy through either embedding-based similarity thresholding or LLM-guided merging. We show that neither suffices in high-granularity settings and propose embedding-gated iterative merge (EGIM), a hybrid approach that iteratively generates context-rich topic representations, uses embedding similarity to propose candidate merges across the topic space, then applies LLM judgement to accept only genuinely redundant pairs while preserving niche distinctions. Across two patent corpora and one legal corpus, LLM judgement rejects 83% of embedding-identified candidates as non-redundant. EGIM improves discriminability on merged topics by 25-55% over a prior iterative LLM baseline while better preserving the original topic distribution.
4. 【2611.17012】Anonymous in Name Only: A Critical Review and a Reidentification Exercise on the European Commission's Anonymization Measures for Google Search Data under Article 6(11) of the DMA
链接：https://arxiv.org/abs/2611.17012
作者：David Sánchez,Benet Manzanares,Josep Domingo-Ferrer
类目：Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：Digital Markets Act, Markets Act, competing search engines, share Google Search, Digital Markets
备注：
点击查看摘要
Abstract:In July 2026, the European Commission (EC) set out the anonymization measures Alphabet must implement to share Google Search data with competing search engines under Article 6(11) of the Digital Markets Act. As the first concrete illustration of how the EC operationalizes anonymization under the EU digital rulebook, this methodology could become a regulatory benchmark. In this paper, we show why it should not. We critically review the anonymization measures proposed by the EC, from the characterization of residual risk to the suppression thresholds and the reliance on contractual safeguards. For each of those issues, we highlight significant conceptual flaws, and, where applicable, we illustrate these flaws with empirical observations from real Google Search data provided by Alphabet and protected under the EC's measures. Importantly, we present examples of low-effort reidentification, record linkage, and confidential attribute inference achieved through straightforward and automatable attack patterns. Our findings show that the approach of the EC relies on unjustified heuristics rather than formal privacy guarantees, underestimates the risks inherent in free-text search queries, and sacrifices data utility without achieving meaningful protection. We also demonstrate that the proposed measures do not meet any of the three anonymization criteria established by the European Data Protection Board (EDPB): no record isolation, no linkage, and no inference. Practitioners and regulators are therefore cautioned against treating these measures as a sound anonymization practice.
5. 【2611.16947】SignalAudit-QD: A Reproducible Audit Resource for External Signals in AI-Query Forecasting
链接：https://arxiv.org/abs/2611.16947
作者：Amir Rafe,Iman Jamshidi,Gourab Sil,Subasish Das
类目：Information Retrieval (cs.IR)
关键词：reproducible audit resource, dated public signal, public signal adds, signal adds information, archived Google Trends
备注：
点击查看摘要
Abstract:SignalAudit-QD is a reproducible audit resource for testing whether a dated public signal adds information beyond query history in a fixed 20-term U.S. AI panel. It aligns two archived Google Trends extractions with eight USPTO AI-patent publication streams and releases origin-indexed predictions, paired losses, provenance, executable tests, and tamper-evident run manifests. Both inputs are retrospective reconstructions obtained after the modeled 2020--2023 origins; the task is therefore a pseudo-origin assay within frozen measurement vintages, not a historical deployment simulation. In the designated one-month comparison, adding a two-component patent block to a level ridge changes macro mean absolute error by +0.0012 Trends points, with conditional 95% moving-block interval [-0.0363,+0.0387]. This establishes neither aggregate benefit nor equivalence. Alternative dimensions, semantic mapping, patent definitions, a second extraction, and a three-month horizon remain unresolved; persistence-anchored and nonlinear hosts instead show model-specific worsening, tiny for the anchored fit. Matched timing controls expose availability assumptions, while a planted-signal assay detects only the largest tested injection. A within-query high-interest alert demonstrates the released interface but not online utility. The contribution is a bounded negative case study and an extensible evidence schema for auditing external-signal claims in temporal information retrieval.
6. 【2611.16795】KuaiRecV2: Benchmarking Large-Scale Continual Learning for Diversified and Multi-task Recommendation
链接：https://arxiv.org/abs/2611.16795
作者：Chenxu Li,Shuchang Liu,Hantao Shu,Wei Yuan,Zhe Xu,Guoqing Hu,Yan Wang,Biao Yang,Xiang Li,Cheng Ling,Fan Yang,Yongqi Liu,Lantao Hu,Han Li,Kaiqiao Zhan,Kun Gai,An Zhang,Xiang Wang
类目：Information Retrieval (cs.IR)
关键词：semantic representation space, key technological advancements, Recommender systems, model-data scaling, interest to users
备注： This paper has been accepted to NeurIPS 2026
点击查看摘要
Abstract:Recommender systems, which retrieve items of interest to users based on their interaction histories, have recently witnessed several key technological advancements, benefiting from the semantic representation space and model-data scaling. Nevertheless, practitioners and researchers have frequently encountered critical inconsistencies between simple offline evaluations and complex online results, and this gap still exists in the era of large models. In this work, we address several key factors that contribute to this inconsistency: 1) the \textit{large-scale continual learning challenge} that assumes a practical demand to maintain long-term model effectiveness under dynamic item pools and distributional shifts; 2) the \textit{combinatorial diversity challenge} that requires the generation strategy to solve the accuracy-diversity trade-off in both the finer token level and the holistic item level; and 3) the \textit{multi-task reward balancing challenge}, which is particularly critical for modern generative models that can accurately model the sequence distribution but are less controllable for the multi-task demands. To address these challenges and further pave the way for the development of more realistic recommendation solutions, we introduce KuaiRecV2, a deliberately constructed benchmark with industrial-level datasets from Kuaishou. Specifically, we provide a large-scale interaction dataset with million-scale multi-modal item information and long-term interaction records across 30 days, with a dynamic video candidate pool. Additionally, we provide a rigorous benchmark that evaluates retrieval accuracy, diversity, and multi-task performance in one rubric system, where an effective advancement occurs if and only if the new method improves all metrics. The code is available at this https URL
Comments:
This paper has been accepted to NeurIPS 2026
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2611.16795 [cs.IR]
(or
arXiv:2611.16795v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2611.16795
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
7. 【2611.16488】Active Learning of Approximate LLM Ranking for Energy-Efficient Retrieval of Long Queries
链接：https://arxiv.org/abs/2611.16488
作者：Ohad Porat,Elad Yom-Tov
类目：Information Retrieval (cs.IR)
关键词：Large Language Models, Large Language, offer complementary strengths, Language Models, Search engines
备注：
点击查看摘要
Abstract:Search engines and Large Language Models (LLMs) offer complementary strengths for document retrieval: lexical retrievers which rely on keyword matching are fast and energy-efficient, whereas LLMs capture semantic meaning and excel at interpreting long, context-rich queries. However, this comes at a cost that is computationally and energetically prohibitive. We propose the LLM Active Approximation Model (LAAM), a hybrid retrieval framework that introduces a lightweight learned predictor which serves as an intermediary between semantic retrieval and LLM retrieval. LAAM is refined through an active learning loop where an LLM labels a small number of documents. By concentrating LLM evaluations on the most informative documents, the framework substantially reduces inference cost while preserving retrieval effectiveness. We evaluate the proposed framework on TREC Robust 2004 using Lucene with BM25 retrieval and DeepSeek v3 as the LLM, under three levels of query verbosity. For verbose queries, LAAM achieves 87% of average P@10 achieved by DeepSeek's reranking (0.459 vs. 0.526), while requiring only 3.3% of the per-query energy consumption. LAAM is statistically significantly better than BM25 and is indistinguishable from DeepSeek on average precision, though not on MAP (Friedman test, P0.05 with post-hoc testing). Overall, our results demonstrate that selectively approximating LLM relevance judgments through active learning enables retrieval accuracy to be controlled directly through the evaluation (and consequently energy) budget. Rather than committing to either inexpensive (and less accurate) lexical retrieval or exhaustive (and expensive) LLM reranking, our framework exposes a continuous spectrum of operating points along the energy--accuracy curve, allowing practitioners to select how to trade retrieval quality with computational budget.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2611.16488 [cs.IR]
(or
arXiv:2611.16488v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2611.16488
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Elad Yom-Tov [view email] [v1]
Thu, 12 Nov 2026 08:59:23 UTC (2,393 KB)
8. 【2611.16425】RMIT-ADM+S at TREC RAG 2026: Research Agents, Retriever Ablations, and Open-Weight Replication
链接：https://arxiv.org/abs/2611.16425
作者：Oleg Zendel,Kun Ran,Chenglong Ma,Nguyen Khoi Vo,Shuai Wang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Retrieval-Augmented Generation, describe the RMIT-ADM, ClimbMix corpus, team participation, RAG
备注：
点击查看摘要
Abstract:We describe the RMIT-ADM+S team's participation in the TREC 2026 Retrieval-Augmented Generation (RAG) track using the ClimbMix corpus. We submitted seven research-agent runs using proprietary OpenAI and open-weight models, exploring different retrieval strategies, writer models, and agent workflows. Pre-submission ablations identified writer selection and adjacent-chunk expansion as the main factors affecting answer quality. In the official NIST evaluation, six of seven runs exceeded the track median across all three rubric/nugget collections. Our best-performing run, brief-hybrid, achieved the highest all-item coverage among our submissions and tied the track maximum (0.892) for Batch-1 vital coverage. Human side-by-side preferences differed across evaluation batches: the open-weight owa-glm5 led Batch 1 despite lower automated coverage, while sol-research-first led Batch 2. These findings highlight differences between automated coverage measures and human preferences, as well as the potential of lower-cost open-weight models for research-agent systems.
9. 【2611.16405】AntEmbed: Dual-Mode Multimodal Embedding Model for Efficient and Fine-Grained Retrieval
链接：https://arxiv.org/abs/2611.16405
作者：Kehang Jia,Teng Liu,Juntao Li,Hua Chen,Jinxiong Chang,Xiaobo Liang,Min Zhang
类目：Information Retrieval (cs.IR)
关键词：efficiently but struggle, multimodal inputs efficiently, Discriminative embeddings encode, encode original multimodal, embeddings
备注： 13 pages
点击查看摘要
Abstract:Discriminative embeddings encode original multimodal inputs efficiently but struggle with fine-grained semantics. Generative embeddings use reasoning to capture query intent and relevance evidence, but incur higher computational costs. We propose AntEmbed, a dual-mode multimodal embedding model that supports efficient retrieval and reasoning-enhanced fine-grained matching in a unified embedding space. First, we construct retrieval-oriented reasoning content that captures query intent and confusion-aware semantic evidence. We treat original and reasoning-enhanced candidate inputs as semantically equivalent views, and use multi-positive contrastive learning with a single embedding token to align discriminative and generative embeddings. Second, cross-mode self-distillation transfers fine-grained semantic information from reasoning-enhanced to original representations through candidate similarity-distribution distillation and query representation alignment. This strengthens discriminative embeddings without requiring additional online reasoning. Both retrieval modes share a single candidate index. On MMEB-v2, AntEmbed-8B achieves an overall score of 81.5 with reasoning-enhanced embeddings, outperforming the strongest baseline by 3.1 points.
10. 【2611.16404】ReSID: Rethinking Long-Tail Retrieval in Generative Recommendation through Item Reachability
链接：https://arxiv.org/abs/2611.16404
作者：Muyu Zou,Shunye Tang,Yi Xu,Haibo Xing,Yandong Wang,Lingyu Mu,Jinxin Hu
类目：Information Retrieval (cs.IR)
关键词：discrete Semantic IDs, Generative recommendation, Semantic IDs, discrete Semantic, Generative
备注：
点击查看摘要
Abstract:Generative recommendation (GR) represents items with discrete Semantic IDs (SIDs) and casts retrieval as sequence generation. Under skewed interaction distributions and tight serving budgets, GR struggles to retrieve long-tail items. In this work, we are the first to study long-tail reachability across the complete pipeline of SID construction, decoding, and matching. We find that under equal code lengths, parallel SID construction consistently outperforms sequential SIDs on tail items. Moreover, even when full generation fails, decoded sequences carry locally consistent information that retrieves relevant tail items via partial matching. Yet this recovery is bounded by upstream search, failing once beam search prunes all prefixes completable within a fixed mismatch tolerance. Motivated by these findings, we propose ReSID to jointly preserve and recover tail candidates. Built on long parallel SIDs, ReSID pairs popularity-debiased and user-semantic-aware beam search to keep promising paths alive with partial SID matching to recover items from surviving tokens. ReSID achieves state-of-the-art long-tail retrieval while maintaining competitive overall accuracy, with lower latency and higher throughput under narrow beams. ReSID is deployed in our production system, serving main user traffic with substantial business gains. We release our complete code and model checkpoints to support full reproducibility and real-world deployment at this https URL.
11. 【2611.16395】riGen: A Generative Paradigm for Trigger-Induced Recommendation
链接：https://arxiv.org/abs/2611.16395
作者：Muyu Zou,Haibo Xing,Shunye Tang,Liyan Tie,Lingyu Mu,Yandong Wang,Jinxin Hu
类目：Information Retrieval (cs.IR)
关键词：predicting target items, autoregressively generating semantic, generating semantic IDs, recommendation typically operates, predicting target
备注：
点击查看摘要
Abstract:Generative recommendation typically operates under the User-Induced Recommendation (UIR) setting, predicting target items by autoregressively generating semantic IDs as a passive continuation of long-term user history. However, this paradigm overlooks Trigger-Induced Recommendation (TIR), an essential industrial scenario where a user click triggers an immediate follow-up feed. In TIR, recommendations must dynamically align with the instant trigger intent without compromising historical preference continuity. Traditional TIR methods rely on discriminative scoring and cannot guide token-level generation, while existing generative models lack mechanisms to reconcile this structural tension. To address this challenge, we propose TriGen, establishing a tailored generative paradigm for trigger-induced recommendation. TriGen introduces calibrated tail injection to re-encode local history, adaptively arbitrates between persistent tastes and immediate impulses via dynamic gating, and applies position-specific transformations to sustain level-aware trigger guidance across decoding steps. Extensive offline evaluations confirm consistent gains over competitive baselines. Furthermore, online A/B tests across six country markets demonstrate significant revenue and GMV improvements, leading to the full production deployment of TriGen.
12. 【2611.16366】CURATOR: Scalable Fine-grained Evidence Selection for Retrieval-Augmented Generation using Decision Models
链接：https://arxiv.org/abs/2611.16366
作者：Shib Dasgupta,Bandish Parikh,Rashmi Gangadharaiah
类目：Information Retrieval (cs.IR)
关键词：Retrieval-augmented generation, entire retrieved passages, Retrieval-augmented, LLM, spans
备注：
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) provides entire retrieved passages to the LLM, even though only a handful of spans within them contain the evidence pertaining to the question. While precise selection of these spans can improve context utilization, identifying them in isolation is challenging. A span may appear irrelevant by itself, and deciding whether to retain it may require examining other retrieved information. One can evaluate each span's candidacy with the full retrieved context, but this is computationally inefficient as the same text must be processed repeatedly. Pretrained decision model can be used to efficiently evaluate multiple spans simultaneously, allowing each decision to consider the surrounding spans as well. However, our experiments show that their ability to identify relevant evidence deteriorates as the number of simultaneous decisions increases. To address this, we introduce CURATOR, a fine-tuned decision model trained to make reliable evidence-selection decisions over large candidate sets. By training a decision model to select varying numbers of supporting spans from large candidate pools, CURATOR develops the capability to select evidence for RAG while retaining the computational efficiency of joint decision-making. We observe that CURATOR maintains a strong evidence discrimination capability as the number of candidates increases, generalizes across different tasks and document domains, and improves downstream RAG performance, particularly when the available context is limited.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2611.16366 [cs.IR]
(or
arXiv:2611.16366v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2611.16366
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
13. 【2611.16194】GA-HEL: A Knowledge-Driven Expert System for Open-Set, Granularity-Aware Hierarchical Event Linking in Social Media
链接：https://arxiv.org/abs/2611.16194
作者：Shengqi Zhou,Zhigang Liu,Wenxiang Zhu,Zhentao Cang
类目：Information Retrieval (cs.IR)
关键词：deepest level warranted, registered event space, Social-media event intelligence, Social-media event, Event Cards
备注： 16 pages, 6 figures
点击查看摘要
Abstract:Social-media event intelligence requires a system to determine whether a post belongs to a registered event space, identify the supported hierarchy path, and stop at the deepest level warranted by the evidence. We formulate this requirement as open-set hierarchical event linking over frozen Storyline--Episode--Atomic Event Cards. GA-HEL implements a three-stage, knowledge-driven expert-system funnel: open-set scope control limits candidate exposure before hierarchical reasoning, hierarchy-aware decoders select a supported path and depth, and deterministic legal-path validation checks each record before database-compatible use. A 200-post Pilot supports task and mechanism development, while a separately annotated 497-post Expansion set evaluates transfer across four held-out Storylines and a hard-negative pool. Method implementations, prompts, Event Cards, candidate order, and six systems' predictions were frozen before Expansion Gold annotation. The resulting evaluation combines end-to-end hierarchical matching, open-set rejection, structural validation, ablation, cross-Storyline analysis, and an independent expert reannotation of a fixed audited subset. GA-HEL remains competitive with strong global full-card reasoning while providing explicit scope control and hierarchy-valid structured records. Error analysis identifies unsupported descent from Episode-level evidence to Atomic Events as the dominant remaining challenge. The task definition, frozen resource, and auditable protocol provide a reproducible foundation for scope-aware event intelligence. Code, Event Cards, labels, frozen predictions, and evaluation scripts are available at this https URL.
14. 【2611.16159】From Tokens to Behaviors: Rethinking Generative Recommendation for User Trajectory Prediction
链接：https://arxiv.org/abs/2611.16159
作者：Jiaqi Wang,Hanchen Yang,Hengyu Zhang,Hongxu Ma,Wenqi Rao,Hongyang Wang,Zhongbo Sun,Renliang Qian,Weixin Chen,Wengen Li,Jihong Guan,Shuigeng Zhou,Qingpeng Cai,Peng Jiang,Hong Cheng
类目：Information Retrieval (cs.IR)
关键词：aims to capture, evolve over time, time by predicting, predicting the sequence, sequence of future
备注：
点击查看摘要
Abstract:User behavior trajectory prediction (UBTP) aims to capture how a user's needs evolve over time by predicting the sequence of future interactions from that user's interaction history. Recent generative recommendation (GR) methods address this task through autoregressive generation of semantic IDs (SIDs). However, serial SID decoding couples token generation with behavior state transitions and requires multiple dependent steps per interaction. Discrete item feedback overlooks predictive uncertainty, and teacher-forced training leaves a training-inference gap in trajectory generation. To address these limitations, we propose TraGR, a behavior-aware generative recommendation framework that aligns generation, feedback, and learning with successive user behaviors. Its behavior-level architecture predicts SID tokens in parallel within each interaction and models behavioral transitions through recurrent state updates, with joint SID and item-level supervision. Probability feedback combines the selected behavior with a probability-weighted summary of alternatives to guide subsequent predictions. Relation-aware trajectory learning incorporates collaborative transition signals and later credit assignment into training on model-generated trajectories. Experiments on four public datasets demonstrate that TraGR consistently outperforms state-of-the-art baselines across different prediction horizons. Code: this https URL.
15. 【2611.16149】HyperPage: Learned Page Layouts for Disk-Resident Graph Vector Indexes
链接：https://arxiv.org/abs/2611.16149
作者：Xinyu Zhang,Jingze Li,Baihua Zheng,Weiwei Sun
类目：Databases (cs.DB); Information Retrieval (cs.IR)
关键词：Disk-resident graph indexes, Disk-resident graph, SSD pages, layout, DiskANN store
备注： 14 pages, 4 figures, 7 tables. Code available at: [this https URL](https://github.com/zhangshea/HyperPage)
点击查看摘要
Abstract:Disk-resident graph indexes such as DiskANN store each vector with its graph edges as one record on SSD pages. A search needs the page of every record it expands, so its page reads depend on the page layout, that is, which records share a page. Search agents trained with reinforcement learning query one such index run after run, and every graph traversal can be logged with the records it expands. We therefore use the logs of a finished run to lay out the index for a declared memory budget, so later runs read fewer pages. In contrast, existing layouts such as Starling and MARGO are computed from the graph and vectors and use no logs. Learning a layout from logs is challenging, because the logs must stay valid under every layout, the saving depends on what the budget caches, and the best layout is NP-hard to find. Our key observation is that DiskANN-style search routes on in-memory codes and the records it expands, never on their page-mates. As a result, the logged traversals price every layout by replay, and cached records add no page reads. Accordingly, we propose HyperPage, which first builds layouts for the declared budget on the logged traversals of uncached records. It then selects one layout, together with the budget split between hot records and a page cache, by replaying validation steps. In addition, a Lagrangian lower bound shows how far a layout may be from the optimum. We learn from one Search-R1 agent run and test on a later run with a different reward, over 1M and 21M passages. Across seven cache budgets, HyperPage reads 5.2% to 21.2% fewer pages than MARGO, and no compared layout reads fewer. The advantage is largest when the cache is small. For example, at 1% of the 1M index, MARGO needs nearly 3 times the budget to read as few pages. On the 21M index, HyperPage also cuts search time per step by up to 10.4%. The saving holds for a second agent model and a second corpus.
16. 【2611.16148】Calibrated Early Termination with Bounded Optimality Gaps for Constrained Vector Search
链接：https://arxiv.org/abs/2611.16148
作者：Xinyu Zhang,Jingze Li,Baihua Zheng,Weiwei Sun
类目：Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Vector search, retrieval-augmented generation, category may contribute, retrieval layer, layer of recommendation
备注： 14 pages, 5 figures, 3 tables. Code available at [this https URL](https://github.com/zhangshea/CaST)
点击查看摘要
Abstract:Vector search over learned embeddings is the retrieval layer of recommendation and retrieval-augmented generation, and many applications cap how many answer items one category may contribute. Graph indexes answer a query by best-first traversal, and where it stops determines its cost and whether its answer is exact. We study early termination for such constrained $k$-nearest-neighbor ($k$-NN) queries, with plain $k$-NN as a special case, and seek the cheapest stopping rule whose answer is exact with probability at least $1-\varepsilon$. Learned early-termination methods instead target average recall, which does not guarantee exact answers. Multiple testing can calibrate any parameterized stopping rule to our target, but it cannot tell how much a better rule with the same risk and observations would save. Answering this needs a lower bound on the optimum of a rule family too large to enumerate, valid for the query population. Our key idea is to declare the observations a rule may use and to consider every rule monotone in them. Risk-constrained stopping then becomes a linear program over an order polytope, whose Lagrangian minimizers form a nested chain of staircase rules computed exactly by dynamic programming. Fixed-sequence binomial tests along this chain calibrate our rule, CaST, whose failure probability is at most $\varepsilon$ with confidence $1-\delta$. Lagrangian weak duality bounds the optimum of the declared class from below at all risk levels at once, without a union bound over the rules. On two datasets of one million items each, CaST replayed on logged searches costs at most 1.132 times the class optimum for risk levels from 0.03 to 0.10, at 95% joint confidence per setting. Larger savings thus need a rule outside the class. At a common risk target on held-out queries, CaST is faster than every other calibrated rule we time, which take 4.8% to 45.5% more mean time.
17. 【2611.16060】REWEAVE: Online Learning for Workload-Adaptive HNSW Indexes
链接：https://arxiv.org/abs/2611.16060
作者：Minghao Li,Nick Koudas,Raghav Mittal
类目：Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Navigable Small World, Hierarchical Navigable Small, Small World, Hierarchical Navigable, Navigable Small
备注： 20 pages, 9 figures, 5 tables. Full version with appendix
点击查看摘要
Abstract:Vector databases rely on Hierarchical Navigable Small World (HNSW) indexes for similarity search, but a graph built from data alone can be poorly matched to a skewed or changing query workload. We present REWEAVE (Reward-Guided Rewiring of Vector Graphs), an online index-maintenance method that learns edge utility from query feedback and periodically rewires the bottom layer within the original per-node degree cap. The method supports sparse exact-neighbor feedback combined with self-labels, and standard HNSW serving without learning overhead once adaptation is disabled. Under explicit assumptions we prove value-estimation and graph-stabilization guarantees. Under stationary skew, REWEAVE improves held-out recall by up to 23.3 percentage points over HNSW. In comparisons with query-aware baselines on up to 100M vectors, it achieves up to 3.3x NGFix's query throughput at recall@100 of 0.80. On Amazon-ESCI with query drift, it increases stream recall@100 from 0.745 to 0.979 with 34% fewer search distance computations than frozen HNSW. These results illustrate the potential to improve retrieval quality and reduce search effort within an existing graph-degree budget, while incurring additional work during adaptation.
Comments:
20 pages, 9 figures, 5 tables. Full version with appendix
Subjects:
Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)
Cite as:
arXiv:2611.16060 [cs.DB]
(or
arXiv:2611.16060v1 [cs.DB] for this version)
https://doi.org/10.48550/arXiv.2611.16060
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
18. 【2611.16053】Wayfinder: Adaptive Resource Routing from Agent Citations
链接：https://arxiv.org/abs/2611.16053
作者：Miguel Romero,George Karypis
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：issue trackers, act effectively, email and knowledge, knowledge bases, project meeting
备注： 20 pages, 3 figures, 10 tables. Accepted to NeurIPS 2026
点击查看摘要
Abstract:To act effectively, agents must gather contextual information across resources such as chats, issue trackers, email and knowledge bases, to answer questions like "what was decided in the last project meeting?" or "where is the FAQ for our internal tooling?" Where this information lives in a user's environment is unknown to the agent, so it re-explores the same resources across consecutive interactions. Common routing approaches represent each resource as a tool and rely on high-level descriptions to generalize to unseen environments. Such descriptions often fail to separate similar or overlapping resources and cannot improve from the agent's subsequent interactions. We introduce Wayfinder, an adaptive router that uses the documents cited by the downstream agent as feedback about where relevant information resides. These citations update Wayfinder's internal resource representations, which subsequent interactions use to prioritize the resources likely to contain relevant information. We also introduce resource augmentation during offline reinforcement learning, which anonymizes and permutes resource identities to discourage training-time overfitting of which resource holds which topic; our ablations suggest it helps most when few training environments are available. Because no openly available professional environments pair realistic queries with resource-access patterns, we construct and release three controlled testbeds derived from existing datasets: NFCorpus, FEVER and Tech Startup. Compared with supervised, tool-retrieval and contextual bandit baselines under a shared closed-loop protocol, Wayfinder gives the best routing when resources contain semantically overlapping content that static descriptions cannot distinguish, while description-based tool retrieval suffices when resources are drawn from distinct corpora.
19. 【2611.16000】Predicting the Needle in a Petabyte Scale Haystack: Open-Vocabulary Event Anticipation in Satellite Imagery
链接：https://arxiv.org/abs/2611.16000
作者：Shreelekha Revankar,Mikhail Klassen,Creon Levit,Ash Hoover,Kavita Bala,Bharath Hariharan
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：Earth daily, capturing the lifecycle, urban construction, deforestation to urban, Satellite constellations
备注： 29 pages, 9 figures, to be published in NeurIPS 2026
点击查看摘要
Abstract:Satellite constellations now image the Earth daily, capturing the lifecycle of events from deforestation to urban construction. Anticipating these events before completion enables timely intervention, yet existing systems cannot jointly identify where a change occurs, what it will become, and when it will finish across an open vocabulary. Building such a model requires diverse event data, but events are like needles in a haystack, making manual annotation at global scale infeasible. We address this problem by representing change as the vector difference between vision-language model embeddings at distinct time points. This arithmetic approach allows us to search for semantic transformations directly in the latent space, enabling (1) an automated data engine for global event discovery without manual annotation and (2) the largest global satellite event dataset to our knowledge, comprising 21,000+ locations across 64+ event types with ~2M images from PlanetScope and Sentinel-2 spanning six continents, to train (3) a novel global-scale event anticipation model. Our model detects change with a 93.5% max F1 score, outperforms baselines 3.6x on predicted event retrieval, and forecasts completion dates with a 3-day median error, even nine months before completion. Code: this https URL
20. 【2611.15904】HeriKGQA: Grounded Knowledge-Graph Question Answering over Cultural Heritage Sensor Data
链接：https://arxiv.org/abs/2611.15904
作者：Lingxiao Kong,Vasileios Arampatzakis,Vasileios Sevetlidis,George Pavlidis,Zeyd Boukhers
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR)
关键词：requires database expertise, Cultural heritage sites, data requires database, Large Language Models, Cultural heritage
备注： Submitted to NAACL 2027 industry track
点击查看摘要
Abstract:Cultural heritage sites are increasingly monitored by sensor networks, but querying their data requires database expertise. Large Language Models (LLMs) offer a natural-language interface, yet over raw sensor records they lose track of which sensor, site, and time each value belongs to, and silently miscompute. We present HeriKGQA, a knowledge-graph question-answering method that confines the LLM to interpreting questions and phrasing answers, leaving computation to SPARQL and deterministic code. Questions are parsed into intents constrained by a heritage ontology aligning W3C SOSA/SSN with CIDOC-CRM, compiled into SPARQL, and answered from query results and temporal, spatial, and anomaly facts derived by a grounding layer, with error correction guarding each LLM step. On 500 questions over real data from five heritage sites, HeriKGQA reaches 99.0% accuracy, 18.2 points above the strongest of three baselines using the same LLM and receiving the same anomaly rules and answer conventions, with comparable answer quality while running almost four times faster. Without grounding, accuracy drops by 12.2 points and on anomaly questions from 99% to 66%. We report lessons from development and live deployment.
21. 【2611.15798】Bag of concepts can enhance other text representations for medical systematic review screening
链接：https://arxiv.org/abs/2611.15798
作者：Radosław Pytlak,Paweł Cichosz,Bartłomiej Fajdek,Bogdan Jastrzębski
类目：Information Retrieval (cs.IR)
关键词：systematic literature review, semi-automated systematic literature, literature review, bag of concepts, SLR case studies
备注： 16 pages, 5 figures, 6 tables
点击查看摘要
Abstract:The paper examines the choice of text representation for semi-automated systematic literature review (SLR) systems based on active learning. Motivated by the insufficient attention that the bag of concepts representation has received so far, the paper discusses the implementation and experimental evaluation of several variations thereof. The experimental study was performed on medical SLR case studies, with results reported for random forest classification, cluster initialization and uncertainty sampling. The utility of bag of concepts features obtained using different ontologies is evaluated by applying them within the active learning framework to sequentially create classification models based on training data iteratively expanded with expert annotations. Systematic experiments compare BoW, BoC, PubMedBERT, Jina, Gemma and Qwen3 representations, together with combinations of BoC and each of the other representations. The evaluation uses workload savings and performance profiles adapted from optimization benchmarking. The results suggest that concept-based features can provide complementary information, with the BoC-augmented representations achieving higher mean workload savings on the DERP cases than their corresponding base representations. The Qwen3+BoC representation gives the best average performance in this comparison. The effects of augmentation vary across case studies and base representations. The paper also concentrates on the impact of ontology choice on document classification outcomes. In particular, the paper compares the predictive value of bag of concepts representations based on chosen ontologies with that of representations obtained using MedCAT with a UMLS-based dictionary.
22. 【2611.15597】When Local Definitions Are Missing: Stable Errors in Language Models
链接：https://arxiv.org/abs/2611.15597
作者：Zengqing Wu,Chuan Xiao
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：technical manuals, online communities, words special meanings, definition, special meanings
备注：
点击查看摘要
Abstract:Contracts, technical manuals, and online communities often give familiar words special meanings and define them in one place. A language model that reads a passage without that definition may use the usual meaning and give an answer that sounds right but is wrong. We study this with multiple-choice questions whose correct answers depend on a local definition. The questions come from a synthetic vocabulary, commercial contracts, Reddit community glossaries, and the documentation of a decentralized exchange. We ask three language models each question with and without the definition. Without using the answer key, we then test whether their repeated answers and stated confidence reveal their own errors. Separately, we give a small open model the answer key and test whether it can predict which questions larger models get wrong. We report three findings. (1) Familiar words that a source redefines cause the most errors. Models often repeat the same wrong answer, and neither repeated answers nor stated confidence reliably flag it. (2) The source definition fixes most errors on synthetic questions, but a definition drawn from the model's own prior knowledge does not. In real contracts, the source definition fixes only about half of the errors. (3) Given an answer key, a small model can rank questions by how likely larger models are to get them wrong. These results call for tests that check answers against the full source, including its local definitions.
23. 【2611.15445】ReAlign: Reward-Guided Preference Alignment for Generative Re-Ranking
链接：https://arxiv.org/abs/2611.15445
作者：YaChen Yan,Liubo Li
类目：Information Retrieval (cs.IR)
关键词：Re-ranking refines, upstream ranked list, maximize listwise user, listwise utility signal, listwise user utility
备注： 9 pages, 3 figures, ACM conference format
点击查看摘要
Abstract:Re-ranking refines the upstream ranked list to maximize listwise user utility. Existing two-stage generator-evaluator methods decouple list generation from list evaluation, leaving the generator without direct access to the listwise utility signal, while scoring-based one-stage methods score items under a fixed upstream permutation context without explicitly searching the permutation space. We propose \textbf{ReAlign}, a reward-guided preference alignment framework that couples a listwise reward model with a candidate-aware autoregressive generator. The reward model decomposes the listwise reward into position-wise contributions, modeling user exposure through a survival-based exposure module and item value through per-objective heads for heterogeneous engagement signals. The generator is trained in two stages: supervised pre-training on logged exposure lists to establish a relevance prior, followed by reward-guided post-training that aligns the generator with the reward model through complementary distribution and ranking alignment over within-pool standardized rewards. Extensive offline experiments show that ReAlign consistently outperforms existing state-of-the-art baselines.
24. 【2611.15434】SurvEval: Listwise Re-Ranking Evaluator via Survival-Based Exposure and Multi-Objective Value Modeling
链接：https://arxiv.org/abs/2611.15434
作者：YaChen Yan,Liubo Li
类目：Information Retrieval (cs.IR)
关键词：existing evaluators oversimplify, reflect true listwise, collapse multi-objective signals, evaluators oversimplify user, oversimplify user browsing
备注： 5 Pages, 3 figures, ACM conference format
点击查看摘要
Abstract:Re-ranking is a crucial stage in recommender systems, yet existing evaluators oversimplify user browsing assumptions and collapse multi-objective signals into a single scalar, limiting their ability to reflect true listwise utility. We propose \textbf{SurvEval}, a listwise evaluator that jointly models user exposure and item value for re-ranking evaluation. We formalize the sequential browsing process as a discrete-time survival model, deriving monotonically decreasing reaching probabilities that capture the cascading structure of user browsing. We further introduce a multi-objective value estimation module with dedicated per-objective prediction heads and uncertainty-based loss weighting to adaptively balance objectives of varying scales and noise levels. Both components are jointly optimized via a unified transformer backbone, and the listwise utility is obtained by summing the position-wise products of reaching probabilities and conditional item value estimates. Extensive experiments on KuaiRand and Avito demonstrate that SurvEval achieves superior performance over state-of-the-art baselines.
25. 【2611.15426】SimRec: Learning to Search, Ask, and Recommend from Simulated Interaction
链接：https://arxiv.org/abs/2611.15426
作者：Yaxin Zhang,Xingyu Wu,Yuchen Yan,Yuqin Dai,Hong Zhao,Lixing Shen,Zhan Chen,Jian Shao,Yongliang Shen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：inspect products, LLM-based recommendation agents, revise rejected recommendations, LLM-based recommendation, search catalogs
备注： 19 pages,5 figures,16 tables. Code: [this https URL](https://github.com/ZJU-REAL/SimRec)
点击查看摘要
Abstract:LLM-based recommendation agents can search catalogs, inspect products, ask users, and revise rejected recommendations. However, these behaviors are often governed by hand-designed workflows, while existing training methods optimize isolated components such as query rewriting or list ranking rather than the interaction policy as a whole. We present SimRec, a reinforcement learning framework that trains the full interaction policy of a tool-integrated recommendation agent. SimRec introduces two components. A task-anchored user simulator provides feedback on every recommendation: conditioned on the current task need rather than on user profile, and it can be an external LLM or the recommender itself under self-play. A task-aligned reward optimizes the whole trajectory with GRPO, crediting natural retrieval quality and valid tool use alongside the final hit, with training-only target injection to handle sparse hits over large catalogs. On ESCI and Amazon C4, SimRec improves the NDCG@100 of a Qwen3-4B agent from 32.23% to 35.42% and from 22.94% to 24.72%}, outperforming training-free agents on far larger backbones and task-aligned baselines on NDCG. Analysis shows that the trained agent verifies candidates, uses preferences, and recovers from rejected recommendations far more often than its untrained counterpart. Our code is available at this https URL .
26. 【2611.15417】When Direction Matters: Diagnosing Relational Instruction Following in Dense Retrieval
链接：https://arxiv.org/abs/2611.15417
作者：Zhanyu Wu,Richong Zhang
类目：Information Retrieval (cs.IR)
关键词：Dense retrievers increasingly, natural-language relevance criteria, retrievers increasingly claim, Dense retrievers, increasingly claim
备注：
点击查看摘要
Abstract:Dense retrievers increasingly claim the ability to condition retrieval on natural-language relevance criteria beyond a short query. We identify a specific weakness in this capability: the evaluated models perform well when lexical or attribute cues distinguish the target, but become much less reliable when relevance depends on a directional relation over the same entities. We introduce SwitchIR, a controlled diagnostic that contrasts Constraint Shift and Explicit Filtering with Relational Flip, where the query and document pair remain fixed while the requested relation direction reverses. Across representative embedding and late-interaction retrievers, the primary joint metric is high on the two cue-available controls and consistently low on Relational Flip; the same ordering persists in an LLM-assisted, manually reviewed realistic variant. An exact margin decomposition shows that both directions are correct only when the direction-sensitive query--document interaction exceeds the direction-invariant pair preference. Empirically, direction-sensitive changes are common, but their aligned interaction is usually too weak to overcome that preference. Diagnostic fine-tuning shows that models can learn relational behavior that generalizes across relation families, with stronger generalization in the larger model.
27. 【2611.15328】Vision-Grounded Semantic Learning and Alignment for Scalable Multilingual Text-Based Person Retrieval
链接：https://arxiv.org/abs/2611.15328
作者：Xinyu Zhou,Fan Li,Shasha Chen,Min Cao,Ahtamjan Ahmat,Qiaoming Zhu,Mang Ye
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Text-Based Person Retrieval, Multilingual Text-Based Person, Person Retrieval, Text-Based Person, aims to retrieve
备注： Accepted by ACM MM 2026 (Oral). 10 pages
点击查看摘要
Abstract:Multilingual Text-Based Person Retrieval (TBPR) aims to retrieve individuals with texts in multiple languages. Despite its practical importance, it has been overlooked by existing research, which mainly focuses on English-only retrieval. The only prior attempt at multilingual TBPR suffers from (1) the absence of a large-scale, multilingual pretraining dataset and (2) a suboptimal model architecture for multilingual text encoding and cross-modal alignment, which employs a shared encoder that overlooks linguistic heterogeneity and relies on English as a pivot for cross-modal alignment, introducing English-centric bias. For this, we contribute MultiPedes, the first large-scale, pedestrian-centric multilingual pretraining dataset. It contains 10 million image-text pairs across four languages, constructed by a multilingual quality-aware data construction pipeline. We also propose ViSeLA (Vision-grounded Semantic Learning and Alignment), a novel framework featuring: (1) a semantic-aware multilingual learning module that extends the mixture-of-experts architecture by routing language-invariant semantics to specialized experts for improved multilingual feature learning; and (2) a vision-grounded cross-modal alignment module that employs a semantic probe to capture fine-grained semantics across modalities, enabling direct cross-modal alignment without relying on a pivot language. Extensive experiments on both multilingual and English-only TBPR datasets demonstrate the effectiveness of ViSeLA. The dataset and code are available at this https URL
28. 【2611.15160】Measuring, Revealing and Mitigating Harmful Content Propagation in Recommender Systems
链接：https://arxiv.org/abs/2611.15160
作者：Xiaokun Zhang,Youlin Wu,Junyu Lu,Jiamin Chen,Zhaochun Ren,Hongfei Lin,Fenglong Ma,Xue Liu,Chen Ma
类目：Information Retrieval (cs.IR)
关键词：navigate vast amounts, users navigate vast, historical behaviors, navigate vast, vast amounts
备注： This work has been acceptted by IEEE TPAMI
点击查看摘要
Abstract:Recommender systems help users navigate vast amounts of information by filtering content according to their historical behaviors. As these systems increasingly shape everyday information access, they largely determine the content users are exposed to. However, current research typically prioritizes catering to user interest, while overlooking the existence and propagation of harmful content, such as violence, hate speech, and pornography. In this work, we take a systematic step toward investigating harmful content in recommender systems from three aspects: measuring, revealing, and mitigating. First, we construct datasets with harmfulness-related annotations and present new evaluation metrics to quantitatively measure the harmfulness of recommendation results. Second, our empirical analysis reveals that users tend to engage with harmful content and prevailing recommendation methods often contribute to the proliferation of such content. Third, to address this issue, we introduce a generic framework, MitiHarm, which integrates harmfulness-related signals into both item and user representation learning. Experiments show that MitiHarm can significantly mitigate the propagation of harmful content while preserving user satisfaction. Resources of this work are available at this https URL.
29. 【2611.14938】When Does a Recommendation Spark Curiosity? Theory, Measurement, and Field Evidence
链接：https://arxiv.org/abs/2611.14938
作者：Pan Li,Alexander Tuzhilin
类目：General Economics (econ.GN); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：sustains engagement, relevance-only recommendations, Curiosity, familiar content, bubbles of repetitive
备注：
点击查看摘要
Abstract:Curiosity, the drive to close the gap between what one knows and what one wants to know, pulls consumers beyond their familiar content, sustains engagement, and breaks them out of the filter bubbles of repetitive, relevance-only recommendations. Despite its importance, curiosity is hardly incorporated into modern recommender systems for lack of a formal measure. The information-gap theory of curiosity provides no formal quantitative model that a recommender system can operate on, and existing proxy metrics do not accurately measure the curiosity that a recommended item evokes. To fill this research gap, we formalize the information-gap theory into five axioms of curiosity and construct the canonical formulation of a computational measure of the curiosity that a recommended item evokes in a consumer. We validate our curiosity measure through a survey-based study, in which it matches consumers' self-reported curiosity and outperforms alternative proxy metrics. We subsequently build a curiosity-aware recommender system that incorporates this measure into the utility function design, and we show through offline experiments on three real-world datasets that it significantly outperforms the state-of-the-art methods. Furthermore, we conduct a large-scale online controlled experiment at a major video-streaming platform in Asia, where we show that our method significantly increases click-through rate, video views, and time spent over the latest production system, leading to tangible economic impact for the company. Our method has since been deployed on the platform and remains in operation. Our findings establish consumer curiosity as a measurable and actionable objective for recommender systems, with important managerial implications for digital platforms to recommend what consumers wonder about.
30. 【2611.14524】Stage-Resolved EBV-Induced B-Cell Programs Across CNS Selection and Multiple Sclerosis Compartments
链接：https://arxiv.org/abs/2611.14524
作者：Hasan Jamil,Alexander Gow
类目：Genomics (q-bio.GN); Databases (cs.DB); Information Retrieval (cs.IR)
关键词：CNS selection remains, selection remains uncertain, CNS selection, Epstein-Barr virus, experimental EBV infection
备注：
点击查看摘要
Abstract:Epstein-Barr virus (EBV) is implicated in multiple sclerosis (MS), but whether EBV-conditioned B cells retain stable transcriptional programs after CNS selection remains uncertain. We reanalyzed datasets spanning experimental EBV infection, CNS-homing B cells in humanized mice, early-MS blood, and paired human CSF and blood. A frozen EBV-induced B-cell factor (F12) was transferred without outcome-driven modification and evaluated using anatomical, sequencing-depth, metabolic, coherence-matched, lineage, and exposure controls. F12 did not predict MS activity (AUC=0.487; p=0.489) and was lower in CSF in nine evaluable participants (mean difference -0.0560; coherence-matched p=0.015). It also remained lower in brain than spleen in all five EBV-exposed mice after matched-depth rarefaction (p=0.0313) and coherence-matched calibration (p=0.0225). The splenic TBX21+CXCR3+ transcriptional gate did not reliably represent the state of anatomically selected brain B cells. An enriched 287-gene cross-system bridge lacked B-lineage and EBV-exposure specificity. In human CSF, an early EBV-associated program was depleted (-0.0492; p=0.0197), whereas latency-III and lymphoblastoid cell line-like programs increased (+0.0666; p=0.0092 and +0.0148; p=0.0096, respectively). Opposite early and late program directions persisted after removing shared genes. No external program met the prespecified prospective criterion. These findings support stage- and compartment-dependent remodeling of EBV-associated B-cell transcription rather than persistence of a stable RNA signature. They distinguish cellular trafficking from transcriptional-state preservation and show that cross-system molecular resemblance alone cannot establish ancestry. EBV-directed biomarker studies should integrate host transcription with virologic, clonotypic, antigen-specific, epigenetic, and longitudinal evidence.
计算机视觉
1. 【2611.17336】Back to Pixels: Lifting Latent Video Diffusion into Pixel Space
链接：https://arxiv.org/abs/2611.17336
作者：Yanke Song,Shuo Chen,Chris Rockwell,Guande He,Nan Liu,Desai Xie,Tianpei Gu,Yong-Hyun Park,Aryan V S,Dennis Yuren Menn,Ming-Hsuan Yang,Xun Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Frontier video generation, generation models work, Frontier video, Frontier, VAE latent space
备注： Project Page: [this https URL](https://chenshuo20.github.io/PixVid/)
点击查看摘要
Abstract:Frontier video generation models work in a VAE latent space that compresses video in both space and time. This compression made training tractable, but now limits high-resolution, controllable, and interactive generation -- doubling resolution quadruples token count, conditions apply to groups of frames rather than individual ones, and each response must wait for the rest of its multi-frame block. We present PixVid, a simple yet effective method that lifts a pretrained latent video model to directly generate every frame in pixel space. PixVid keeps the diffusion transformer and replaces the VAE decoder with a convolutional head that renders its outputs into pixels. We find that predicting clean video rather than velocity, together with a larger noise shift, is key to quality. Finetuned from Wan2.1-14B, PixVid is competitive with the latent baseline within $\sim 1.3$M training clips. Working framewise in pixels, it generates at $2\times$ higher resolution with the same per-frame token count, keeps depth-conditioned video editing aligned under fast motion, and responds to each action at the next frame. Project page: this https URL
2. 【2611.17334】Unbundling Multimodal Vision Encoding
链接：https://arxiv.org/abs/2611.17334
作者：Ellis Brown,Chris Hoang,Shengyi Qian,Shang-Wen Li,Mike Lewis,Marjan Ghazvininejad,Luke Zettlemoyer,Lucas Beyer,Mengye Ren,Jakob Verbeek,Saining Xie,Hu Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：encode visual input, visual input remains, input remains, vision, encoder
备注： Project page: [this https URL](https://unbundling.github.io)
点击查看摘要
Abstract:How multimodal language models should encode visual input remains up for debate. Most models use a pretrained vision encoder, while some recent recipes train the encoder from scratch with the language model or remove it entirely. Vision encoders bundle together three design choices: a visual prior from upstream pretraining, dedicated vision capacity, and pre-fusion placement of that capacity (i.e., before the multimodal backbone). Because published models also differ in data, architecture, and compute, comparing them cannot isolate the effect of each choice. We disentangle these choices via a controlled framework where we pretrain all models from scratch on common data and compare them on visual question answering and language benchmarks at matched lifetime compute. We find that the visual prior is not necessary; an encoder trained jointly from scratch is on par with a pretrained one, without a separate training stage. What matters instead is dedicated vision capacity: an encoder-free model trails on visual understanding even when its backbone is enlarged by the encoder's parameter count. Yet that capacity need not precede multimodal fusion, as vision-only modules added in-fusion to early backbone layers perform comparably to a pre-fusion encoder and can lower time to first token. These results also hold across backbone sizes, when encoder pretraining is treated as free, and when starting from a pretrained language model. Overall, our findings favor dedicated vision capacity trained jointly with the backbone and placed early within it.
3. 【2611.17331】B: Test-time Baking for Efficient Rendering of Decoder-only View Synthesis Models
链接：https://arxiv.org/abs/2611.17331
作者：Chin-Yang Lin,Ryo Hachiuma,Jaesung Choe,Min-Hung Chen,Yu-Chiang Frank Wang,Yen-Yu Lin,Wei-Chen Chiu,Yu-Lun Liu,Cheng Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Decoder-only Large View, View Synthesis Models, Large View Synthesis, Decoder-only Large, Synthesis Models
备注： NeurIPS 2026 (Spotlight). Project page: [this https URL](https://test-time-baking.github.io)
点击查看摘要
Abstract:Decoder-only Large View Synthesis Models (LVSMs) with KV-cache have recently achieved state-of-the-art quality by regressing novel views from neural networks without reconstructing 3D geometry, while Test-Time Training (TTT) layers save computation but sacrifice quality. We propose Test-Time Baking (TTB), a strategy that learns to bake global scene information from cross-view attention into a lightweight MLP, enabling fast and high-fidelity novel-view decoding. The first key is to repurpose the fast-weight MLP of TTT to learn the cross-view attention mapping explicitly from its input-output pairs, rather than replacing attention entirely, achieving the same rendering efficiency as TTT while delivering substantially higher quality. The second key addresses a modality misalignment between context prefilling and novel-view rendering: we disentangle context tokens into camera-only context rendering tokens to serve as TTB input, and context ground-truth tokens with image content to serve as the TTB mapping target, ensuring the baked MLPs are relieved of the modality generalization challenge between context and novel-view processing. Our method achieves up to **23x** rendering speedup with quality on par with the state-of-the-art across several benchmarks. Project page: this https URL
4. 【2611.17330】ProtoVis-Nav: Prototypical Visual Imagination for Visual-Spatial Aligned UAV Navigation
链接：https://arxiv.org/abs/2611.17330
作者：Guangyuan Sui,Yunzhong Hou,Chi Harold Liu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Unmanned Aerial Vehicles, Vision language navigation, Aerial Vehicles, Unmanned Aerial, challenging for Unmanned
备注：
点击查看摘要
Abstract:Vision language navigation (VLN) is very challenging for Unmanned Aerial Vehicles (UAVs) since small errors in 3D motion prediction can lead to navigation errors and collisions. Unable to fathom execution outcomes in 3D environments, existing methods often struggle to predict accurate navigation waypoints from language instructions. To solve this, we introduce the Prototypical Visual Imagination framework, shortened as ProtoVis-Nav, which forces the model to imagine an outcome-associated local visual representation for the intended next UAV movement. Specifically, we predict feature prototypes and use their linear combination to estimate the visual feature of the target region. In this manner, the VLN model first imagines the local visual representation of the next intended location, and then uses predicted prototypes as context for generating the final action, promoting alignment between visual context and waypoint outputs. Extensive experiments demonstrate the effectiveness of the ProtoVis-Nav framework and show substantial improvements over existing baselines.
5. 【2611.17324】K2V: Generative Keyframing For Physically Plausible Video Generation
链接：https://arxiv.org/abs/2611.17324
作者：Felix O'Mahony,Daniel Olmeda Reino,Roberto Cipolla,Ayush Tewari
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：textural qualities, generate samples, samples with high-quality, Video diffusion models, Video
备注：
点击查看摘要
Abstract:Video diffusion models are able to generate samples with high-quality appearance and textural qualities. However, content produced by these methods is known to exhibit significant physical errors. This is because, in a classical video generation setting, all physical reasoning must take place simultaneously and exclusively within the diffusion this http URL propose to resolve these issues by redistributing the task of physical reasoning onto a language model-backed keyframe generation module, which allows for explicit reasoning in language, and fine-grained control over the appearance of the video at important moments in the video. We then condition a video generation model with these keyframes, reducing the role of the diffusion model to the simpler task of interpolating between physically-correct intermediate states, rather than inferring an entire sequence with diffusion. Results demonstrate that our approach significantly outperforms existing approaches, achieving state-of-the-art performance on the Physics-IQ Verified benchmark and PhyGenBench.
6. 【2611.17321】BrickFlow: Connectivity-Guided Brick Reconstruction
链接：https://arxiv.org/abs/2611.17321
作者：Peter Kulits,Cordelia Schmid
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：set of LEGO, assembled object, LEGO parts, assemble the object, object
备注： NeurIPS 2026
点击查看摘要
Abstract:Given a set of LEGO parts and an image of an assembled object, our task is to infer the pose of each part to assemble the object. In contrast with traditional 3D reconstruction, doing so requires satisfying discrete physical constraints, which provide structure but render the problem combinatorial and highly sensitive to small pose errors. To learn a prior over how parts fit together, we train a set-conditioned SE(3) flow model on procedurally generated assemblies. We then finetune this model to inject image conditioning, using 1% as much data. However, while the learned flow captures global structure, it does not enforce connectivity. To address this, we introduce an analytic connectivity-field guidance to pull predictions toward connected assemblies at test time. Through this, we demonstrate improved build quality with model size, pretraining, and guidance. We make our models and data available for research purposes at this https URL
7. 【2611.17318】Spatial Foundry: A Multimodal Dataset for Spatial Intelligence
链接：https://arxiv.org/abs/2611.17318
作者：Ethan Lin,Yang Song
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：intelligence requires connecting, Spatial intelligence requires, requires connecting visual, connecting visual observations, intelligence requires
备注： Project Page: [this https URL](https://ranolabs.com/Blog/spatial-foundry)
点击查看摘要
Abstract:Spatial intelligence requires connecting visual observations to the geometry, objects, and persistent state of an environment. Images alone leave these relationships implicit, while disconnected annotations make it difficult to study appearance, camera motion, and scene changes under a common reference. We introduce Spatial Foundry, a collection of 5,280 furnished residential 3D scene configurations with editable assets and aligned visual, geometric, and temporal data. Its modalities include floor plans, perspective and panoramic RGB, metric depth, point clouds, meshes, instance-level 3D bounding boxes, and camera trajectories paired with video. Shared scene coordinates link observations across views and time; editable source scenes enable additional camera paths and controlled object changes. We describe the data representation and construction workflow, and discuss applications in floor-plan-conditioned 3D generation, geometric reconstruction, instance-level perception, camera-conditioned video generation, shared world modeling, and scene editing. Controlled camera and scene variations support spatial perception and world-model research. The public project page provides videos and an interactive colored point-cloud preview.
8. 【2611.17302】FLEX-LBP: Learning Local Binary Patterns with Exact Binary Inference for Texture Classification
链接：https://arxiv.org/abs/2611.17302
作者：Mohamed Alimoussa,Amal El Kaid
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Local Binary Patterns, Local Binary, Binary Patterns, medical imaging, industrial inspection
备注： 21 pages, 5 figures, 8 tables. Code: [this https URL](https://github.com/medalimoussa/FLEX-LBP)
点击查看摘要
Abstract:Local Binary Patterns (LBP) remain among the most widely used texture descriptors, from industrial inspection to medical imaging. Yet their radius, sampling angles, color transform and thresholds are fixed by hand for each dataset. We present FLEX-LBP, which learns these parameters by backpropagation while every forward pass computes exact binary codes and hard histogram counts. A straight-through estimator acts only in the backward pass, so the deployed descriptor is an interpretable hard-binary LBP with 90 learnable parameters and unchanged inference cost. In a controlled ablation on six color texture benchmarks, the component worth learning is dataset-dependent. One configuration, applied unchanged everywhere, learns the geometry and thresholds with the color transform frozen. It improves the nearest-neighbor accuracy of the identical fixed descriptor by 3.55 points on average over five seeds, significantly on five of six benchmarks and never significantly worse. With a linear discriminant readout, it gains 0.9 points; the fully learned descriptor gains 2.7 and has the highest mean. FLEX-LBP is more accurate than five classical LBP-family descriptors, PCANet and a neural LBP on five of six benchmarks. Its mean nearest-neighbor accuracy exceeds that of frozen ImageNet ResNet-50 features (23.5 million parameters). On the Kather colorectal cancer histology benchmark, the fully learned descriptor reaches 93.8%, significantly above the best classical descriptor (Completed LBP, 92.8%). The learned radii adapt in directions that recur across seeds. Noise drowns single-pixel comparisons and illuminant change flips inter-channel ones; median sampling or gray-world normalization restores 96-97%. The code is available as a drop-in PyTorch layer at this https URL.
9. 【2611.17298】Consistent Video-to-Video Translation via Explicit Correspondences
链接：https://arxiv.org/abs/2611.17298
作者：Gaurav Parmar,Zhengqi Li,Richard Zhang,Jun-Yan Zhu,Srinivasa Narasimhan,Eli Shechtman,Yotam Nitzan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：applications require real-time, applications require, maintaining long-range temporal, Interactive, long-range temporal consistency
备注： ECCV 2026. Project Website: [this https URL](https://www.cs.cmu.edu/~vid2vid-long/)
点击查看摘要
Abstract:Interactive video-to-video applications require real-time generation while maintaining long-range temporal consistency. However, recent methods achieve speed by restricting attention to a fixed-length causal window. This limits long-range consistency whenever relevant history falls outside the context window. To address this limitation, we introduce vid2vid-long, a correspondence-based approach grounded in a simple observation. Video-to-video translation provides an explicit cross-frame reference: the regions that match in the input video should match in the output video too. Concretely, we compute patch-level correspondences in the input, guiding retrieval of previously generated outputs in the corresponding regions, and condition the model on these patches through correspondence cross-attention. Our experiments demonstrate that vid2vid-long consistently improves long-range temporal consistency across recent video models while preserving generation quality and real-time performance.
10. 【2611.17240】Objects as Addresses: Instance Binding in Vision Transformer Attention
链接：https://arxiv.org/abs/2611.17240
作者：Khalil Sabri,Guillaume-Alexandre Bilodeau,Nicolas Saunier,Wassim Bouachir
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Humans naturally parse, naturally parse visual, parse visual scenes, capability cognitive science, cognitive science calls
备注：
点击查看摘要
Abstract:Humans naturally parse visual scenes into coherent individual objects rather than scattered features, a capability cognitive science calls object binding. While recent work shows that pretrained Vision Transformers (ViTs) intrinsically acquire this ability, how native self-attention computations mechanistically keep object instances separate remains unresolved. By studying this across eight pretrained ViTs, we found that instance separation is expressed more strongly in attention routing than in token content: selected query-key relations distinguish individual objects more reliably than value similarity or residual representations. Inside heads, patches belonging to one individual tend to read from a common image region, which we term their attention address. Visually distinct parts of one person share an address, whereas identical duplicated instances receive separate, movable addresses. These shared destinations arise in part because query interactions with the spatial structure of keys direct attention toward consistent regions for one object and elsewhere for another. In DINOv2 and most other backbones we tested, editing this query component at the selected head redirects its attention address toward another individual. Grouping patches by this query component separates same-category instances, reaching .615 FG-ARI versus .289 for the same clustering of final-layer features, which tend to merge them.
11. 【2611.17199】MALNISI-Infused Graph Construction and Weighted Contrastive Loss based GAT for Unsupervised Representation Learning in HSI
链接：https://arxiv.org/abs/2611.17199
作者：Soumi Sarkar,Subhadip Boral,Sarbani Palit,Ashish Ghosh
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：land utilization due, possess discriminating spectral, discriminating spectral characteristics, possess discriminating, characteristics with respect
备注：
点击查看摘要
Abstract:Hyperspectral images (HSI) possess discriminating spectral characteristics with respect to land utilization due to high-dimensional information. Recently, unsupervised representation learning using graph neural networks has unveiled these utilization-specific complex spectral relations. This article has three main contributions. First, it proposes an index, the Mean Absolute Local Neighborhood Inverse Spectral Index (MALNISI), which measures the similarity between two pixels based on their neighborhood information. The index is used to construct a weighted adjacency matrix, giving the HSI a graph structure. Second, it proposes an upgraded Graph Attention Network that learns compact latent representations of hyperspectral data from the constructed graph. In this network, an enhanced multi-head attention mechanism incorporates the MALNISI weights as an auxiliary feature to emphasize learned attention between neighboring pixels. To alleviate over-smoothing and preserve fine-grained spectral details, the architecture integrates residual connections, skip projections, and feature normalization, which together enhance representation capability, stabilize learning, and accelerate convergence. Third, it proposes a weighted contrastive loss function that incorporates neighborhood-aware MALNISI between connected pixels, encouraging strongly connected pixels in the high-dimensional space to remain close in the latent space, and weakly connected pixels to stay apart. The resulting discriminative low-dimensional embeddings are then clustered using spectral clustering. Experimental analysis on six benchmark HSI datasets demonstrates the efficiency and necessity of the three aforementioned contributions, and the comparative study highlights superior performance over fourteen state-of-the-art approaches.
12. 【2611.17194】DMD: Endpoint Distribution Matching for Few-Step Diffusion Distillation
链接：https://arxiv.org/abs/2611.17194
作者：Tong Zhao,Xianfang Zeng,Yucheng Han,Ruoyu Wang,Mingkun Lei,Gang Yu,Chi Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Distribution matching distillation, student final output, student final outputs, distilling diffusion models, score model tracks
备注： Code Link: see [this https URL](https://github.com/Westlake-AGI-Lab/eDMD)
点击查看摘要
Abstract:Distribution matching distillation (DMD) has emerged as a leading paradigm for distilling diffusion models into few-step students, where an auxiliary fake score model tracks the student's distribution and the discrepancy between the teacher and fake predictions drives the student toward the teacher. In multi-step distillation, although only the student's final output is delivered, existing methods train the fake model on intermediate states or across all denoising steps. Consequently, the student's update signal becomes entangled with intermediate distributions, which can distort the matching direction and remain nonzero even after the student's final outputs already match the teacher distribution. To resolve this mismatch, we propose Endpoint Distribution Matching Distillation (eDMD), which trains a single shared fake model exclusively on the student's final outputs and uses it to correct every denoising step. Our theoretical analysis proves that this endpoint reference guarantees that the distribution matching term vanishes if and only if the student's final output distribution matches the teacher's, regardless of intermediate distributions. Beyond the fake reference, we further strengthen teacher supervision through a precise teacher (PT) that replaces single-step guided predictions with short multi-step trajectories on the final noise interval, paired with a calibrated query density for intermediate steps. Experiments on SD3-Medium, FLUX.2-klein (4B and 9B), and Qwen-Image-2.1 demonstrate that eDMD consistently outperforms existing distribution matching methods for 4-step generation.
13. 【2611.17190】Consensus Capture in Reference-Based UAV Video Stabilization: A Benchmark on Dynamic Urban Scenes
链接：https://arxiv.org/abs/2611.17190
作者：Robert Fonod,Nikolas Geroliminis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reference-frame stabilization registers, Reference-frame stabilization, stabilization registers, object positions comparable, keeping object positions
备注： 50 pages, 17 figures, 24 tables. Code at [this https URL](https://github.com/rfonod/stabilo-benchmark) and data at [this https URL](https://doi.org/10.5281/zenodo.23623540) and [this https URL](https://doi.org/10.5281/zenodo.15050577)
点击查看摘要
Abstract:Reference-frame stabilization registers every frame of a hovering-drone video onto one reference frame, keeping object positions comparable. The registration pipelines it relies on are selected on feature-matching benchmarks in which only the camera moves. Over a busy intersection, vehicles moving together supply mutually consistent correspondences that can draw the robust homography estimate toward their motion: consensus capture, which inlier statistics cannot flag. A two-part benchmark measures it and the object masking meant to prevent it. A static protocol scores ten pipelines under exactly known homographies on 4K aerial frames, tuned on a site-disjoint split at a matched resolution and feature budget. A dynamic protocol scores them at an offline and a real-time budget on hovers selected from the video alone to span the amount and coherence of moving foreground, plus a stationary control. It measures background alignment, object position error and the share of a moving group's displacement an estimate follows, against a pseudo-ground-truth reference audited with manually annotated ground control points, which also score every candidate. On static scenes, tuned AKAZE, RootSIFT, SIFT and BRISK lead, retuning the matcher thresholds raises the mean average accuracy (mAA) by at most 0.0062, and masking costs less than 0.005. Unmasked ORB is captured on 28 of 304 real-time dynamic pairs and on 6 offline; its real-time captured estimates have a median corner error of 18.8 px yet typical inlier counts and ratios. Masking removes capture for every pipeline and leaves the leading pipelines unchanged. Code, data and results are released.
14. 【2611.17185】Neural Render Proxies for Interactive and Differentiable Lighting
链接：https://arxiv.org/abs/2611.17185
作者：Sergio Sancho,Alexander Rath,Marco Manzi,Pascal Chang,Amit H. Bermano,Derek Nowrouzezahrai,Markus Gross,Marios Papas
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：animation production pipeline, challenges artists tackle, production pipeline, animation production, challenges artists
备注： Accepted at Computer Graphics Forum (Proc. EGSR 2026)
点击查看摘要
Abstract:Within the CG animation production pipeline, the challenges artists tackle in Lighting can be immense. Even minor adjustments require re-rendering massive scenes with slow offline renderers; global illumination has to be sampled and complex shaders have to be evaluated, leading to iteration times of minutes to hours per frame. To accelerate this process, we introduce a novel neural render proxy (NRP) that enables differentiable relighting of static scenes with fixed camera and materials at interactive rates. Our main insight is the decoupling of traditional rendering into path sampling and emission computation. From a single, light-agnostic render pass, we collect light transport data in the form of path samples. This enables rapidly sampling lighting conditions on the fly, and training a scene-specific lightweight neural network that learns how light is transported from any scene location to any image pixel. This approach is compatible with non-differentiable production renderers, induces minimal memory requirements during inference, and scales only with resolution and the number of light sources and parameters, but independently of scene and appearance complexity. Our evaluation demonstrates interactive frame rates for relighting (~30-60 Hz) while closely approximating the visual fidelity of ground-truth path tracing. In addition, the differentiable NRP enables fast, gradient-based inverse workflows, allowing artists to efficiently solve for lighting parameters from intuitive image-space edits or generative targets.
15. 【2611.17176】Validation-Guided Prompt Selection for Differential Morphing Attack Detection
链接：https://arxiv.org/abs/2611.17176
作者：Raghavendra Ramachandra,Hailin Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Differential morphing attack, trusted live capture, Differential morphing, morphing attack detection, compares a trusted
备注： Accepted in WACV 2027 Workshops
点击查看摘要
Abstract:Differential morphing attack detection (D-MAD) compares a trusted live capture with a document image that may contain a facial morph. We investigate whether labelled validation data can improve a frozen-parameter vision-language evaluator through prompt selection rather than model fine-tuning. Version~1 generates 50 candidate prompts and selects the top-ranked instruction using a security-oriented loss that prioritises missed morph attacks (MACER) while accounting for bona fide classification errors (BSCER), response failures, parse failures, and decision inconsistency. Version~2 recursively revises prompts using aggregate validation feedback. On a subject-disjoint test set of 160 pairs spanning LMA, MIPGAN-2, and PIPE, the selected Version~1 prompt achieves a (19.17\%) morph attack classification error rate (MACER), with (0.00\%) observed bona fide sample classification error rate (BSCER), compared with (70.00\%) MACER for a controlled manual prompt. The paired (50.83) percentage-point difference has a (95\%) subject-bootstrap interval of ([43.33,58.33]). Recursive revision does not surpass the best Generation~0 validation loss; the reported revised descendant obtains (31.67\%) test MACER. All 23 attacks missed by Version~1 are landmark-based (LMA) morphs. Overall, the results show that prompt formulation can substantially influence frozen-parameter VLM-based D-MAD performance, while also highlighting the challenge of recursive prompt refinement under a compact 10-subject validation setting.
16. 【2611.17172】SpotDiff: A Plug-and-Play Framework for Zero-Shot Change Detection in Remote Sensing Imagery
链接：https://arxiv.org/abs/2611.17172
作者：Anit Upadhyaya,Ata Akbari Asanjan,Chaitanya Jalluri,Subash Yeggina,Jeremy Kravitz
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote sensing change, Remote sensing, pixel-level annotations, temporally aligned, imaging platforms
备注：
点击查看摘要
Abstract:Remote sensing change detection usually relies on large collections of temporally aligned, pixel-level annotations, which limits its scalability across regions, imaging platforms and application domains. Recent zero-shot approaches reduce the need for supervision, but they often localize fine-grained changes poorly because their features are coarse or inconsistent across time. We present SpotDiff, a training-free, plug-and-play framework for zero-shot change detection built by composing complementary vision foundation models. SpotDiff uses DINOv3 for semantically robust features, AnyUp to reconstruct them at pixel resolution, and SAM 3 for text-guided region-of-interest proposals, which an inference-time multi-scale strategy (SWIMS) makes reliable on small objects. Change is then measured by comparing the reconstructed features of the two dates inside the proposed regions, with no learnable components, fine-tuning or change labels. To our knowledge, SpotDiff is the first change detection method to use a universal feature upsampler, which alone adds 13.8 F1 over bilinear upsampling of the same features. On LEVIR-CD, SpotDiff reaches 82.46 F1, 2.06 points above the strongest prior training-free method, and on the multi-class SECOND benchmark it improves building change detection by 10.3 IoU and the six-class average by 2.2 IoU. Qualitative results on PlanetScope (3 m) and Sentinel-2 (10 m) imagery show that the same pipeline transfers across resolutions without modification. Our results indicate that composing modern foundation models is an effective route to scalable, label-free change detection.
17. 【2611.17163】UAV-Flow++: A Unified Suite for Benchmarking and Learning Language-Guided UAV Flight
链接：https://arxiv.org/abs/2611.17163
作者：Donglin Yang,Xiangyu Wang,Yantong Zhong,Wenhao Zheng,Zihan Ding,Yue Liao,Hongsheng Li,Ke Xu,Si Liu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Language-guided UAV navigation, long-horizon route planning, Language-guided UAV, leaving short-range, route planning
备注： 22 pages, 10 figures
点击查看摘要
Abstract:Language-guided UAV navigation has largely focused on long-horizon route planning, leaving short-range, object-relative flight maneuvers underexplored. To address this gap, we formulate Flying-on-a-Word (Flow), a task requiring a UAV to convert concise natural-language instruction, egocentric visual observation, and current state dynamics into continuous flight actions. Flow encompasses both primitive motion commands and complex object-interactive behaviors, assessing motion intent comprehension and spatial context grounding. To enable policy learning and closed-loop evaluation, we introduce UAV-Flow, a comprehensive dataset comprising 30,692 expert-piloted real-world trajectories across eight distinct motion categories, alongside 10,109 simulation trajectories in the UAV-Flow-Sim environment equipped with task-specific completion criteria. Furthermore, we develop FlowVLA, which undergoes imitation pretraining on mixed real-sim demonstrations and online post-training via Tail-Aware GRPO (TGRPO). By leveraging group reward distributions, TGRPO effectively reinforces high-reward action sequences. Evaluated on 273 held-out UAV-Flow-Sim episodes, pretrained FlowVLA achieves a mean success rate of 75.58%, outperforming the strongest baseline by 6.72 percentage points, which TGRPO post-training further elevates to 93.16% with superior sample efficiency. Physical UAV experiments demonstrate robust execution of object-relative commands in both indoor and outdoor real-world scenes. Together, Flow establishes a novel benchmark and learning framework for language-conditioned flight maneuvers.
18. 【2611.17146】HiVE-VQA: Hierarchical Interaction via Volumetric Embedding for Video Quality Assessment
链接：https://arxiv.org/abs/2611.17146
作者：Robbie Hamilton,Fan Zhang,David Bull
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：highly important challenge, video quality assessment, user-generated video content, robust no-reference video, no-reference video quality
备注： Accepted to WACV 2027, 11 pages, 3 figures, 6 tables
点击查看摘要
Abstract:The proliferation of user-generated video content has made accurate and robust no-reference video quality assessment (NR-VQA) a highly important challenge. Existing research increasingly relies on architecturally complex multi-branch pipelines or computationally intensive fine-tuning of single-branch backbones. In this paper, we investigate whether a single frozen video foundation model can serve as an effective NR-VQA backbone, and propose HiVE-VQA, the first framework (to our knowledge) to apply a JEPA-based video encoder to this task. HiVE-VQA extracts token grids from multiple depths of a pre-trained V-JEPA 2.1 encoder and stacks them into a hierarchical spatio-temporal volume, which a compact 3D convolutional head fuses across its layer, spatial, and temporal axes, combining low-level distortion cues from shallow layers with the semantic and temporal context captured at greater depths. The encoder remains frozen throughout, so only the head is trained: 5.2M parameters (5.7\% of the total), with no auxiliary multi-modal models and an inference cost that is invariant to video resolution. Trained solely on LSVQ and evaluated without any fine-tuning, HiVE-VQA outperforms 17 state-of-the-art (SOTA) methods in SROCC and PLCC on both intra-dataset (LSVQ-test, LSVQ-1080p) and cross-dataset (KoNViD-1k, LIVE-VQC) benchmarks. These results indicate that hierarchical, depth-wise fusion of features from a single frozen video foundation model provides a more effective and efficient basis for NR-VQA than task-specific multi-network fusion. Code and model checkpoints are available at this https URL.
19. 【2611.17126】STeP-C: Real-Time Neural Compression for Distributed Fiber-Optic Sensing at Scale
链接：https://arxiv.org/abs/2611.17126
作者：Tingfeng Li,Ming-Fang Huang,Shaobo Han,Yue Tian
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Distributed Acoustic Sensing, Distributed fiber-optic sensing, Distributed Acoustic, creating severe challenges, Distributed fiber-optic
备注： Accepted to WACV 2027 (Applications Track). 10 pages, 9 figures, 3 tables
点击查看摘要
Abstract:Distributed fiber-optic sensing (DFOS) technologies such as Distributed Acoustic Sensing (DAS) generate continuous, high-resolution spatio-temporal data at rates exceeding hundreds of megabytes per second, creating severe challenges for real-time storage and transmission. While neural compression methods can achieve strong rate-distortion performance on sensing data, prior approaches either require per-segment retraining incompatible with streaming, or have only been validated offline. None have been demonstrated end-to-end on a continuously streaming DAS acquisition system at scale. We present STeP-C (Spatio-Temporal Predictive Compression), a neural compression framework that decouples spatial encoding, temporal prediction, and entropy-optimized residual coding, trained end-to-end with a rate-distortion objective motivated by conditional entropy reduction. Critically, we identify entropy coding as the dominant bottleneck for streaming deployment. We address it through GPU-side symbol computation, cached probability tables, and parallel GIL-free arithmetic coding, together with FP16 inference and batched entropy coding, enabling a full real-time pipeline built around a GPU ring buffer. We validate this pipeline on a live DAS testbed, achieving a 98.85% file size reduction at 31.04 dB full-band PSNR and an average throughput of 535 MB/s, exceeding the 324 MB/s requirement for 1 kHz, 81 km DAS streams. We further show that STeP-C substantially outperforms conventional codecs at practical streaming bitrates, can be applied to unseen channel ranges within the same acquisition system without retraining, and largely maintains downstream detector consistency, with 96.62% high-confidence class agreement and 100% Jaccard similarity on detected event types.
20. 【2611.17105】Predicting Ethanol Drinking Status from Nonhuman Primate Liver Histology: A Proof of Concept for Parameter-efficient Fine-tuning in Few-Shot Vision-Language Modeling
链接：https://arxiv.org/abs/2611.17105
作者：Amirmohammad Mohammadi,Rupak Khadka,Kathleen A. Grant,Mary Lauren Benton,Joshua Peeples
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Combining vision-language models, few-shot whole-slide image, Combining vision-language, Tissue Research Resource, vision-language models
备注： 3 pages, 2 figures. Accepted for publication in the proceedings of IEEE BIBM 2026. The code is publicly available: [this https URL](https://github.com/Advanced-Vision-and-Learning-Lab/ALD_VLM)
点击查看摘要
Abstract:Combining vision-language models (VLMs) with parameter-efficient fine-tuning (PEFT) offers a promising approach to few-shot whole-slide image (WSI) classification in computational pathology. This study evaluates this approach for predicting ethanol drinking status from nonhuman primate liver histology. Adapters are evaluated against non-PEFT configurations on a subset of the Monkey Alcohol Tissue Research Resource (MATRR). All evaluated PEFT configurations achieve higher mean balanced accuracy than the non-PEFT baselines. For example, in the four-shot setting, attention-based multiple instance learning (ABMIL) alone achieves 43.5% mean balanced accuracy, compared with 78.1% after adding an adapter. Qualitative attention analysis shows that textual pathway adaptations produce localized attention heatmaps, while visual pathway adaptations produce more diffuse ones. A pathologist's review identified similar histological features across adaptations.
21. 【2611.17104】uMAP: A Dual-View, Morphotype-Aware Pathomics Pipeline for Quantifying Renal Tubular Remodeling
链接：https://arxiv.org/abs/2611.17104
作者：Ruijie Wu,Yuechen Yang,Yanfan Zhu,Yu Wang,Shilin Zhao,Ming-Tsun Tsai,Szu-Yuan Li,Shuo-Ming Ou,Tz-Heng Chen,Haichun Yang,Yuankai Huo
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：Quantifying disease-associated renal, Quantifying disease-associated, disease-associated renal tubular, renal tubular remodeling, appearances are heterogeneous
备注： 5 pages, 3 figures, 1 table. Submitted to IEEE ISBI 2027
点击查看摘要
Abstract:Quantifying disease-associated renal tubular remodeling is challenging because tubular appearances are heterogeneous. We introduce TuMAP (Tubular Morphotype-Aware Pathomics), a pipeline combining (1) dual-view foundation-model representations and provisional morphotype annotation, (2) compositional and within-morphotype pathomics, and (3) patient-level statistical inference. From 456,158 tubules in 358 PAS-stained kidney biopsy slides, TuMAP identified eight image-based morphotypes, seven of which showed stable subsampling assignments. Across 219 patients in six diagnostic groups, diabetic nephropathy (DN) and tubulointerstitial nephritis/acute tubular injury (TIN/ATI) each differed from minimal change disease in seven morphotype proportions, while IgA nephropathy differed in six. DN showed reduced nuclear solidity and increased eccentricity across all eight morphotypes. Area-normalized nuclear density exposed additional within-morphotype differences. TuMAP provides a framework for separating changes in tubular morphotype composition from phenotypic differences within morphotypes.
22. 【2611.17103】Joint Null-Space Projection for Data-Free Model Merging
链接：https://arxiv.org/abs/2611.17103
作者：Tian Xia
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：multi-task model requires, single multi-task model, Merging independently fine-tuned, requires no data, gradient steps
备注：
点击查看摘要
Abstract:Merging independently fine-tuned checkpoints into a single multi-task model requires no data, no labels, and no gradient steps. In practice the task vectors of different tasks interfere, and the standard remedies--averaging, magnitude pruning, sign election--operate entry by entry, ignoring that each delta induces a low-dimensional update on the hidden features it acts upon. We recast merging as a subspace interference problem. For every two-dimensional weight tensor we take the top-r right-singular subspace of each task's delta--the input directions along which that task moves the representation most--and remove from each task vector the component lying in the union of the other tasks' subspaces. The resulting Joint Null-Space Projection (JNSP) is closed-form and order-independent, needs no forward pass, and is defined entirely by the checkpoint set. On eight CLIP image-classification tasks JNSP merges ViT-B/16 experts to 89.45% average accuracy without using a single image, 11.88 points above the strongest parameter-wise training-free baseline (TIES-Merging, 77.57%), 14.22 above Task Arithmetic, and 0.98 above WUDI's data-free consensus merge (88.47%). The gain holds across three backbones on the independently trained TALL release (+10.8, +12.6, +9.1 over TIES for ViT-B/16, ViT-B/32, ViT-L/14) and replicates there at 89.20%; controls confirm the source--a single shared subspace instead of per-task ones loses 2.9 points, and a sequential variant collapses to 69.6%. On RoBERTa-large the same projection underperforms plain task arithmetic, which we report rather than hide. Code is available at this https URL.
23. 【2611.17077】SALT: State-Aligned Low-Rank Transfer for Single-Temporal Cross-Dataset Structural Localization in Remote Sensing
链接：https://arxiv.org/abs/2611.17077
作者：Aggelos Psiris,Georgios Angelidis,Giorgos Sfikas,Maria Vakalopoulou,Thomas Lagkas,Panagiotis Sarigiannidis,Georgios Th. Papadopoulos
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remote sensing conventionally, sensing conventionally relies, spatially aligned bi-temporal, aligned bi-temporal imagery, practical scenarios
备注： Accepted at the Third Workshop on Computer Vision for Geospatial Image Analysis (GeoCV), IEEE/CVF WACV 2027
点击查看摘要
Abstract:Change detection in remote sensing conventionally relies on spatially aligned bi-temporal imagery, which may be unavailable or unreliable in practical scenarios. Recent single-temporal approaches address this limitation by learning structural evidence, such as building regions, from a labeled source dataset and transferring it to unseen target imagery using only the current image. However, adaptation to the source dataset can over-specialize pretrained features and reduce their cross-dataset generalization, a risk that this paper argues is higher when the feature adaptation is parameterized independently of the states used for prediction. To address this issue, the current study introduces SALT, a State-Aligned Low-Rank Transfer framework. SALT keeps a DINOv3 backbone frozen and learns negative and positive structural states that both score each patch and, through State-Aligned Low-Rank Adaptation (SALA), span the rank-2 subspace in which patch features are corrected. Directional State Alignment supervises these corrections to raise the evidence of positive patches and lower that of negative ones, while Geometry Preservation limits changes to the pairwise relations among pretrained patch features. Experiments on LEVIR-CD and the WHU aerial building dataset show that, at the pixel level and in both transfer directions, SALT outperforms four baselines reproduced under a common source-only protocol, improving over the strongest reproduced baselines by 9.45 and 5.79 points in pixel-level AP and by 27.69 and 14.25 points in IoU (LEVIR-CD to WHU and WHU to LEVIR-CD, respectively), with only 0.068M trainable parameters and 40.2 ms per image. In order to facilitate reproducibility and further research, the source code of SALT is available at this https URL
24. 【2611.17060】Ropedia Xperience 2: A Gold Standard for Scaling Physical AI Environments and Behaviors
链接：https://arxiv.org/abs/2611.17060
作者：Hao Li,Fangzhou Hong,Zhaoxi Chen,Hui En Pang,Kairui Hu,Mingze Sun,Runmao Yao,Xinhao Ji,Xiyuan Zheng,Xuanli Chen,Yalun Dai,Yap Kim Hui,Dingwen Zhang,Yuanyuan Gao,Ziang Cao,Cheng Huang Yean,Jackson Peng,Rui Duan,Yaobo Liu,Zetong Wang,Ziwei Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Astra and Claude, Claude Fable, Large foundation models, control robots directly, visual observations
备注： [this https URL](https://ropedia.com/xperience/2-research)
点击查看摘要
Abstract:Large foundation models such as GPT-6 Astra and Claude Fable 5.1 have recently been shown to control robots directly from visual observations. They nevertheless remain brittle on long-horizon, contact-rich tasks in real-world environments. Further progress depends on two complementary resources: demonstrations of human behavior that supervise how tasks are performed, and interactive environments in which policies can be rolled out, evaluated, and improved in closed loop. Language models have advanced along well-characterized scaling laws; the corresponding question for physical AI is how capability scales with environments and behaviors, which first requires identifying which data to scale and how to produce and reuse such data continuously. To address this question, we introduce Ropedia Xperience 2, comprising 1,589 released metric-scale 3D scans and a collection of 4,230 egocentric recordings of 74 tasks (131 hours). We further show that each capture can be repurposed for robot learning: scenes are converted into physically interactive simulation environments, human motion is retargeted to whole-body robot trajectories, and additional robot behaviors are obtained through virtual teleoperation and automated long-horizon trajectory generation. We propose this joint capture of environments and behaviors as a gold standard for physical AI data collection, laying a data foundation for establishing scaling laws over environments and behaviors.
25. 【2611.17048】AURA 2.0: From User-Driven Responses to Model-Initiated Conversations in Streaming Video
链接：https://arxiv.org/abs/2611.17048
作者：Shuhan Li,Huankang Guan,Xintong Guo,Yang Bo,Yuyang He,Dunyuan Xu,Jingyan Chen,Fang Liu,Tsz Kin Wan,Jinpeng Chen,Zhenqi He,Yuxuan Hu,Wenbo Li,Han Gao,Qijun Li,Long Chen,Hongsheng Li,Rui Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：offer meaningful opportunities, stream offer meaningful, remaining silent, assistants respond, offer meaningful
备注：
点击查看摘要
Abstract:Most AI assistants respond only when prompted, remaining silent even when events in the video stream offer meaningful opportunities for conversation. To move beyond purely user-driven interaction, we present AURA 2.0, a streaming video large language model that introduces three core upgrades to AURA. The key advance is Model-Initiated Conversation (MIC), which enables the model to identify topics worth discussing in the evolving visual stream and initiate conversations at appropriate moments without a user query. Stream-Aware Tool Calling (SATC) enables the model to invoke external tools using the current visual and conversational context and incorporate returned information into the ongoing interaction. Interactive Visual Grounding (IVG) supports visual grounding in both user inputs and model outputs. The model can identify objects marked by users on video frames and produce frame-aligned bounding boxes to link its responses to specific objects and regions. To develop these capabilities, we construct a dedicated streaming interaction dataset and adopt a three-stage training scheme to integrate the new behaviors with AURA's existing streaming interaction abilities. We further incorporate Long-Horizon Interaction Memory (LHIM) to maintain contextual continuity over extended video streams. Evaluations on public streaming benchmarks show that AURA 2.0 achieves leading performance among open-source streaming models, while targeted evaluations further validate its new interaction capabilities. We open-source the model weights and inference code.
26. 【2611.16984】ElasticDino: Dense Semantic Features Using Elastic Deformations
链接：https://arxiv.org/abs/2611.16984
作者：Ulysse Mizrahi,Sean Zaretzky,Dov Danon,Amit H. Bermano
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：self-attention severely limits, countless vision tasks, severely limits feature, limits feature resolution, Vision transformers
备注：
点击查看摘要
Abstract:Vision transformers (ViTs) serve as the backbone for countless vision tasks, including dense prediction tasks, such as segmentation and depth estimation, even though the quadratic complexity of self-attention severely limits feature resolution and induces spatial artifacts. In this work, we introduce ElasticDino, a lightweight adapter which produces high-resolution feature maps, adhering to the fine details of the input image. As a key insight, we observe the consistency of artifacts across channels, and simultaneously resolve them to match the input image structure. Using a slim architecture based on spatial deformations, ElasticDino produces pixel-aligned, high-resolution feature maps efficiently. Leveraging deformations allows strictly preserving sharp semantics, and thereby avoiding the smoothness biases inherent to alternative approaches. Due to the absence of ground truth, we employ pixel-level semantic segmentation and depth estimation with linear heads to predict a set of downstream dense tasks, guiding the deformation process without leaking task-specific semantics into the model. We demonstrate superior accuracy over current methods on a range of popular dense task benchmarks, with better computational performance.
27. 【2611.16955】A Disease-specific Retinal Aging Biomarker for Predicting Progression to Late Age-related Macular Degeneration
链接：https://arxiv.org/abs/2611.16955
作者：Hexin Dong,Benjamin Hou,Puzhen Wu,Mingquan Lin,Emily Y. Chew,Zhiyong Lu,Yifan Peng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：irreversible vision loss, Age-related macular degeneration, AMD risk, AMD risk stratification, AMD
备注： 41 pages, 13 figures (including supplementary material)
点击查看摘要
Abstract:Age-related macular degeneration (AMD) is a leading cause of irreversible vision loss in older adults. While chronological age is a primary risk factor, it inadequately reflects individual variations in retinal aging, limiting effective AMD risk stratification and timely intervention. Here, we propose and validate fundus-based AMD age (FAA), which quantifies disease-specific retinal aging in AMD and captures accelerated AMD-related retinal aging, thereby improving prognostic precision over chronological age. Trained on 36,782 images from 2,192 participants in the Age-Related Eye Disease Study (AREDS) dataset and validated across AREDS and AREDS2 cohorts, our model demonstrates significant improvements over traditional chronological age-based approaches. Specifically, integrating the proposed FAA into Cox proportional-hazards models significantly enhances prediction performance. FAA improved the C-index from 0.836 to 0.888 and reduced the 5-year Brier score from 0.050 to 0.046 in AREDS, with consistent gains observed in AREDS2 (C-index 0.715 to 0.756; 2-year Brier 0.078 to 0.076). FAA showed improved prognostic performance across the two datasets and under different phenotype definitions (reading center-defined vs. specialist-defined grading), supporting its potential utility for AMD risk stratification. These findings highlight the advantage of incorporating FAA into AMD risk prediction frameworks, supporting further evaluation of FAA for AMD risk stratification.
28. 【2611.16925】Report of the 8th LSVOS Challenge: Mobile Unified Multimodal Understanding
链接：https://arxiv.org/abs/2611.16925
作者：Chang Liu,Henghui Ding,Tong Yang,Dayoung Kil,Seong-heum Kim,Qilin Xiang,Ronghao Zheng,Ziyang Zhang,Shanlin Jiang,Ruohan Shi,Qilin Fan,Chengfeng Qiu,Kaifeng Wei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large-scale Video Object, Unified Multimodal Understanding, Video Object Segmentation, Mobile Unified Multimodal, Multimodal Understanding
备注： 13 pages, 3 figures, 3 tables. Report of the MUMU track of the 8th LSVOS Challenge, held in conjunction with ECCV 2026. Project page: [this https URL](https://lsvos.github.io/mumu)
点击查看摘要
Abstract:This report summarizes the Mobile Unified Multimodal Understanding (MUMU) track of the 8th Large-scale Video Object Segmentation (LSVOS) Challenge, held in conjunction with ECCV 2026. MUMU asks for a single unified model that jointly performs multi-concept image tagging over quality, scene, and event vocabularies, open-vocabulary object detection, and concise image captioning, within a budget of 0.5B parameters and 8 GB of peak inference memory. Submissions are ranked by a weighted task score scaled by an efficiency factor. We describe the tasks, rules, and evaluation protocol, report the final results, and review the methods of the top three teams. All three leading solutions build on the compact Florence-2-base model, but extend it in different ways: lightweight tagging heads with cross-task inference refinement, a shared low-rank adapter trained on coverage-aware multi-source data with task-dependent decoding, and a training-free pipeline that maps captions to tags and applies detection test-time augmentation. The results show that a compact prompt-based vision-language model can serve all three outputs when supervision, decoding, and cross-task cues are designed for each task, while open-vocabulary detection on novel categories remains the main bottleneck.
29. 【2611.16907】Automated PD-L1 Tumor Proportion Scoring with Uncertainty-Guided Triage in Non-Small Cell Lung Cancer
链接：https://arxiv.org/abs/2611.16907
作者：Kesi Xu,Ayesha Azam,Tanvier Kaur,Monika Kondratowicz,Kinza Asim,Brinder Chohan,Paapa Appiah-Odame,Zhao Chen,David Snead,Nasir Rajpoot
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：informs immunotherapy selection, Programmed death-ligand, cell lung cancer, non-small cell lung, informs immunotherapy
备注： 55 pages (29-page main text with 5 figures and 3 tables, followed by 26 pages of supplementary material)
点击查看摘要
Abstract:Programmed death-ligand 1 (PD-L1) tumor proportion score (TPS) informs immunotherapy selection in non-small cell lung cancer. Near the 1% and 50% cutoffs, the score should also indicate when closer review is warranted. We designed a three-stage framework to follow the sequence of TPS assessment. Stage 1 identifies tumor regions and excludes macrophage-rich patches. Stage 2, a dual-branch cell counting network (D2Count-Net), counts PD-L1-positive and PD-L1-negative tumor cells in these regions to calculate TPS. Stage 3, TPS-Guard, an uncertainty-guided triage mechanism, reports model uncertainty as the disagreement among independently trained models, refers the most uncertain slides, and flags scores near the 1% or 50% cutoff when model estimates disagree across that cutoff. Flags state the reason for referral or alert the pathologist to possible scoring errors on auto-reported slides. In a retrospective, single-center study, 154 whole-slide images were scored by three pathologists, and the model and each pathologist were compared in turn with the mean of the other two. On the 114 slides unseen in training, model mean absolute error (MAE) was 6.96 percentage points, within the range of the three pathologists (4.24 to 8.29), and model uncertainty correlated with absolute TPS error (Spearman rho = 0.77) and inter-pathologist disagreement (rho = 0.71). After referral of the 15% most uncertain slides, model and pathologist MAE both decreased. Applied without retraining to an external, publicly available dataset, TPS-Guard still directed review to higher-error cases, and referring more uncertain cases raised sensitivity at the 50% cutoff. TPS-Guard provides reasons for reviewing individual automated scores and identifies slides that also produce greater disagreement among pathologists. Prospective reader studies should assess TPS-Guard's effect on TPS reporting.
30. 【2611.16897】okenStream: Multi-Subject Personalized Video Generation with Token-wise LoRA and Guided Attention
链接：https://arxiv.org/abs/2611.16897
作者：Hung Nguyen,Quang Qui-Vinh Nguyen,Khoi Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reference-video training dataset, composes independently learned, independently learned subject, learned subject identities, optimization-based framework
备注： Accepted to WACV 2027
点击查看摘要
Abstract:We introduce TokenStream, an optimization-based framework that composes independently learned subject identities in text-to-video generation without a reference-video training dataset or joint optimization of each new subject combination. Learning from a single reference image makes subject appearance difficult to separate from static-image bias, while merging independently trained adapters can mix identities. Token-wise LoRA (ToRA) restricts low-rank updates to the cross-attention value projections of subject-associated text tokens, providing a separate adaptation path for each subject. A T2V-guided stream copies queries and keys from the frozen base model during early denoising to reuse its layout and motion priors while retaining personalized values. We also introduce Multi-DB, a 30-subject, 122-prompt benchmark with appearance-free prompts and varied interactions. On Multi-DB at 1.3B, TokenStream improves identity preservation from 0.422 for DreamBooth to 0.467 and textual alignment from 0.652 to 0.688.
31. 【2611.16869】Raysemble: Metric 3D Bone Reconstruction from a Single X-ray
链接：https://arxiv.org/abs/2611.16869
作者：Xiaoyang Li,Xinghao Yan,Yuan Chai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Raysemble reconstructs, single X-ray, X-ray by separating, reconstructs eight lumbar, lumbar and pelvic
备注：
点击查看摘要
Abstract:Raysemble reconstructs eight lumbar and pelvic bones from a single X-ray by separating shape and placement. Each 3D query samples regional and global features at its image projection. A shared decoder predicts normalized bone shapes. Predicted depth and camera geometry determine 3D centers and scales for resampling these shapes onto a common grid in millimeters. Evaluation uses 23 held-out patients with 43 CT scans, each generating one simulated anteroposterior radiograph. Without rigid alignment to CT,Raysemble leads 15 evaluated methods, averaging 65.24% Dice, 9.09 mm HD95, and 3.32 mm ASSD over three random seeds. With identical inputs, it improves Dice over VolumeNeRF by 5.86 percentage points.
32. 【2611.16861】Visual Cipher Bench: Benchmarking LLM Agents on Long-Horizon Visual Reasoning
链接：https://arxiv.org/abs/2611.16861
作者：Deyao Hong,Jiayi Jiang,Yuchun Chen,Yixuan Shi,Wenyi Li,Zheng Jiang,Chengxing Xie,Mingyu Su,Qingle Liu,Mingju Gao,Yizhe Chi,Youjie Zheng,Calvin Xiao,Kaisen Yang,Huan-ang Gao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：explicit text specifications, language-model agents excel, Visual Cipher Bench, coding and terminal, success relies
备注：
点击查看摘要
Abstract:While language-model agents excel at long-horizon coding and terminal tasks, this success relies on two conditions: explicit text specifications and immediate execution feedback. However, neither condition holds in real-world problems where critical information exists only in images, leaving it unclear whether long-horizon capability transfers from text to visual reasoning. In such visual settings, because rules and clues resist text transcription and lack test-case feedback, agents must repeatedly inspect images, simulate spatial transformations, and autonomously cross-check clues. Despite this challenge, existing evaluations fail to capture such capability: visual reasoning benchmarks largely reduce tasks to single-turn, short-chain question answering, whereas agent benchmarks focus on text-based environments or interactive states that permit trial-and-error. To bridge this gap, we introduce Visual Cipher Bench, a collection of 40 original visual puzzles across four categories: spatial manipulation and simulation, logical constraints and planning, rule induction, and knowledge-based decoding. Each puzzle provides only one to three black-and-white line drawings and a minimal submission instruction, requiring agents to discover the underlying solving mechanism entirely from the images. Across 29 reasoning-effort configurations of eight frontier models, even the strongest model, GPT-6 Astra (max), achieves only 26.7% accuracy, while five of the eight models score below 1%. Yet on a ten-task subset, providing a single non-spoiler mechanism hint boosts accuracy from 7.8% to 55.6%. This sharp contrast shows that the primary bottleneck of current agents lies not in executing multi-step plans, but in autonomously discovering rules from visual evidence. Visual Cipher Bench thus provides a rigorous benchmark for measuring long-horizon visual reasoning in agents.
33. 【2611.16840】Kosmo-GFM: A Production-Ready Geometry Foundation Model
链接：https://arxiv.org/abs/2611.16840
作者：Sheng Tang,Shengzhe Wei,Tiancheng Chen,Wenhua Jin,Xinyang Lu,Tinghao Jiang,Shuoxuan Feng,Yupeng Liu,Yu Zhang,Xingshuo Chang,Keren Zhou,Yuhan Xiong,Jiahao Li,Haoming Liu,Jituo Tian,Hui Liang,Chaoqun Tang,Feng Tian,Wentao Ouyang,Kaojin Zhu,Xiaolin Chai,Peihuang Fu,Miao Zheng,Yunbo Hu,Feixue Cai,Zizhen Zou,Weigang Wang,Yexuan Yang,Haoyu Feng,Weiqi Zhang,Juntong Fang,Zesong Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pose optimization engine, present Kosmo-GFM, geometry foundation model, GFM, GFM predicts camera
备注： Project page: [this https URL](https://kosmoresearch.github.io/Kosmo-GFM/)
点击查看摘要
Abstract:We present Kosmo-GFM, a scene reconstruction system that integrates a geometry foundation model (GFM), a pose optimization engine (PoseEngine), and reconstruction-derived supervision from KosmoWorld. GFM predicts camera parameters, depth, cross-view correspondences, and dynamic 3D points from images and videos. PoseEngine combines these predictions with geometric optimization to recover scene-level camera poses and geometry for downstream 3D and 4D Gaussian Splatting. KosmoWorld generates images and geometric supervision from reconstructed real-world scenes to improve GFM's geometric predictions. On the Sparse and Medium subsets of SpatialBench, GFM achieves the lowest absolute relative depth error and the highest relative-pose AUC at 5 degrees among the compared methods. It also achieves the lowest mean endpoint errors for dynamic points and scene flow across the five evaluated datasets. Across 34 scenes completed by all compared reconstruction systems, PoseEngine achieves the highest scene-averaged pose AUC at thresholds of 1, 3, and 5 degrees, with a cumulative runtime of 14.07 hours, approximately 20% of GLUEMAP's 69.67 hours. PoseEngine Flash provides a further accuracy-efficiency trade-off, with a measured mixed-precision runtime of 2.62 hours, approximately 4% of GLUEMAP's runtime. Separate scaling experiments show generally favorable trends with increased data, model computation, and training budgets. These results support the use of learned geometric priors within a scene-level reconstruction pipeline.
34. 【2611.16793】EG360: Efficient and Generalizable $360^\circ$ Depth Estimation via Adaptive Panorama-Perspective Distillation and Spherical Cross-Level Feature Fusion
链接：https://arxiv.org/abs/2611.16793
作者：Laiyan Ding,Chongxi Meng,Rui Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：witnessed great advances, Generalized panorama depth, Generalized panorama, recent years, witnessed great
备注：
点击查看摘要
Abstract:Generalized panorama depth estimation has witnessed great advances in recent years. These methods typically achieve robust zero-shot generalization performance using large pretrained models, but their high computational cost makes real-time inference on embedded platforms challenging. In contrast, previous lightweight panorama models have mostly been developed for single-domain evaluations and cannot generalize well due to domain shifts. To reduce the gap between these two types of models, we introduce EG360, an efficient and generalizable panorama depth estimation model. Specifically, building on a lightweight depth model, we design an Adaptive Panorama-Perspective Distillation (APPD) strategy guided by scene geometry, along with a Spherical Cross-Level Feature Fusion (SCFF) module for global semantic perception. As a result, with only 6.593M parameters after reparameterization, EG360 achieves strong zero-shot performance on real-world benchmarks and runs at 35 FPS on a Jetson Orin NX 16GB in MAXN mode, whereas a previous ViT-small model runs at less than 2 FPS. Our code will also be made public for future research.
35. 【2611.16767】Evaluating Video LLMs' Understanding of Corner Cases in Autonomous Driving
链接：https://arxiv.org/abs/2611.16767
作者：Gabriel Manalu,Minh Son Hoang,Hyeontaek Hwang,Jaesung Lee,Hyojin Choi,Tran Tuan Phong,Seon Kwon Kim,Saad Wazir,Daeyoung Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Video Large Language, modern Video Large, Natural language explanations, Large Language Models, Natural language
备注： Accepted at BMVC 2026
点击查看摘要
Abstract:Natural language explanations promised by modern Video Large Language Models (Video LLMs) offer autonomous driving systems a path toward detailed scene description and interpretable decision making on the road. While recent benchmarks have begun assessing these models on driving scenes, they mainly target routine traffic conditions and general comprehension tasks based on existing driving datasets and therefore fail to evaluate model performance on the rarest and most safety-critical driving events, also known as "corner cases". To provide a comprehensive evaluation of Video LLMs on precisely these scenarios, we introduce DashBench, a benchmark testing 25 Video LLMs on 1,709 carefully curated driving videos spanning not only collision-related corner cases but also rare non-collision ones. Through extensive prompts and open-ended question answering, we expose a critical capability gap: all evaluated models perform substantially below the threshold required for safety-critical driving applications, frequently misjudging or missing dangerous events on the road ahead and hallucinating non-existent agents or actions in their explanations. We believe DashBench, combining an extensive dataset with a rigorous evaluation toolkit and a detailed diagnosis of current model limitations, drives progress toward safer, more explainable autonomous driving systems. The code and data will be shared at: this http URL
36. 【2611.16764】Efficient Periocular Recognition through Model Scaling and Cross Spectral VIS NIR Verification
链接：https://arxiv.org/abs/2611.16764
作者：Fabian Stockhard,Juan E. Tapia,Christoph Busch
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：resolution is limited, offers an efficient, efficient alternative, facial regions, regions are occluded
备注： Munuscript In revision Process, abstract limited to 1920 ch
点击查看摘要
Abstract:Periocular recognition offers an efficient alternative to full-face verification when facial regions are occluded or image resolution is limited. We present AdaEye, a systematic study of input and backbone scaling for periocular verification in visible-spectrum (VIS) and cross-spectral (VIS/NIR) settings. Using an AdaFace-style framework, we compare full-face, masked-face, and dedicated 80x40 periocular inputs while varying backbone width and embedding dimensionality. Across four VIS/VIS and VIS/NIR protocols, we assess verification accuracy, computational cost, inference throughput, training memory, template size, and training stability. Direct periocular processing reduces recognition cost from 6.30 to 1.64 GMACs per image and increases measured throughput by approximately threefold. Its effectiveness depends on the evaluation protocol: periocular models perform better on native UFPR periocular images, whereas face-based protocols favor retaining more input information. Moderate backbone width reductions maintain comparable mean verification performance on CASIA and ND-NIVL while reducing computation. Embedding compression decreases template-storage requirements, primarily benefiting deployment. Multi-seed experiments reveal that some configurations require numerical stabilization, particularly when embedding and backbone reductions are combined. These findings support selecting compact periocular architectures according to the target protocol and deployment constraints, balancing accuracy, efficiency, storage, and robustness.
37. 【2611.16752】AgriSense: Vision-Language Decision Support and Robotic Intervention in a Virtual Greenhouse Copy title
链接：https://arxiv.org/abs/2611.16752
作者：Lyes Saad Saoud,Oualid Doukhi,Reza Ghorbani,Moussa Ayyash
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Autonomous greenhouse management, management increasingly requires, increasingly requires robotic, requires robotic systems, greenhouse management increasingly
备注：
点击查看摘要
Abstract:Autonomous greenhouse management increasingly requires robotic systems that integrate perception, navigation, environmental regulation, and plant-level intervention. This paper presents AgriSense, a framework combining an Isaac Sim virtual greenhouse, a quadruped mobile manipulator, RGB and LiDAR-inertial sensing, environmental control, and supervised vision-language decision support. Frozen DINOv2 and BERT encoders, together with structured environmental inputs, support joint prediction of twelve environmental references, a target zone, and an intervention flag. Checkpoint replay reproduces 41/43 zone decisions. Across five seeds on a source-grouped test set, the full, image-removed, and language-removed configurations each achieve 43/44 correct zone decisions, providing no evidence of incremental multimodal zone-accuracy improvement. The full model achieves mean absolute errors of 0.249 degrees C for temperature, 2.030 percentage points for humidity, and 0.997 percentage points for soil moisture. Sensor-only inputs match full-model zone accuracy, while language-only inputs achieve 68.64%. External real-image benchmarks reveal distribution-shift limitations. Five offline Point-LIO routes yield rigidly aligned trajectory errors of 5.22-17.32 mm. Of 40 virtual-arm targets, 32 satisfy geometric acceptance criteria and eight are rejected at boundaries. Six long-horizon climate cases and fault protocols characterize integration limits. Navigation and integrated treatment rely on simulator-state inputs; physical greenhouse performance and agronomic treatment efficacy remain unvalidated. The contribution is an evaluated decision-support and robotic-intervention framework for a virtual greenhouse.
38. 【2611.16749】ORCA:Orthogonal Residual Consensus Alignment for Multi-View Clustering
链接：https://arxiv.org/abs/2611.16749
作者：Xiaojian Ding,Xian Li,Xiaoying Zhu,Lin Zhao,Kaixiang Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Deep multi-view clustering, redundant information accumulation, Deep multi-view, multi-view clustering, clustering often suffers
备注： 24 pages,5 figures,2 tables
点击查看摘要
Abstract:Deep multi-view clustering often suffers from redundant information accumulation during fusion and indiscriminate alignment across representation levels. We propose Orthogonal Residual Consensus Alignment (ORCA) to address these challenges. Its semantic incremental recurrent fusion module extracts cross-view orthogonal residuals as non-redundant increments and adaptively weights recurrent states through divergence-guided gating. Its consensus-calibrated hierarchical contrastive alignment module uses the global consensus to weight contrastive alignment of view-level, pairwise, and recurrent representations. Together, these modules balance view-specific structure with cross-view consistency. Experiments on five benchmarks against fifteen competing methods demonstrate ORCA's effectiveness, including a 5.25 percent accuracy improvement over the strongest baseline on 100leaves. Ablation studies validate both modules. Code is available at this https URL.
39. 【2611.16748】PhysLoop: Harnessing LLMs' Physics Awareness for Self-Improving Video Generation Models
链接：https://arxiv.org/abs/2611.16748
作者：Yuxuan Chen,Xiaojie Li,Hao Chen,Juncheng Ma,Kewei Zhang,Zhongjing Du,Guoqiang Wei,Fangfang Wang,Zhen Dong,Zhiyang Dou,Liming Zhao,Yan Zeng,Jianwei Zhang,Daquan Zhou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Video generation models, models produce visually, Video generation, produce visually realistic, generation models
备注：
点击查看摘要
Abstract:Video generation models produce visually realistic videos but still struggle with physical dynamics and causal consistency. Learning from generated videos requires fine-grained physical supervision, yet reliable quality judgments, correction pairs, and controlled variations are difficult to obtain. Large language models (LLMs) possess physical knowledge, but struggle to reliably guide video generation models in producing their training videos. We present PhysLoop, a unified harness designed to support physically grounded self-improvement in video generation models. The harness guides and constrains LLMs throughout video generation, selection, and correction, distilling their physical knowledge into physically consistent videos. The framework supports controllable training-data construction and inference-time video repair. By identifying and correcting failures, PhysLoop marks a key milestone toward recursive self-improvement (RSI) in video generation models with limited human intervention. We release 100K videos spanning diverse, realistic indoor and outdoor scenes, along with generation tools and two evaluation datasets: PhysLoop-Gen and PhysLoop-Repair. We evaluate controllable generation and localized repair on these datasets, respectively, and assess physical behavior on the external Physics-IQ Verified benchmark.
40. 【2611.16742】Fog-FWL: A Large-Scale Full-Waveform LiDAR Dataset for Recovering Fog-Hidden Objects
链接：https://arxiv.org/abs/2611.16742
作者：Kazuma Ikeda,Kotaro Oishi,Ryosei Hara,Ryo Yoshida,Takahiro Kado,Ibuki Fujioka,Taro Beppu,Mariko Isogawa,Kentaro Yoshioka
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：autonomous driving, highly vulnerable, real foggy FWL, core sensor, FWL
备注： 6 pages, 1 figure, 3 tables
点击查看摘要
Abstract:LiDAR is a core sensor for autonomous driving, yet it is highly vulnerable to fog. Fog scattering produces strong backscatter near the sensor and attenuates reflections from objects behind it, so weak object returns are often discarded by the peak detection that converts received signals into point clouds. Full-waveform LiDAR (FWL), which records the received optical signal before peak detection, retains these weak returns, but the lack of suitable data has prevented research on recovering fog-hidden objects from FWL. We present Fog-FWL, a dataset foundation for this task that consists of a real-world benchmark, Fog-FWL-Real, and a large-scale synthetic training set, Fog-FWL-Sim. Fog-FWL-Real contains 7,527 real foggy FWL frames from 8 scenes and 58 sequences, which is 579x larger than the only existing real foggy FWL data, together with histogram-level Object/Fog/Noise labels, 10,719 3D bounding boxes, and three difficulty levels defined by the attenuation of object reflections. Fog-FWL-Sim contains 12,000 frames generated by our physics-based simulator, Fog-FWL-Simulator, which integrates spatially heterogeneous fog density fields, time-resolved light transport including multiple scattering, and a photon-counting SPAD receiver model. The two subsets share the same sensor format and annotation protocol, enabling a strict sim-to-real evaluation in which no real waveforms are used for training. Our analysis shows that, under the hardest condition, object returns are included in the three strongest peaks for only 34.9% of object rays, underscoring the need for waveform-level recovery. Fog-FWL-Real, Fog-FWL-Sim, and the Fog-FWL-Simulator will be publicly released to facilitate research on fog-robust LiDAR perception.
41. 【2611.16727】From Foundation VLM to Versatile Driving VLM: A Triplet Incremental Training Approach
链接：https://arxiv.org/abs/2611.16727
作者：Shengtao Wu,Zichao Dong,Weixuan Qiao,Xiaolu Liu,Xin Zhan,Junbo Chen,Jianke Zhu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Adapting general Vision-Language, intrusive architectural overhauls, Triplet Incremental Training, Autonomous Driving, Adapting general
备注： 13 pages, 3 figures, 7 tables. Accepted at the 10th Conference on Robot Learning (CoRL 2026)
点击查看摘要
Abstract:Adapting general Vision-Language Models (VLMs) to Autonomous Driving (AD) is thought to require heavy 3D spatial priors or intrusive architectural overhauls to compensate for a lack of spatial grounding. In this work, we present a counterintuitive pilot study: off-the-shelf general VLMs already exhibit remarkable adaptability across diverse driving tasks, while precise metric depth remains the primary missing link, a bottleneck readily addressable via onboard sensors and depth foundation models. To this end, we introduce the Triplet Incremental Training Framework, a non-intrusive paradigm that seamlessly instills 3D geometric awareness into a general VLM backbone while fully preserving its open-world capabilities. Driven by automatically constructed (image, depth, QA pair) triplets, our framework operates via a unified tri-stream training pipeline: an unfrozen primary VLM stream to adapt to driving tasks, an auxiliary depth stream that guides the visual backbone to implicitly imagine 3D scene geometry via explicit geometric constraints, and a frozen twin VLM stream employing logit-level KL distillation to prevent semantic drift. Crucially, the auxiliary depth branch is discarded during deployment, ensuring the enhanced geometric awareness comes with zero inference overhead. We evaluate our framework across four major benchmarks targeting four diverse capabilities spanning 3D spatial perception, driving-oriented language reasoning, end-to-end planning, and general multimodal understanding. Our approach outperforms state-of-the-art driving VLMs, rivals domain-specific expert models in 3D perception, and successfully retains its original general reasoning capabilities. This demonstrates that Triplet Incremental Training offers a unified, deployment-ready paradigm for transforming general foundation models into robust driving intelligences.
42. 【2611.16724】What Limits Thermal Infrared Drone Detection? A Cross-Dataset Benchmark Analysis
链接：https://arxiv.org/abs/2611.16724
作者：Tamara R. Lenhard,Jan Kels,Tobias Koch
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：supporting continuous surveillance, imaging enables drone, enables drone detection, imaging enables, ambient illumination
备注： Accepted at 2027 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW), Workshop "Real World Surveillance: Applications and Challenges, 7th"
点击查看摘要
Abstract:Thermal infrared (IR) imaging enables drone detection with reduced dependence on ambient illumination, supporting continuous surveillance beyond the limitations of visible-spectrum sensing. However, substantial and often undocumented variability in camera systems, processing pipelines, and annotation practices across public IR drone datasets complicates the assessment of detector performance and cross-domain generalization. To examine these sources of variability and their implications for drone detection, we systematically characterize existing IR datasets and establish an artifact taxonomy reflecting their origins across the acquisition and processing pipeline, encompassing optical and sensor effects, tone mapping and image enhancement, and recording-related artifacts. Focusing on long-wave IR data, we investigate the impact of training data composition and model characteristics on YOLO-based detection performance, generalization, and condition-dependent failure modes. Our results demonstrate that detection performance is governed more strongly by training data composition than by YOLO generation or model capacity, while cross-dataset generalization exhibits pronounced asymmetries. Even the best-performing configuration fails to detect over 40\% of drones, with elevated miss rates for very small targets, cluttered urban backgrounds, and thermal crossover, highlighting the shortcomings of existing datasets.
43. 【2611.16701】Sprint3D: Accelerating End-to-End 3D Asset Generation through Pipeline Optimization
链接：https://arxiv.org/abs/2611.16701
作者：Sho Kuno,Ruihan Yu,Yonghao Yu,Guixu Lin,Lian Fu,Muyao Niu,Yu-Ju Tsai,Zheng-Hui Huang,Yi-Chuan Huang,Siqi Yang,Fengbo Lan,Erwin Wu,Kaipeng Zhang,Zhixiang Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：asset-quality textured meshes, produce asset-quality textured, generative models, textured meshes, costly to deploy
备注： Project page: [this https URL](https://alaya-lab.github.io/sprint3d/) Code: [this https URL](https://github.com/AlayaLab/sprint3d)
点击查看摘要
Abstract:Image-to-3D generative models now produce asset-quality textured meshes, but at minutes per asset they remain slow to iterate with and costly to deploy. Prior work has mostly accelerated the sampling of the networks, and where it also optimizes the mesh processing, it trains its own generators. We instead start from a publicly released pipeline and ask how much of its end-to-end time can be saved. Profiling the public Pixal3D pipeline shows that its latency is dominated by what happens after the networks: the four rectified flows take 14% of the wall-clock time and mesh post-processing takes 85%, most of it in CPU-based UV unwrapping. We therefore first rebuild the mesh post-processing on the GPU and take it off the critical path, then cut the per-evaluation overhead of the flows and distill them from 76 to 8 network evaluations. The resulting pipeline, Sprint3D, reduces the median time per asset from 133 s to 4.05 s on one H200 GPU at the same export settings (33$\times$). At the same time, on 2,653 held-out Toys4K objects it improves every input-view normal metric of the Pixal3D protocol, with a slightly lower mean silhouette IoU, lower point-cloud alignment scores and less fine texture detail. The rebuilt post-processing alone also speeds up TRELLIS.2, which uses the same export code, by 6.7$\times$ without a detectable change in the evaluated metrics.
44. 【2611.16655】MuViRL: Multimodal View-Invariant Visual Speech Representation Learning via Calibrated View Aggregation
链接：https://arxiv.org/abs/2611.16655
作者：Fei Su,Kai Qiu,Juan Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：capture shared semantic, shared semantic information, signals to capture, capture shared, shared semantic
备注： 30 pages, 7 figures
点击查看摘要
Abstract:Multimodal representation learning combines complementary signals to capture shared semantic information. For dynamic scenes, these representations need to remain consistent across views while preserving distinctions between temporal states. In visual speech representation learning, view variation changes the visibility and reliability of articulation cues, making it difficult to learn such representations from synchronized audio and video. To address this challenge, we propose MuViRL, a self-supervised framework for multimodal view-invariant visual speech representation learning via calibrated view aggregation. The framework combines synchronized 3D Gaussian view synthesis with multimodal self-supervision to learn consistent representations from real and synthesized data. A multimodal decision model learns relative view utility from teacher prediction losses, and its calibrated scores guide the aggregation of complementary information. Aggregation-to-Single Distillation transfers the aggregated predictions to a single branch. Real-synthetic alignment matches synchronized windows across views while preserving their temporal relations. Experiments on real and synthesized multiview data demonstrate that MuViRL improves multimodal representation consistency and visual speech recognition performance across views.
45. 【2611.16650】Learning the Missing Derivative: Neural Multiple-Scattering Operators for Inverse Volume Rendering
链接：https://arxiv.org/abs/2611.16650
作者：Sipeng Chen,Shibo Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：photographs requires modeling, requires modeling multiple, Reconstructing optically thick, modeling multiple scattering, Reconstructing optically
备注： 21 pages, 11 figures, 18 tables
点击查看摘要
Abstract:Reconstructing optically thick media from photographs requires modeling multiple scattering and its response to changes in extinction. Frozen-source tomography discards this derivative; differentiable path tracing estimates it through expensive, noisy sampling. We instead predict the multiple-scattering field with a neural operator and differentiate through it during inverse rendering, while computing transmittance and single scattering directly. A further challenge arises during optimization: an operator that predicts the field accurately on held-out media can still produce poor derivatives at the density states visited by the optimizer. We address this by fine-tuning on states generated during inversions driven by the operator, using Monte Carlo scattering-field supervision. On held-out optically thick clouds, our method improves relighting over frozen-source tomography at equal time and outperforms differentiable path tracing given substantially more time. Training on inversion trajectories also improves derivative alignment at visited states and reduces optimization drift.
46. 【2611.16642】Dataset Distillation via Drifting
链接：https://arxiv.org/abs/2611.16642
作者：George Cazenavette,Angelina Quan,Giannis Daras,Antonio Torralba,Vincent Sitzmann
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：downstream tasks, concerns the learning, effective replacement, dataset distillation concerns, large real dataset
备注： Accepted at NeurIPS 2026. Project Page: [this https URL](https://drifting-distillation.github.io/)
点击查看摘要
Abstract:The task of dataset distillation concerns the learning of a small set of synthetic samples that can serve as an effective replacement for a large real dataset when used for downstream tasks. While many solutions have been proposed since the problem's inception, most of them primarily seek to optimize the distilled data with respect to a classifier. In this work, we propose a new distillation method that learns a set of samples such that they directly approximate the per-class data distribution. Specifically, we "drift" our distilled data in the latent space of a feature extractor such that they move both toward the real data and away from each other without using a classification objective. We find that our drifted data cover the real distribution significantly better than existing methods while still serving as powerful training samples for classification. Furthermore, we showcase our method's use as a visualization tool for better interpreting models and extend it beyond images to other modalities. Our work advances the frontier of dataset distillation, offering a novel synthesis method and proposing distribution-based metrics as a complementary evaluation. More broadly, our findings help address the growing need to understand both data and models by uncovering more about how they interact.
47. 【2611.16639】Asymmetric Multimodal Learning with Decomposed JEPAs
链接：https://arxiv.org/abs/2611.16639
作者：Yusuf Shihata
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：building multimodal representations, Alignment Redundancy Bound, standard objective, alignment, multimodal representations
备注： 15 pages, 12 tables, 3 figures
点击查看摘要
Abstract:Cross-modal alignment is the standard objective for building multimodal representations. We show that alignment as a \emph{sole} objective is lossy wherever modalities are informationally asymmetric---where neither can express what the other carries. Visual question answering is an obvious case: a question is a selective relational operator probing a dense visual field whose fine-grained features no query recovers, so what alignment preserves is not what the task requires. We prove an \textbf{Alignment Redundancy Bound}: alignment-only Dirichlet energy minimization retains at most the redundant information atom $\Red(Z; X_1, X_2)$, annihilating private modality-specific structure $\Unq(Z; X_m)$ and cross-modal synergy $\Syn(Z; X_1, X_2)$. We introduce \textbf{Decomposed JEPA (D-JEPA)}, which factorizes latents into an aligned shared core and private modality-specific fibers. The shared core retains most of the structure alignment targets; the private fibers recover what alignment discards, via contextual masked prediction and asymmetric cross-subspace independence. Under information asymmetry, alignment-only training undergoes catastrophic semantic collapse on compositional reasoning benchmarks, surviving only on binary queries. D-JEPA averts this collapse, substantially improving downstream accuracy over both alignment-only and alignment-with-reconstruction baselines, and restoring a positive multimodal synergy gap in place of the baseline's inverted gap. Information-theoretic audits confirm that D-JEPA recovers most of the mutual information available from a frozen backbone, and causal fiber-swap interventions demonstrate that the recovered information is causally localized in the private fibers.
Comments:
15 pages, 12 tables, 3 figures
Subjects:
Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.16639 [cs.LG]
(or
arXiv:2611.16639v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2611.16639
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
48. 【2611.16630】When Chekhov's Gun Fires Anyway: Over-Realization in Text-to-Image Models
链接：https://arxiv.org/abs/2611.16630
作者：Jiahao Huang,Kon Woo Kim,Song-Duo Ma,Yuka Kitamura,Felix Wagner,Yunshan Huang,Sunisth Kumar,Xanh Ho,Yun-Ang Wu,Zhijie Chen,Yunjia Xu,Junfeng Jiang,Zefan Yu,Fei Cheng,Akiko Aizawa
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：prompt mentions, target, failure, call, prompt
备注：
点击查看摘要
Abstract:In text-to-image generation, a target that the prompt mentions often appears in the generated image in a way the prompt does not call for. We call this failure over-realization. Mental-spaces theory points to the situations where it can happen: under a negation, inside what a character believes or imagines, as the vehicle of a figurative comparison, or behind a viewpoint that hides the target. Prior work has studied only negation in depth, and the conventional alignment and preference metrics do not penalize the failure. We build OverReal to measure it: OverReal-Gen, 698 prompts covering the four situations, on which we measure each generator's over-realization rate; and OverReal-Det, 2,841 generated images human-labeled for whether and how the target is over-realized, on which we verify the automatic judge that produces this rate. Our evaluation of eight text-to-image systems reveals that all of them over-realize, and that conventional metrics such as CLIPScore reward the failure rather than penalize it. Prompt expansion only partly mitigates the failure. Inside the generator, the diffusion backbone attends to a mentioned target almost as much as to a requested one. The cue words that should hold the target back receive less attention than ordinary words.
49. 【2611.16628】Safety as a Budget: Calibrating the Control Channel of Constrained GRPO for Vision-Language Models
链接：https://arxiv.org/abs/2611.16628
作者：Bo Han
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：harmful image-text requests, decline harmful image-text, reward weights found, teach vision-language models, Reinforcement learning
备注： 10 pages, 5 figures, 5 tables
点击查看摘要
Abstract:Reinforcement learning can teach vision-language models (VLMs) to decline harmful image-text requests, but how safe the result becomes is set indirectly, through reward weights found by trial runs. Stating safety as budgets on the rate of harmful assistance and the rate of over-refusal, enforced by Lagrange multipliers inside GRPO with an off-the-shelf scorer as the cost, is the natural fix, and it fails twice. The multiplier compares the scorer's mean with the budget, and scorers built for ranking get the mean wrong: a fixed-point analysis shows that the mean bias, not the budget, then decides whether the multiplier settles, saturates or switches off. And standard GRPO standardizes the penalized reward within each group, which cancels the multiplier before it reaches the gradient. Two-channel constrained GRPO repairs both: the base reward keeps the raw score for the within-group comparison, the penalty and the constraint estimate pass through a monotone map fitted on judge-labeled training responses, and the advantage keeps the multiplier. On a Qwen3-VL-2B policy with a training-free readout of an open 4B model as the scorer, held-out harm on 1,037 adversarial prompts falls from 8.9% under standard GRPO to 4.8%, lower in every seed, where the uncalibrated budget gives 7.6%; over-refusal stays at most 2% on 400 benign queries and MMBench is unchanged. The gain is largest where the intent sits in the image (10.1% - 5.1%) and grows on the unseen HADES benchmark (28.9% - 12.8%). Order-preserving distortions of the scores reproduce each predicted controller state in every seed, and the results hold under a map fitted on another judge's labels, an image-reading judge and a human audit.
50. 【2611.16620】Improved CNN-Transformer Network for Neutron Image Super-Resolution
链接：https://arxiv.org/abs/2611.16620
作者：Yuheng Chu,Hongli Li,Tian Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：material defect diagnosis, neutron images, defect diagnosis, nondestructive testing, spatial resolution
备注： 11 pages, 5 figures, 3 tables
点击查看摘要
Abstract:The spatial resolution of neutron images is of great importance for material defect diagnosis, structural characterization, and nondestructive testing. However, owing to limitations in neutron beam quality, scintillator conversion efficiency and light scattering, detector pixel size, and noise levels, conventional neutron images often suffer from speckle noise, blurred edges, and missing details, making them inadequate for high-precision analysis. To address these issues, an improved super-resolution model combining convolutional neural networks (CNNs) and Transformers is proposed. First, to overcome the difficulty of obtaining high-quality and clear training images for neutron imaging, a pretrained image restoration model is fine-tuned using real neutron images and then employed to enhance existing neutron images, thereby providing high-quality reference images for subsequent super-resolution model training. Second, an improved CRAFT-based super-resolution network is developed by incorporating a hybrid prior-guided channel fusion module (HPCF), a mean-standard deviation dual-statistics squeeze-and-excitation block (MS-SEBlock), and a partial convolution feed-forward network (PCFN), with the aim of improving the reconstruction of important information, such as textures and fine details, in neutron images. Simulation results demonstrate that, compared with bicubic interpolation, SRCNN, SRGAN-VGG, and other methods, the proposed network achieves superior performance in both full-reference metrics, including PSNR and SSIM, and no-reference metrics, including AGM and SMD. The visual quality and structural fidelity of the reconstructed images are also significantly improved. This study provides a new approach to improving neutron image quality.
51. 【2611.16608】owards Democratising Low-Data Medical Image Classification: CPU-Trainable ZACH-ViT and Its Geometric Variants
链接：https://arxiv.org/abs/2611.16608
作者：Athanasios Angelakis
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：computational capacity, classification in resource-constrained, resource-constrained settings, settings must contend, contend with limited
备注： 17 pages, 4 figures
点击查看摘要
Abstract:Medical image classification in resource-constrained settings must contend with limited annotations and computational capacity. We evaluate four ZACH-ViT variants with linear, Euclidean prototype, Poincare and spherical heads alongside two compact multiple-instance-learning baselines. All models are trained from scratch with fewer than 260,000 parameters across seven MedMNIST+ datasets and three external benchmarks (PCam, ISIC2017 and Shenzhen tuberculosis radiographs). The low-data protocol uses 50 training images per class and five seeds, with validation-selected checkpoints at 23 and 47 epochs; a full-data reference uses one seed. Compact-TransMIL achieves the highest ten-dataset mean test Macro-F1 at 23 epochs (53.34%) and with full data (73.93%). At 47 epochs, ZACH-Linear narrowly leads (57.76% versus 57.54% for Compact-TransMIL). Extending training improves Macro-F1 in 239 of 300 paired comparisons. On ISIC2017, hZACH-Spherical has the highest 47-epoch low-data Macro-F1 (44.09% with SD 4.09%), whereas ZACH-EuclideanProto leads with full data (51.27%). We additionally conduct 40 CPU-only training runs on ISIC2017 and Shenzhen using four CPU threads; model-only single-image inference requires approximately 4-9 ms, while image decoding and preprocessing substantially increase end-to-end latency. The results demonstrate the feasibility of CPU-only training on the tested platform and the task- and regime-dependence of compact medical imaging under strict resource constraints.
52. 【2611.16583】ReFineR: Single image to dense point cloud registration at pixel level with point splatting
链接：https://arxiv.org/abs/2611.16583
作者：Ugo Insalaco,Jean-Emmanuel Deschaud,Pierre Dellenbach
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Light Detection, Detection and Ranging, LiDAR sensors provide, provide complementary observations, sensors provide accurate
备注：
点击查看摘要
Abstract:Cameras and LiDARs (Light Detection and Ranging) provide complementary observations of the same scene: cameras capture rich appearance cues while LiDAR sensors provide accurate geometric measurements. In this work, we address the problem of fine image-to-point cloud registration from a single image and a roughly estimated camera pose. On robotic platforms, residual reprojection errors of several pixels are commonly observed even after calibration due to temporal desynchronization, mechanical vibrations, or inaccuracies in point cloud reconstruction. Such errors can lead to decimeter-level geometric discrepancies at moderate distances and significantly affect multiple downstream tasks, such as dense cross-modal supervision, texture mapping, and semantic label transfer. To address this challenge, we introduce ReFineR: an offline framework to finely register individual images to pre-reconstructed point clouds. ReFineR builds upon differentiable point splatting rasterization and a smooth Gradient Orientation Measure (GOM) to iteratively refine the camera pose through analysis-by-synthesis optimization. We evaluated the method on a curated dataset of manually calibrated images collected from heterogeneous data sources. Furthermore, we show that an automatic point cloud rescale factor can be estimated prior to optimization, enabling robust refinement across a wide range of scenarios using a single scale-invariant formulation. The project page can be found at this https URL
53. 【2611.16581】Do the Details Help the Whole? One-Way Transfer from Person Actions to Group Intent in VLMs on JRDB-Social
链接：https://arxiv.org/abs/2611.16581
作者：Chengguang Gan,Zhixi Cai,Yunhao Liang,Hanjun Wei,QingHao Zhang,Shiwen Ni
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Social scene datasets, scene datasets label, Social scene, datasets label people, scene datasets
备注：
点击查看摘要
Abstract:Social scene datasets label people at two levels: what each person is doing and what the group is there for. Training on both levels at once is often assumed to help each of them. We test this assumption for vision-language models (VLMs) on JRDB-Social, treating person actions as the details and group intent as the whole. We fine-tune Qwen3.5 4B under eight training arms with three seeds, repeat the core arms on Qwen3.5 9B and Qwen3-VL 4B, and judge every arm with a verdict rule fixed before testing. Writing each member's actions before the intent raises intent macro-F1 from 30.1 to 31.0, and writing the intent first reaches 31.2, while action F1 stays within 0.2 points of an action-only model. Under the selected recipe, no arm trained with intent improves actions. The gain requires correct, image-grounded actions: empty action lists or actions borrowed from another group with the same intent lower intent F1. Forced-prefix tests, occlusion, member masking, linear probes and component grafting show that the intent follows the written actions, relies more on people and partly resides in the vision tower. Supplying actions as input instead of as targets hurts both levels.
54. 【2611.16579】ActWorld-JEPA: Action-Conditioned JEPA World Models Meet Latent Planning for End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2611.16579
作者：Ziying Song,Shengkai Zhang,Caiyan Jia,Lei Yang,Lin Liu,Yuchen Liu,Ziyang Liu,Zirui Li,Gang Wang,Peiliang Wu,Li Wang,Yadan Luo,Chen Lv
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Joint-Embedding Predictive Architectures, Predictive Architectures, pixel reconstruction, space without pixel, enable future prediction
备注： 19 pages, including appendix. Code: [this https URL](https://github.com/adept-thu/ActWorld-JEPA) . Project: [this https URL](https://adept-thu.github.io/ActWorld-JEPA/)
点击查看摘要
Abstract:Joint-Embedding Predictive Architectures (JEPAs) enable future prediction in latent space without pixel reconstruction. However, latent predictive consistency alone does not establish the relative driving quality of candidate plans. We present ActWorld-JEPA, a joint-embedding formulation for candidate-based driving. Where Plan-Conditioned JEPA (PC-JEPA) uses global and step-wise trajectory intentions to guide recurrent latent prediction, then combines the predicted future with the current scene through gated cross-attention; Relational Residual Reranking ($R^3$) models agreement and discrepancy between plan and future representations under planning supervision, yielding bounded, gated residual corrections to the base planning scores. This formulation connects latent prediction to candidate selection using only observed context and proposed trajectories at inference. Benchmark-specific implementations report 94.1 PDMS on NAVSIM v1 navtest, with the final selector calibrated using aggregate NAVTEST feedback, and 91.6 and 42.7 EPDMS on NAVSIM v2 navtest and navhard, respectively. The nuScenes evaluation reports a mean $L_2$ error of 1.20 m and a predicted collision rate of 0.76% over 1--6 s. This work provides an effective path from JEPA's predictive representations to driving decisions informed by anticipated consequences.
55. 【2611.16538】Pl@ntNet machine-to-machine identification service with Pl@ntNet API: enabling automated biodiversity monitoring through large-scale plant identification
链接：https://arxiv.org/abs/2611.16538
作者：Benjamin Bourel(IROKO),Jean-Christophe Lombardo(IROKO),Alexis Joly(IROKO),Mathias Chouet(UMR AMAP),Thomas Paillot(IROKO),Antoine Affouard(UMR AMAP),Vanessa Hequet(UMR AMAP),Herv{é} Go{ë}au(UMR AMAP),Pierre Bonnet(UMR AMAP)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：identification, plant, images, plant identification, service
备注：
点击查看摘要
Abstract:1. Monitoring plant biodiversity requires identifying large numbers of plants across space and time. Although artificial intelligence (AI) can now identify plant species from images with high accuracy, most existing systems rely on users manually submitting images. As ecological monitoring increasingly generates large image collections from cameras, drones, robots and online platforms, there is a growing need for plant identification services that can be directly integrated into automated data-processing workflows. 2. Here, we present Pl@ntNet's machine-to-machine AI plant identification service. This service uses an application programming interface (API) to provide programmatic access to Pl@ntNet's plant recognition models and the associated taxonomic processing. This service enables the implementation of automated identification workflows without human intervention and can thus directly link large image collections and automated observation systems to an AI-based plant identification system. 3. We establish that this service, which covers 85,000 species from around the world, (1) has a species prediction accuracy of 0.89, (2) process images up to 666 times faster than workflows requiring human intervention, (3) and has processed over 84 million identification requests since its launch, including more than 40 million in 2025 alone. We demonstrate how it has already enabled the implementation of a new generation of ecological workflows: identifying plants from images of insects to reconstruct the plant-pollinator interactions, analysing geolocated images from social media to study plant distribution, detecting invasive plants using images taken at the roadside, and identifying weeds using agricultural robots. Finally, we illustrate its application using a reproducible example: identifying plants from insect photos on iNaturalist. In approximately 30 min on a standard laptop, 2,424 images were processed to generate a dataset of 708 plant-pollinator interactions, with a weighted precision of 0.98 for flower detection and an accuracy of 0.88 for genus plant identification. 4. In conclusion, this machine-to-machine species identification is already operating on a considerable scale and meets a genuine need. All of this paves the way for a new paradigm in biodiversity monitoring, in which automated sensors and image collections can be directly connected to AI-based identification services.
56. 【2611.16534】Context-Predictive Low-Rank Adaptation for Face Presentation Attack Detection
链接：https://arxiv.org/abs/2611.16534
作者：Aminu Yusuf,Shakeel Muhammad Ibrahim,Sulaimon Oyeniyi Adebayo,Muhammad Sohail Ibrahim,Muhammad Shahid Jabbar,Shujaat Khan
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV); Signal Processing (eess.SP); Machine Learning (stat.ML)
关键词：Face presentation attack, distinguish physical spoofing, physical spoofing cues, Face presentation, presentation attack detection
备注： This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible
点击查看摘要
Abstract:Face presentation attack detection requires representations that distinguish physical spoofing cues across changes in acquisition devices, subjects, and attack media. Large visual encoders offer transferable representations, but conventional binary fine-tuning supervises their final decisions without explicitly constraining how local facial evidence is represented under partial observation. We present CP-JEPA, a context-predictive adaptation framework that combines low-rank tuning of a pretrained CLIP image encoder with a joint-embedding predictive objective. A student predicts complete-image teacher features at masked spatial locations, while unmasked classification, masked classification, and prediction consistency retain the connection to the live/spoof task. An exponential-moving-average teacher supplies evolving latent targets. The auxiliary components are used only during training; inference requires only the LoRA-adapted CLIP visual encoder and binary classifier. {We evaluate CP-JEPA under single-source and multi-source OCIM transfer, additional CelebA-Spoof training, transfer to CelebA-Spoof, two-source training, and unseen-attack evaluation on SiW-Mv2.} On the standard OCIM benchmark, CP-JEPA achieves 3.74\% mean HTER and 98.73\% mean AUC. {Single-source evaluation achieves 11.36\% mean HTER across twelve source--target combinations.} With CelebA-Spoof added to the three OCIM training sources, CP-JEPA reduces mean HTER from 3.45\% to 2.35\% and increases mean AUC from 98.68\% to 99.32\%. On SiW-Mv2, it achieves 3.36\% mean HTER across the held-out attack categories. Controlled loss ablations examine the contributions of latent prediction, masked classification, and prediction consistency. The results show that context-predictive adaptation can improve cross-dataset PAD performance, although the gains vary with the training sources and evaluation setting.
57. 【2611.16517】UniSpark: Exploring Hybrid Attention for Multimodal Understanding and Generation
链接：https://arxiv.org/abs/2611.16517
作者：Jiancheng Pan,Yuzheng Liu,Hengyuan Cao,Qiyuan Zhang,Yangyan Li,Biao Gong,Zheng Zhang,Ka Long Cheng,Xinyang Wang,Yujun Shen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：model that investigates, investigates hybrid attention, generation, visual, attention
备注： Technical Report, 31 pages
点击查看摘要
Abstract:We present UniSpark-9B, a unified multimodal model that investigates hybrid attention for visual understanding and generation. Built on a Mixture-of-Transformer-Experts backbone with approximately 9B parameters in each branch, UniSpark combines full attention for explicit token interactions with GatedDeltaNet linear attention for compact context propagation. Autoregressive text prediction and visual flow matching jointly support visual question answering, text-to-image generation, instruction-guided editing, and interleaved text-image prediction. In interleaved generation, noisy visual targets are isolated from subsequent predictions, while clean visual representations provide context for later outputs. A blockwise protocol enforces this distinction through attention masks in full-attention layers and recurrent-state retention rules in linear-attention layers. The selected training sources contain 159.7M generation samples, 213.4M understanding samples, and 624.8K interleaved sequences. A four-stage curriculum jointly trains multimodal understanding and visual generation, refining answer accuracy and instruction following while extending image synthesis to 2K. UniSpark scores 2470.3 on MME-S and 0.83 on GenEval. Qualitative examples further illustrate its capabilities in interleaved image generation, video synthesis, and video editing. Together, these results demonstrate that hybrid attention provides an effective backbone for unified multimodal understanding and generation.
58. 【2611.16515】PiLLVD: A Real-World Low-Light Video Dataset for Dynamic Scenes Captured with Off-the-Shelf Cameras
链接：https://arxiv.org/abs/2611.16515
作者：Yaser Abu Awwad,Paul L. Rosin,Oktay Karakuş
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：received increasing attention, low-light video enhancement, low-light video, Low-Light Video Dataset, video enhancement
备注： 14 pages, 7 figures, 5 tables. Dataset available on Zenodo: [this https URL](https://doi.org/10.5281/zenodo.23015904)
点击查看摘要
Abstract:Low-light image and video enhancement has received increasing attention in recent years. However, most existing enhancement methods are developed and evaluated on still images, while progress in low-light video enhancement remains limited by the lack of real-world paired video datasets. Acquiring paired low-light and normal-light video sequences is challenging because it requires spatially and temporally aligned captures while avoiding motion blur, exposure mismatch, and correspondence errors in dynamic scenes. To address this gap, we introduce PiLLVD, the Pi-based Low-Light Video Dataset, a paired low-light video dataset captured using an accessible Raspberry Pi-based multi-camera system with off-the-shelf cameras. PiLLVD provides paired low-light and aligned normal-light reference sequences for dynamic indoor and outdoor scenes, including diverse human and object motion under varying illumination conditions. Unlike existing datasets that are often image-based, static, synthetic, or limited to simple motion patterns, PiLLVD focuses on motion-rich scenes where frame-to-frame stability and motion-related artefacts are important for evaluation. In addition to presenting the dataset and acquisition pipeline, we benchmark representative pre-trained low-light video enhancement methods on PiLLVD under a zero-shot setting. The results show that existing methods do not generalise uniformly across the proposed sequences, highlighting the challenges posed by the proposed dataset and its value for both benchmarking existing methods and supporting the development of future low-light video enhancement algorithms.
59. 【2611.16464】From State of THE ART to Human Prediction Algorithms
链接：https://arxiv.org/abs/2611.16464
作者：Conghao Wong,Ziqian Zou
类目：Computers and Society (cs.CY); Computer Vision and Pattern Recognition (cs.CV)
关键词：driven human progress, prediction algorithms, curiosity and longing, progress from ancient, ancient times
备注：
点击查看摘要
Abstract:Human curiosity and longing for the future have driven human progress from ancient times to the present. With the advancement of AI technology, human prediction algorithms have also drawn increasing attention from researchers. However, as AI technology continues to advance, we observe a counterintuitive phenomenon. Take human trajectory prediction algorithms as an example. Although models' quantitative prediction performance has improved, yielding one state-of-the-art model after another, the consideration of human behaviors, future thoughts, and social interactions themselves presents a gradually diminishing trend in the construction of these prediction algorithms, buried beneath numbers and metrics. In this manuscript, taking interactive art and human trajectory prediction algorithms as examples, we attempt to adopt a different analytical perspective to analyze the structural and developmental commonalities between these two fields. By examining specific interactive artworks and prediction algorithms, we aim to explore how human intuitions and art are associated with AI algorithms through three aspects, including perception, interaction, and timing, thereby providing new insights for the understanding and further research in this domain. We also observe an interesting phenomenon that certain art-inspired prediction algorithms can actually deduce intriguing patterns of human behaviors from the data, offering new potential avenues for understanding the relationship between human activities, state of The Art, and AI algorithms.
60. 【2611.16452】Can an LVLM Perceive Event Boundaries Like a Human?
链接：https://arxiv.org/abs/2611.16452
作者：Hyolim Kang,Jungsoo Lee,Yeji Song,Whie Jung,Janghoon Cho,Juntae Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Vision-Language Models, Large Vision-Language, Vision-Language Models, humans remains unclear, remains unclear
备注： 15 pages, 5 figures, 8 tables
点击查看摘要
Abstract:Large Vision-Language Models (LVLMs) reason effectively about video content, but whether they perceive its event boundaries in a manner consistent with humans remains unclear. We first investigate this through Generic Event Boundary Detection (GEBD), which identifies event boundaries naturally perceived by humans in continuous video, without relying on predefined event categories. On Kinetics-GEBD dataset, LVLMs miss many boundaries when predicting directly from frames, but effectively refine candidates proposed by an unsupervised discovery method, achieving state-of-the-art unsupervised GEBD performance. We extend this discovery-refinement approach to hour-long egocentric video, where boundary discovery requires a broader semantic scale and whole-video LVLM refinement becomes impractical. We address these challenges through coarse-to-fine temporal discovery and localized LVLM accept/reject judgments. Human evaluation shows that the LVLM's agreement with group consensus falls within the range observed among human annotators, with disagreements concentrated on low-consensus cases. Using this pipeline, we construct EgoBoundary, a benchmark for event boundary detection in hour-scale egocentric video. Representative supervised and unsupervised methods degrade substantially on EgoBoundary, highlighting the challenge of long-horizon event boundary detection.
61. 【2611.16451】HIFC-IQA: Train-Free Cross-Domain Image Quality Assessment via Dual-Process Cognition
链接：https://arxiv.org/abs/2611.16451
作者：Yu Li,Zhengran Shen,Puchao Zhou,Yukang Ding,Yachun Mi,Boyuan Yang,Xi Zhai,Shaohui Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Image Quality Assessment, No-Reference Image Quality, complex real-world degradations, real-world degradations introduces, critical domain shift
备注： Accepted by NeurIPS2026
点击查看摘要
Abstract:The gap between controlled synthetic distortions and complex real-world degradations introduces a critical domain shift challenge for No-Reference Image Quality Assessment. Although Unsupervised Domain Adaptation (UDA) approaches attempt to address this issue, they remain constrained by substantial retraining overhead and cumulative error propagation inherent in iterative pseudo-labeling. Inspired by the dual-process theory of human cognition for remarkable generalization ability, we propose Hierarchical Intuitive and Fuzzy Consensus (HIFC), a completely train-free Cross-Domain IQA framework. HIFC employs asymmetric perceptual decomposition to disentangle semantic content from distortion-sensitive representations. The final quality score is fused through the synergy of two complementary branches: a memory consensus branch that retrieves a stable Fuzzy Quality Centroid from a synthetic reference gallery, and an intuitive branch that captures aesthetic polarization via zero-shot vision-language alignment. Extensive experiments show that HIFC achieves state-of-the-art performance across multiple benchmarks, attaining the highest average SRCC and PLCC among competing UDA methods. Most notably, in the challenging synthetic-to-authentic cross-domain setting, HIFC achieves a substantial performance margin over competing methods, demonstrating remarkable robustness and generalization.
62. 【2611.16442】DesignTaste: Benchmarking AI-Generator Visual Design Against Award-Wining Works
链接：https://arxiv.org/abs/2611.16442
作者：Zhou Chen,JiaXiang Li,DanYing Pan,Ye Li,TianRui Yang,EnBao Zhang,YaNan Xiao,LiXin Sun,Anqi Liu,Dong Zhao,JianYuan Li,YuanYuan Ding,Kai Kong,Xinwen Xu,HuiTang Du,Min Zhou,Zhiqiang Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：commonly assess text-image, assess text-image alignment, benchmarks commonly assess, commonly assess, assess text-image
备注： 31 pages, 12 figures, including appendices. Code and data: [this https URL](https://github.com/ArtArk-AI/DesignTaste)
点击查看摘要
Abstract:Text-to-image benchmarks commonly assess text-image alignment or overall preference. Whether models can produce good designs when a brief leaves the appearance open remains less well understood. We introduce DesignTaste, a visual design benchmark that compares generated images with award-winning works. From these works and their publicly available context, we derive 403 design briefs: 100 poster tasks from 100 Beste Plakate 2025 and 303 tasks spanning 20 categories from ADC 2026. Six leading commercial text-to-image models each generate an image from the same brief. A single model judge scores each output and the corresponding award-winning work independently on five evaluation dimensions. On each dataset, only ArtArk achieves a higher mean overall score than the award-winning works. All six models score lower in Creative Originality on both datasets. These results show that producing finished, visually appealing images does not imply that a model can develop good design solutions.
63. 【2611.16424】PhysCapBench: A Cross-Domain Benchmark for Physically Grounded Video Captioning
链接：https://arxiv.org/abs/2611.16424
作者：Haofeng Wang,Pengcheng Wen,Ruiqi Li,Yuhao Zhang,Tiange Zhang,Boren Zheng,Xuanyi Liu,Siyu Tao,Danni Yu,Gan Lin,Haocheng Tang,Tianzizhe Guo,Mingyuan Su,Boyuan Chen,Zhongyuan Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：learn transferable physical, aims to learn, learn transferable, transferable physical knowledge, Physical
备注： Project page: [this https URL](https://hfwang2001.github.io/physcapbench-site/)
点击查看摘要
Abstract:Physical AI aims to learn transferable physical knowledge from real-world experience to understand, predict, and act in the physical world. Internet videos and embodied demonstrations provide complementary observations of motion, interaction, and state evolution. A foundational data challenge is to measure and preserve this physical information as training supervision. In video-language pretraining, captions express observed processes in language, yet a semantically correct description can omit the interactions and transitions that define those processes. Rich physical experience in video does not automatically translate into sufficient language supervision. This gap calls for a yardstick to assess annotation quality, compare captioning strategies, and guide training-data refinement. Motivated by our data construction for world-model pretraining, we introduce PhysCapBench, to our knowledge the first unified physical-caption benchmark spanning all three domains: third-person scenes, egocentric manipulation, and handheld-gripper demonstrations. It provides human-verified annotations for 1,500 video sequences and evaluates accuracy and coverage through seven physical dimensions. We examine downstream utility through video reconstruction and manipulation-policy fine-tuning. Physical captions reduce reconstruction LPIPS by 8.6-9.5% on third-person videos and 26.9-30.9% on egocentric videos relative to metadata captions. Training-instruction enrichment improves both PhysCapBench scores and policy success, including a 7.5-percentage-point gain for pi0.5 on a RoboTwin 2.0 subtask. PhysCapBench makes the physical content of language supervision inspectable and comparable, providing a cross-domain basis for its evaluation and improvement.
64. 【2611.16419】I See What You Want: Decoding Hierarchical Operator Intent from Visual Teleoperation History
链接：https://arxiv.org/abs/2611.16419
作者：Xiangyi Jia,Kaixian Qu,Shengzhi Wang,Chenyu Yang,Robert Katzschmann,Marco Hutter
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：robotic scene understanding, Vision-language models, task planning, scene understanding, language-conditioned control
备注： 8 pages, 6 figures. Project page: [this https URL](https://see-want.github.io/)
点击查看摘要
Abstract:Vision-language models (VLMs) have become a powerful foundation for robotic scene understanding, task planning, and language-conditioned control. A natural question follows: can these models also decode what a human operator intends while teleoperating a robot, without any explicit instruction? We formulate this as hierarchical intent prediction, jointly inferring the ongoing atomic action and the broader mission it serves from a short visual teleoperation history. To study this, we introduce VI AMO (Vision Intention Action and Mission Ongoing), a dataset of 6,600 episodes from eleven robot sources with 13,653 temporally aligned action annotations and 9,702 mission annotations. Large proprietary models struggle with this problem: on held-out episodes, GPT-4o reaches Sentence-BERT similarities of only 0.563 and 0.470 for action and mission, and GPT-5.6 Luna achieves only 0.581 and 0.554. Fine-tuning a VLM on VI AMO yields our Vision-Intention Model (VIM), which raises these scores to 0.825 and 0.821 and still reaches 0.726 and 0.717 on the 35.4% of test actions with both labels absent from training. Finally, as a downstream application, VIM's predicted mission enables a vision-language-action (VLA) policy to take over from the operator mid-task in a real-world environment unseen during VIM fine-tuning, reducing human teleoperation time by 34.6% relative to GPT-4o and 39.8% relative to GPT-5.6 Luna, while cutting intent-prediction latency by roughly 70% on average.
65. 【2611.16418】Model Distribution-Aware Multimodal Dataset Distillation
链接：https://arxiv.org/abs/2611.16418
作者：Jiajun Shen,Yonglin Wu,Ruonan Yu,Xinchao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：synthesizing compact image-text, Multimodal dataset distillation, compact image-text datasets, aims to reduce, Multimodal dataset
备注： NeurIPS 2026
点击查看摘要
Abstract:Multimodal dataset distillation (MDD) aims to reduce the cost of vision-language pre-training by synthesizing compact image-text datasets. Although recent feature-matching methods have improved distillation efficiency, synthetic data may become specialized to the model representations encountered during optimization, limiting generalization to unseen model states. We propose Model Distribution-Aware Multimodal Dataset Distillation (MDA-DD), which leverages supervision from a dynamic staggered queue of models at different training stages. We further introduce asymmetric dual projection for complementary alignment in visual and linguistic spaces and an uncentered second-order moment objective that retains mean-related cross-modal information. Experiments on Flickr30K and MS-COCO demonstrate consistent retrieval improvements over existing methods across synthetic-data budgets. With only 100 synthetic pairs, MDA-DD improves IR@1 and TR@1 on Flickr30K by 12.9 and 18.2 percentage points, respectively, over the strongest baseline at the same budget, outperforming all compared methods using 500 pairs on both datasets across all six retrieval metrics.
66. 【2611.16417】VBot Exo2Ego Policy: Lightweight Data Collection and Exocentric-to-Egocentric Video Generation
链接：https://arxiv.org/abs/2611.16417
作者：Tong Rao,Zhihao Zhang,Yuntian Wang,Siyu Zhou,Hailong Qin,Yinan Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：abundant real-world footage, first-person operation data, turns third-person videos, expand first-person operation, present VBot
备注： 27 pages, 11 figures
点击查看摘要
Abstract:We present VBot Exo2Ego Policy, a video generation model that turns third-person videos into first-person observations of a selected actor, offering a practical way to expand first-person operation data from abundant real-world footage. To support this goal, we introduce a lightweight data collection pipeline and mobile app that support first-person recording, third-person recording, and synchronized capture of both views. This setup combines accessible single-view collection with paired RGB and camera geometry for learning cross-view correspondence. Building on a pretrained video diffusion transformer, our model incorporates geometric guidance and auxiliary supervision from semantic masks and hand keypoints to facilitate optimization and improve the fidelity of hand-object interactions. Camera geometry is injected stochastically during training and gradually removed, allowing inference without target-camera calibration. To accommodate the diversity of Internet videos, we combine source-video perception and reasoning, optional actor references, and multi-shot adaptation to identify the intended actor and follow an operation across camera cuts. The collection system and generation model provide a foundation for expanding first-person operation data across tasks, scenes, and participants.
67. 【2611.16413】RICapBench: A Fine-Grained Visual Understanding Benchmark Dataset for Vision-Language Models in Remote Sensing
链接：https://arxiv.org/abs/2611.16413
作者：Xue Wang,Yubin Xu,Kun Tan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Advances in vision-language, supported geospatial decision-making, sensing image analysis, remote sensing, instance localization
备注： 13 pages, 4 figures, 2 tables
点击查看摘要
Abstract:Advances in vision-language models (VLMs) have improved remote sensing image analysis and supported geospatial decision-making. However, fine-grained understanding of remote sensing imagery remains challenging for VLMs. Large variations in object scale, complex geospatial relations among instances, and limited visual detail hinder precise instance localization, visible attribute identification, and spatial relation understanding, potentially leading to descriptions that lack visual grounding. Existing datasets and benchmarks insufficiently assess end-to-end instance localization and captioning without target-specific textual cues. To support this evaluation, we introduce RICapBench, a dataset and benchmark that unifies instance localization and fine-grained captioning in remote sensing. RICapBench contains 245,466 instance-level annotations and 498,005 spatial relation tuples spanning general remote sensing, UAV remote sensing, and dense small-object scenarios. Each annotation pairs an object's oriented bounding box with a natural language description of its visible attributes and spatial relations to surrounding instances and environmental elements. To evaluate the accuracy and completeness of spatial relation captioning, we propose a remote sensing spatial relation parser and the RelCap-F1 metric. We combine RelCap-F1 with instance localization and attribute captioning metrics into a composite metric, RICScore. Our evaluation of 15 advanced open-source and closed-source VLMs identifies instance localization as a major bottleneck for these models. LocateAnything achieves the highest RICScore of 31.68, but scores lower on spatial relation captioning than other task-fine-tuned open-source VLMs. Code and dataset are available at this https URL.
68. 【2611.16408】Gravity and Flight: Learning to Navigate Fine-Grained Remote Sensing Scenes
链接：https://arxiv.org/abs/2611.16408
作者：Yuheng Zong,Minghua Wang,Xin Zhao,Xiaobin Liu,Yongjian Dong,Chanho Eom
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：complex remote sensing, remote sensing scenes, Transfer Policy Optimization, Relational Transfer Policy, increasingly capable
备注：
点击查看摘要
Abstract:Vision-language models are increasingly capable, yet their reasoning in complex remote sensing scenes can remain coarse-grained and insufficiently grounded in task-relevant visual evidence. We propose Gravity and Flight (GF), a framework for scene specialization with limited supervision that separates visual and reasoning verification while coupling policy updates. It combines Evidence-of-Thought supervised fine-tuning (EoT-SFT) and Relational Transfer Policy Optimization (RTPO). EoT-SFT teaches fine-grained observation and faithful reasoning through description, analysis, and supported conclusions. RTPO independently samples responses to scene-matched image pairs with fine-grained visual differences under a shared task. Its rubric-based verification combines Gravity, which checks visual fidelity and description coverage, and Flight, which takes descriptions as premises to assess evidence use and relations between paired judgments. Their scores and task correctness yield a shared pair-level advantage that couples policy updates from both responses. Using 1,008 demonstrations and 500 training pairs for harbor specialization, GF achieves a mean score of 69.12 across six evaluation sets, exceeding the backbone and supervised initialization by 9.76 and 4.56 points. Matched controls show gains over single-image and joint-input RL, and removing either verification view reduces performance. Applying GF to urban specialization also improves on the base model and supervised initialization across three evaluation subsets. Project details and updates are available at this https URL.
69. 【2611.16402】ach with Blinks: Breaking Linguistic Momentum in On-Policy Distillation for Fine-Grained Multimodal Perception
链接：https://arxiv.org/abs/2611.16402
作者：Tangzheng Lian,Hang Zhang,Guanyu Hu,Renjiu Hu,Zhensong Zhang,Jiankang Deng,Jifei Song
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, amortizing costly inference-time, costly inference-time zooming, inference-time zooming operations, effective post-training approach
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) has emerged as an effective post-training approach to improving fine-grained perception in multimodal large language models by amortizing costly inference-time zooming operations into a single-pass recipe. However, vanilla OPD is inherently susceptible to linguistic momentum: the teacher can follow the student's erroneous prefixes, thus weakening corrective supervision. To address this, we propose Blink On-Policy Distillation (BlinkOPD), in which the teacher "blinks" at every token: it reads the same prefix once with its eyes open and once with its eyes closed. A first-glance gain further strengthens the correction on rollouts that conflict with the teacher. By extracting more effective supervision from each on-policy trajectory, BlinkOPD achieves state-of-the-art average performance across six fine-grained benchmarks using only 500 training images (12x less data) than existing OPD methods. Beyond fine-grained perception, BlinkOPD also demonstrates strong zero-shot improvements across ten held-out benchmarks spanning general visual perception, visual hallucination, and multimodal reasoning abilities. Code: this https URL
70. 【2611.16400】FuGIBench: Evaluating Reliable Preparation in Streaming Video
链接：https://arxiv.org/abs/2611.16400
作者：Changheng Cai,Zhichao Huang,Song Ren,Zhichen Zhao,Hongsen Liu,Chaoyang Zheng,Wenxi Wu,Yuan Fang,Wei Wang,Yang Wang,Yuchen Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：http URL, assistant watching, ready to receive, receive this http, watching a worker
备注：
点击查看摘要
Abstract:An assistant watching a worker can prepare for an emerging need before the worker is ready to receive this http URL the need evolves, the assistant must maintain preparation until a response is due, or withdraw it if the need disappears. Video anticipation and interactive response benchmarks leave this interval between early evidence and response largely unmeasured. We introduce FuGIBench (Future-Grounded Interaction), a streaming-video benchmark in which a model chooses among waiting, reversible preparation, and response given a causal video prefix and a task contract. The benchmark contains 19,893 synthetic tool-assistance videos across ten tool tasks, in handover, ordinary-activity, and cancelled-need tracks. One primary score credits sustained preparation, incorporates response-interval alignment, and penalizes activity when the reference prescribes waiting. On a frozen set of 1,000 episodes, a reference system with a longer preparation lead has poorer response alignment, while similar handover leads accompany different levels of activity during ordinary work in matched scenarios. Together with cancellation analyses, these results show why evaluating preparation requires tracking decisions as needs develop, become actionable, or disappear.
71. 【2611.16393】ransXplainRRG: A Radiologist-Evaluated LVLM for Chest Radiograph Report Generation
链接：https://arxiv.org/abs/2611.16393
作者：Chayan Mondal,Duc-Son Pham,Tele Tan,Ashu Gupta,Vincent T.Y. Tiong,Shreya Ghosh,Tom Gedeon
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Large Vision-Language Models, overlook workflow integration, X-ray report generation, Recent advancements, advancements in Large
备注： 17 pages, 6 figures, 11 tables
点击查看摘要
Abstract:Recent advancements in Large Vision-Language Models (LVLM) enhance X-ray report generation, but often neglect clinical context, overlook workflow integration, and lack explainability, which hinders clinical adoption due to interpretability and reliability concerns. This paper addresses the dual challenges of performance and expert explainability in automated X-ray report generation for clinical AI applications. Our proposed approach, TransXplainRRG, utilises an off-the-shelf Swin Transformer model along with a transformer-based text encoder that incorporates patient medical history to generate a radiology report. Further, we explore an expert-guided `inside-out' approach and extract only abnormal findings for radiology report refinement. Thus, this study bridges the gap between high-performance automation and interpretability critical for clinical practice by combining state-of-the-art transformer-based vision encoders, text encoders, and LLMs. TransXplainRRG is trained and tested on the large-scale MIMIC-CXR dataset and further evaluated on the unseen IU X-Ray dataset to demonstrate its generalizability and robustness. We employed the GREEN metric as a complementary measure of clinical consistency, achieving scores of 0.327 on MIMIC-CXR and 0.605 on IU X-Ray, both higher than those achieved by MAIRA-2 under the same evaluation setting. It also performed competitively across standard evaluation metrics, frequently matching or surpassing state-of-the-art models. Additionally, we introduce qualitative evaluation metrics developed from radiologists' viewpoints and conduct a preliminary radiologist evaluation on 100 generated reports to assess their clinical relevance. Quantitative and qualitative analyses further demonstrate the potential of our TransXplainRRG framework for reliable and explainable radiology report generation.
72. 【2611.16382】RADIANT: Redundancy-Aware Information Allocation for Universal Multi-Modal Fusion
链接：https://arxiv.org/abs/2611.16382
作者：Shenghai Wu,Yue Lin
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Universal multi-modal fusion, allocates information poorly, process allocates information, Universal multi-modal, Redundancy-Aware Dynamic Information
备注： 9 pages, 4 figures. Published in ACM Multimedia 2026 (MM '26). Code: [this https URL](https://github.com/StevenWSH27/RADIANT)
点击查看摘要
Abstract:Universal multi-modal fusion often fails not because modalities are insufficiently aligned, but because the fusion process allocates information poorly: redundant evidence is repeatedly amplified, modality-unique evidence is over-smoothed during alignment, and task-dependent synergistic evidence is insufficiently activated. We present RADIANT (Redundancy-Aware Dynamic Information Allocation Network), a task-general framework that organizes fusion around three complementary roles: suppressing redundant cross-modal overlap, preserving modality-unique evidence, and composing task-conditioned synergy through cross-modal interaction. Specifically, stable matrix-exponential projections are used to reduce interference among shared and modality-unique streams, while task memory with hard positive updates selects which synergistic interactions should be activated for the current fusion regime. Extensive experiments across six heterogeneous fusion tasks show consistent improvements over the compared methods. On FLIR, RADIANT improves downstream detection mAP@0.5 from 91.2% to 96.8%, a gain of 5.6 percentage points (6.1% relative) over GIF. RADIANT also exhibits strong direct cross-dataset transfer, with further gains from inference-time task-memory adaptation while keeping all network weights frozen. Additional ablations and sensitivity studies support the robustness of the allocation mechanism.
73. 【2611.16373】Description-Guided CLIP Adaptation with Local Evidence Calibration for Few-Shot Plant Disease Recognition
链接：https://arxiv.org/abs/2611.16373
作者：Zhenkun Ye,Qian Zhou,Hua Zou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：provide limited labeled, limited labeled samples, Accurate plant disease, settings provide limited, capture diagnostic symptoms
备注：
点击查看摘要
Abstract:Accurate plant disease recognition is essential for intelligent agriculture, but few-shot settings provide limited labeled samples that may not capture diagnostic symptoms and intra-class variations. Pretrained vision-language models (VLMs), such as CLIP, offer transferable visual-semantic knowledge. However, existing CLIP-based methods often rely on coarse class semantics and global visual representations, overlooking disease-specific diagnostic information and fine-grained local cues. Excessive few-shot adaptation may also cause over-specialization and weaken the generalization ability of large-scale pre-training. We propose a description-guided, two-stage CLIP adaptation method to address these issues. Symptom and comparative descriptions enrich class semantics with typical visual symptoms and discriminative cues between similar diseases. The enhanced semantics guide the aggregation of class-relevant patch evidence to calibrate global image-text matching with fine-grained cues. For adaptation, we first update the vision-language encoders with lightweight parameters, then freeze them and train a linear classifier. At inference, the classifier is used for in-domain prediction, while class prototypes from the adapted text encoder support cross-domain prediction and retain vision-language transferability. Experiments with two backbones show that our method achieves the highest mean accuracy in most few-shot settings on PlantVillage, Cassava, and Pear, reaching 93.16%, 79.30%, and 96.56%, respectively, with ViT-L/14 under 16-shot. On class-aligned cross-domain evaluation across 21 shared PlantDoc classes, it achieves 56.96% accuracy, outperforming all compared methods. These results demonstrate its effectiveness in fine-grained few-shot plant disease recognition and cross-domain generalization.
74. 【2611.16368】ReliaGuard: Reconstruction-Aware Watermarking for Source Attribution and Blind Edit Localization
链接：https://arxiv.org/abs/2611.16368
作者：Hailong Wang,Wuzheng Tan,Zixin Zhang,Xujun Fang,Fengjuan Gong
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)
关键词：facilitates content creation, Generative image editing, editing facilitates content, complicates source attribution, Generative image
备注：
点击查看摘要
Abstract:Generative image editing facilitates content creation but complicates source attribution and edit verification. Existing watermarking methods combine copyright protection with tamper localization, yet background reconstruction can weaken spatial evidence even when source identifiers remain recoverable. We propose ReliaGuard, a reconstruction-aware watermarking framework for source attribution and blind edit localization. The writer optimizes keyed feature responses in both the protected image and its variational autoencoder reconstruction under image-distortion and source-preservation constraints. Using only the received image and a secret key, the reader combines watermark responses with local image context through residual evidence refinement and predicts an edit mask through native-resolution-guided multiscale reading. It is trained on complete editing outputs, locally spliced counterparts, and processed versions of both. On an independent test set of 300 source images and 900 editing cases from three image domains, our method achieves edit-region intersection-over-union scores of 85.61% for complete outputs and 94.90% for locally spliced outputs at a threshold calibrated to a nominal 1% background false-positive rate on complete outputs. The complete-output result exceeds the strongest baseline by 45.02 percentage points, while decoded identifier-bit accuracy reaches 100% in both conditions. Across seven families of image processing, the corresponding localization scores are 81.01% and 86.49%, with identifier-bit accuracies of 92.76% and 92.79%, respectively. These results support source recovery and blind edit localization under background reconstruction and subsequent image processing.
75. 【2611.16339】Hand in Silhouette: Synthetic-to-Real Multi-View Hand Reconstruction via Binary Masks
链接：https://arxiv.org/abs/2611.16339
作者：Leiyao Cui,Lecheng Ruan,Zihang Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：existing methods depends, methods depends strongly, Calibrated multi-view hand, advanced rapidly, costly to acquire
备注： Project page: [this https URL](https://silhand26.github.io)
点击查看摘要
Abstract:Calibrated multi-view hand reconstruction has advanced rapidly, yet the effectiveness of existing methods depends strongly on real captured data, which is costly to acquire, limited in hand-geometry diversity, and often affected by imperfect annotations. Synthetic data offers a scalable alternative with accurate supervision, but a substantial synthetic-to-real appearance gap hinders its use. To address this, we introduce Hand in Silhouette (SilHand), a calibrated multi-view hand reconstruction framework that operates on binary hand masks, obtainable at low cost either automatically or manually, to reduce the synthetic-to-real observation gap. Rather than relying on RGB features for 3D lifting, SilHand projects metric 3D hypotheses into each view to query and fuse mask-ray evidence for hand reconstruction. This mask-centric formulation enables training on a large-scale synthetic dataset comprising 46.8k grasping poses and 60k free-hand samples, providing broad coverage of hand geometry while directly transferring to real captured hand geometry. Across five real-world benchmarks, SilHand improves relative reconstruction accuracy from 49.2% to 63.4% using masks rendered from reference hands. Moreover, reconstruction accuracy improves consistently as the synthetic training set grows, indicating that broader geometric coverage translates into better real-world performance. While achieving such diversity is difficult with real captured data, it becomes practical under our mask-centric formulation. Finally, SilHand remains robust under mask corruption, with reconstruction error increasing by at most 1.63 mm. Together, these results support binary masks as an effective interface for learning hand reconstruction from synthetic geometry.
76. 【2611.16310】Selective Generative Restoration for Video Deraining via Uncertainty-Aware Diffusion
链接：https://arxiv.org/abs/2611.16310
作者：Yi'ang Chen,Han Li,Laibin Chang,Hui Liu,Kui Jiang,Junjun Jiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：atmospheric effects, challenging due, Video deraining, generative, restoration
备注：
点击查看摘要
Abstract:Video deraining is challenging due to rain streaks, occlusions, and atmospheric effects. Existing methods mainly follow a deterministic restoration paradigm, assuming that clean scenes can be uniquely recovered from rainy observations. However, rain degradation is spatially heterogeneous. Reliable regions require faithful reconstruction, whereas severely occluded regions contain ambiguous content that require stronger prior-driven inference. Therefore, conventional deterministic restoration often produces over-smoothed results, while global generative restoration may introduce unnecessary hallucinations. We introduce a Selective Generative Restoration paradigm for video deraining, where generative priors are adaptively activated according to restoration uncertainty. Based on this principle, we propose Selective Generative Video Deraining (SGVD), an uncertainty-aware diffusion framework that enables adaptive fidelity preservation and generative recovery. Specifically, SGVD exploits stochastic diversity between dual one-step diffusion predictions to estimate region-level restoration uncertainty, which determines where observation fidelity should be preserved and where generative inference should be activated. Furthermore, an anchor-guided trajectory consistency mechanism is proposed to regularize stochastic diffusion evolution across frames, reducing temporal generation drift and improving video coherence. To achieve practical efficiency, SGVD adopts one-step diffusion inference while maintaining uncertainty-aware generative capability. Extensive experiments demonstrate that SGVD achieves superior restoration performance, perceptual quality, and temporal consistency compared with state-of-the-art video deraining methods.
77. 【2611.16307】DEDCA: Test-Time Adaptation for Generalized AI-Generated Image Detection
链接：https://arxiv.org/abs/2611.16307
作者：Hao Tan,Qimin Zhang,Lihuang Fang,Kebing Jin,Jinghui Qin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：source training distribution, face significant challenges, detectors face significant, real-world environments, training distribution
备注：
点击查看摘要
Abstract:AI-generated image detectors face significant challenges when deployed in real-world environments, particularly when test samples are produced by unseen generators that deviate from the source training distribution. Existing detectors often rely on a single type of evidence, such as semantic representations or low-level generation traces, making them vulnerable when the corresponding cue becomes unreliable. Moreover, adapting detectors to newly emerging generators usually requires target labels or retraining, which is costly and impractical. To address these challenges, we propose Dual-Evidence Disagreement-Constrained Adaptation (DEDCA), a test-time adaptation framework for generalized AI-generated image detection. DEDCA constructs a dual-evidence detector by combining CLIP-based semantic evidence with trace evidence extracted from shuffled entropy and residual statistics, and introduces a reliability-aware gate to perform sample-specific adaptive fusion. Our key idea is to exploit the disagreement between the two evidence streams as an unlabeled adaptation signal, enabling the detector to adjust to target-domain shifts without relying on target labels or blindly trusting a single prediction stream. Experiments show that DEDCA achieves superior performance on the GenImage benchmark by outperforming state-of-the-art AI-generated image detectors and test-time adaptation methods with 92.0\% average accuracy.
78. 【2611.16269】FlowIR: Depth-driven Rectified Flow for Resolving Thermal Ambiguity in Infrared Super-Resolution
链接：https://arxiv.org/abs/2611.16269
作者：Xingyue Zhu,Qinyun Mei,Zhexi Min,Yang Zou,Xingyuan Li,Zhiying Jiang,Jinyuan Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Distinguishing different heat, multiple thermal emitters, inherently difficult, heat sources, sources in low-resolution
备注： Accepted to the 2026 IEEE International Conference on Multimedia Expo (ICME 2026)
点击查看摘要
Abstract:Distinguishing different heat sources in low-resolution infrared (IR) images is inherently difficult, as multiple thermal emitters often collapse into ambiguous and overlapping responses. Existing super-resolution methods hallucinate structures from such ambiguous 2D evidence, leading to thermal drift, boundary merging, and unreliable restoration under infrared degradations. We propose FlowIR, a depth-driven rectified flow framework that resolves thermal ambiguity by injecting 3D geometric cues into the generation process. Pseudo-3D depth lifting and depth-guided 3D convolutions disentangle overlapping foreground objects, while cluster-wise inter-attention suppresses cross-source feature contamination. A Thermal-Geometry Consistency Loss further enforces geometric alignment during refinement. Built upon a lightweight rectified flow backbone, FlowIR restores IR images in only a few steps, producing sharply separated, degradation-robust, and geometrically faithful high-resolution results.
79. 【2611.16259】Reconstruct What You Can: Distractor-free 4D Gaussian Splatting
链接：https://arxiv.org/abs/2611.16259
作者：Joel Julin,Liuyue Xie,Ananya Bal,Mose Sakashita,Koichiro Niinuma,Laszlo A. Jeni
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：preserve valid subject, suppressing transient occluders, valid subject motion, volumetric effects, casual video
备注： Accepted at WACV 2027
点击查看摘要
Abstract:Dynamic reconstruction from casual video must preserve valid subject motion while suppressing transient occluders, shadows, and volumetric effects. Existing methods either suppress valid motion through static-scene assumptions or model all observations jointly, producing ghosting and unstable geometry. We introduce ReCan-GS, a 4D Gaussian Splatting framework that separates coherent scene content from inconsistent observations. It derives a Jacobian-based deformation-sensitivity score from the learned deformation field, using it as an empirical proxy for reconstruction ambiguity. The score guides separation into dynamic Core Gaussians and per-view Distractor Gaussians, or post-hoc pruning of sensitive Core Gaussians. The same criterion supports removal of spatial occluders, photometric artifacts, and evolving smoke or fog without masks, pretrained segmenters, or medium-specific supervision. Experiments on synthetic and real dynamic scenes and synthetic smoke/fog scenes demonstrate its usefulness across the evaluated distractor regimes.
80. 【2611.16236】ATune: Unsupervised Photo Retouching Through Image-Editor Controls
链接：https://arxiv.org/abs/2611.16236
作者：Divyanshu Goyal,Gabriel Ruiz,Amir Meisami
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：edit, Pixabay and Unsplash, photograph, photographs, retouched photographs
备注： 27 pages, 12 figures, 18 tables. Main paper 8 pages plus supplementary material
点击查看摘要
Abstract:Photo retouching models are trained on pairs of original and retouched photographs, usually edited by experts. Expert edits are costly, so the two main public sets, FiveK and PPR10K, hold only 16,161 originals. Good photographs on their own are far easier to find: commercial stock collections and free ones such as Pixabay and Unsplash hold millions. We learn retouching from them alone: we damage each photograph the way a camera or a careless edit would, which gives a worse and a better version of the same photograph. From these pairs, our model, ATune, learns how 13 measured attributes, such as brightness, contrast and sharpness, should change to raise a photograph's quality. The edit is declarative: ATune sets target values for the attributes, and a simple search adjusts the sliders of an out-of-the-box photo editor until the photograph reaches them. Every edit is a list of slider values a person can read and adjust. The same model can drive any editor that makes those changes; we test RawTherapee and darktable. We train on 10M photographs from a commercial stock collection and test on FiveK, PPR10K and SPAQ. Nine quality judges score every edit, and in a user study 157 human raters made 9,253 choices between our edit and another method's edit of the same photograph. When Claude Opus 5 and GPT-6 Astra edit the same photographs in the same editor, raters prefer our edits to GPT-6 Astra's (54.3%) and rate them even with Claude's (50.5%). We also compare with supervised retouchers on their home ground: NeurOP on FiveK and AdaInt on PPR10K, each trained on that set's own expert edits. Raters chose our edits in 46.3% of those comparisons. ATune, a 54M-parameter model trained without a single expert edit, now matches frontier models at setting an editor's sliders.
81. 【2611.16224】Disentangled Embedding Optimization for Diffusion-Based Dataset Distillation
链接：https://arxiv.org/abs/2611.16224
作者：Hongcheng Li,Yucan Zhou,Yibin Wang,Xiaoyan Gu,Bo Li,Weiping Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enable efficient model, efficient model training, Dataset distillation aims, compress large-scale datasets, compact synthetic subsets
备注： 10 pages, 7 figures. Accepted at the 34th ACM International Conference on Multimedia (ACM MM 2026)
点击查看摘要
Abstract:Dataset distillation aims to compress large-scale datasets into compact synthetic subsets that enable efficient model training with comparable performance to the original data. Recent advances show that diffusion models are highly effective for this task due to their strong generative capability. Existing diffusion-based approaches typically perform class-wise clustering and use the obtained cluster prototypes as diffusion inputs to generate distilled samples. However, the uniformly distributed original samples in a category inevitably lead to entanglement near cluster boundaries, pulling the cluster prototypes closer and reducing the inter-cluster separation. Consequently, the diffusion model receives overly similar latent inputs, resulting in synthetic data with limited diversity. To address this issue, we propose Disentangled Embedding Optimization (DEO), a simple yet effective framework that replaces static clustering with trainable embeddings. These embeddings are optimized to match the Gaussian statistics (i.e., mean and covariance) of the original data distribution, while a diversity regularizer is designed to encourage separation among these embeddings to improve the intra-class variability. Extensive experiments demonstrate that our proposed DEO can generate more diversified and representative distilled data than existing cluster-based diffusion methods, achieving state-of-the-art performance and superior generalization across multiple datasets.
82. 【2611.16217】WorldDraft: If Code Builds the World, Can Video Models Just Render It?
链接：https://arxiv.org/abs/2611.16217
作者：Zhiyu Hou,Wen-Jie Shu,Harold Haodong Chen,Weilin Ruan,Chenfei Liao,Liuzhou Zhang,Disen Lan,Xiaogang Xu,Qi Chen,Ser-Nam Lim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal coding agents, coding agents decouple, Multimodal coding, agents decouple, coding agents
备注： Project: [this https URL](https://haroldchen19.github.io/WorldDraft-site/)
点击查看摘要
Abstract:Multimodal coding agents decouple 4D world construction from visual generation, repurposing video models from world generators toward generative renderers. This division of labor raises a fundamental question: if code builds the world, can video models just render it? A reliable generative renderer hinges on two complementary criteria: (i) world preservation, retaining prescribed 4D kinematics and camera paths; and (ii) visual realization, persistently binding text-specified target attributes over time. To evaluate this capability, we introduce WorldDraft, a benchmark of $432$ strictly paired test cases across $48$ executable 4D world families spanning six dynamic challenge categories. Under a $3 \times 3$ factorial design, WorldDraft orthogonally crosses draft granularity (abstract proxy to previs) and appearance alignment (neutral to conflicting) under identical dynamics. Extensive evaluations across $12$ representative models reveal that: (I) world preservation and visual realization remain in stark operational tension; (II) richer draft scaffolding anchors structure but paradoxically impairs appearance fidelity; and (III) conflicting source cues trigger severe source leakage (up to $64\%$), exposing fragile cross-modal disentanglement. To mitigate these bottlenecks, we propose WorldDraft-Primer, a plug-and-play visual prompting strategy that consistently improves both objectives across frozen video renderers. Together, WorldDraft and WorldDraft-Primer lay a foundation for bridging programmatic 4D simulation with video generation, advancing physically grounded generative rendering.
83. 【2611.16212】SPEM: Scan-Prior Entropy Modeling for LiDAR Point Cloud Compression
链接：https://arxiv.org/abs/2611.16212
作者：Bojun Liu,Yangzhi Ma,Jie Li,Dong Liu,Li Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：point clouds exhibit, clouds exhibit scan-induced, exhibit scan-induced spatial, LiDAR point clouds, point clouds
备注：
点击查看摘要
Abstract:LiDAR point clouds exhibit scan-induced spatial regularities that are informative for geometry compression. Existing scan-aware approaches often exploit these regularities by transforming coded geometry into spherical or beam-aligned coordinate systems. However, this couples acquisition priors with geometry representation, altering spatial partitioning and quantization, and potentially preventing exact recovery of the original Cartesian geometry. We argue that acquisition priors should guide probability modeling rather than dictate the coding representation. We propose SPEM, a Scan-Prior Entropy Modeling framework that exploits LiDAR scanning regularities within the entropy model without requiring coordinate transformation. We introduce a multi-frequency spherical rotary positional encoding that captures scan-aligned spatial relationships in both backbone self-attention and decoded-context retrieval. Building upon this encoding, we develop a decoded-memory autoregressive predictor that efficiently exploits previously decoded occupancy information through reusable key/value caches. Experiments demonstrate state-of-the-art performance in both lossy and lossless LiDAR geometry compression, highlighting the effectiveness of scan-prior modeling across different coordinate representations.
84. 【2611.16162】GOOSELoc: A Multimodal Benchmark for Ground-to-Aerial Localization in Unstructured Off-Road Terrain
链接：https://arxiv.org/abs/2611.16162
作者：Fabian Deuser,Peter Mortimer,Robin-Nico Kampa,Anna Bößendörfer,Mirko Mählisch,Martin Werner,Norbert Oswald
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pose estimation estimates, camera geographic pose, ground camera geographic, matching onboard sensor, Cross-view pose estimation
备注：
点击查看摘要
Abstract:Cross-view pose estimation estimates a ground camera's geographic pose by matching onboard sensor data with geo-referenced overhead imagery. This is particularly relevant when GNSS is unreliable, for example under forest canopy or in urban canyons. Existing metric cross-view benchmarks, such as VIGOR and cross-view KITTI, are dominated by urban and road scenes with strong human-made structure without off-road terrain. We introduce GOOSELoc, a multimodal benchmark for ground-to-aerial localization in unstructured environments, including forests, fields, and rural tracks. GOOSELoc comprises 9,356 scenes recorded across all four seasons around Munich, Germany, pairing geo-referenced aerial orthophotos with surround-view RGB imagery and 3D LiDAR point clouds. Paved/unpaved labels enable analyzing the impact of terrain structure, while the seasonal recordings allow studying the appearance gap to mostly summer-captured orthophotos. To assess the transferability of existing methods, we adapt and fine-tune four state-of-the-art cross-view localization baselines on GOOSELoc. Despite task-specific fine-tuning, the performance degrades substantially in off-road environments. We therefore propose a multimodal baseline combining surround-view imagery and LiDAR geometry, improving localization performance and providing a stronger reference for future work. Data and baselines are released at this https URL.
85. 【2611.16126】Split-and-scale Latent 3D Representations
链接：https://arxiv.org/abs/2611.16126
作者：Dorian Chan,Muhammed Kocabas,Xiaoming Zhao,Oncel Tuzel,Jen-Hao Rick Chang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enabling compact encoding, modern shape modeling, enabling compact, supporting powerful, latent capacity
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:Latent 3D representations have significantly expanded the capabilities of modern shape modeling, enabling compact encoding of 3D scenes and supporting powerful 3D generative models. Despite this progress, current representations struggle to capture the fine details of complex objects, fundamentally limited by the capacity of their latents. However, scaling latent capacity at training time is computationally expensive and often infeasible under memory limits, and naively increasing the number of latents at inference fails to make effective use of the added capacity. In this paper, we address both challenges with \textit{split-and-scale}, a method that effectively expands latent capacity at inference while keeping training cost tractable. Our key observation is that by representing 3D scenes as continuous functions of 3D coordinates, a single pretrained tokenizer can be applied at inference to arbitrarily small sub-regions of a scene, allocating the same latent capacity to a smaller spatial extent and thus capturing far higher detail. We validate this insight by conducting extensive ablations to study the trade-offs between compute, memory, latent capacity, and reconstruction quality, demonstrating our inference-time scaling method achieves quality competitive with much larger models that exceed single-GPU memory limits. We further demonstrate that split-and-scale supports high-quality generative modeling, training an autoregressive 3D generator that performs competitively with state-of-the-art baselines.
86. 【2611.16061】Pothole Risk Assessment with Geometrically Grounded Vision Language Models
链接：https://arxiv.org/abs/2611.16061
作者：Abdalmalek Aburaddaha,Zaid A. El Shair,Ali Al-Bustami,Samir A. Rawashdeh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Potholes impose billions, annual vehicle damage, impose billions, billions of dollars, dollars in annual
备注： 22 pages, 8 figures, 17 tables. Submitted to IEEE Access. Code and data: [this https URL](https://github.com/malekaburaddaha/Pothole_Assessment_Pipeline)
点击查看摘要
Abstract:Potholes impose billions of dollars in annual vehicle damage, yet detectors report only where potholes are, not how severe they are or what to do. Judging severity from a single RGB image is ill-posed, and ungrounded vision-language model (VLM) assessments tend to be over-conservative. We present a five-stage modular framework for the offline assessment of already-detected potholes that combines geometric measurements with VLM reasoning: perspective transformation, zero-shot SAM segmentation, geometric feature extraction, Gemini 2.5 Pro severity classification with composite risk scoring, and natural-language warning generation. We evaluate it on 3,092 potholes in 1,119 dashcam scenes against independent references. Severity agreement with a prediction-free three-annotator panel is weak (Cohen's $\kappa = 0.139$, 95% CI [0.00, 0.28]; $n = 101$) and far below the annotators' agreement with one another ($\kappa = 0.605$); against physically measured depth on an independent RGB-D dataset, it is also weak ($\kappa = 0.098$), although the predicted classes preserve the order of measured depths. The severity classes are therefore perceived visual categories, not depth measurements. Geometric grounding does change the warnings: relative to an image-only baseline, it moves 26.7% of scenes out of the high-urgency tier and raises critical-tier assignments by 109% (Stuart-Maxwell $p 10^{-15}$), and in a blind study, three raters preferred the grounded warnings 3.5:1. A six-arm prompt ablation attributes the hybrid prompt's rule adherence to the per-pothole measurements rather than to the rubric or worked examples. At USD 0.105 per scene, it suits large-scale offline infrastructure assessment; its maneuver suggestions are advisory research outputs, not validated vehicle guidance.
87. 【2611.16056】Sub-actions in Action: Text-Guided Hand-Role Alignment for Sub-Action Recognition
链接：https://arxiv.org/abs/2611.16056
作者：Sadegh Rahmaniboldaji,Filip Rybansky,Quoc Vuong,Frank Guerin,Andrew Gilbert
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enhance VLMs ability, enhance VLMs, VLMs ability, ability to distinguish, ongoing high-level action
备注： Accepted at BMVC 2026, Supplementary material is available
点击查看摘要
Abstract:Our objective is to enhance VLMs ability to distinguish the roles of the left and right hands in egocentric actions. We introduce sub-action detection, a task that requires models to explicitly recognise the left- and right-hand roles and their manipulated objects within an ongoing high-level action. To address this challenge, we propose BiScopeNet, a framework that augments existing video-LLMs without modifying their vision encoders or language models. BiScopeNet incorporates two components: FocusAlign, a gated text-guided attention-based module that selectively aligns video features with textual context to emphasise action-relevant cues, and MetaLoss, a masked, object-weighted loss that prioritises visually grounded terms. To supervise sub-action detection, we introduce BiScopeCap-100K, a large-scale video-level dataset curated from existing egocentric datasets, providing dense captions that jointly describe high-level actions, left/right-hand roles, and manipulated objects, enriched with spatial metadata for grounding. Across the evaluated Video-LLM backbones, BiScopeNet improves action, hand-role, and object recognition over the corresponding supervised baselines, achieving the strongest aggregate performance among the evaluated configurations on BiScopeCap.
88. 【2611.16012】opology-Aware 4D Gaussian Splatting for Egocentric Videos
链接：https://arxiv.org/abs/2611.16012
作者：Leonardo Vanni,Stefano Gasperini,Federico Tombari,Chiara Plizzari
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reconstructing dynamic scenes, everyday interactions involving, Reconstructing dynamic, interactions involving topological, Gaussian Splatting
备注： Project page: [this https URL](https://topoego.github.io)
点击查看摘要
Abstract:Reconstructing dynamic scenes and objects from monocular egocentric video is crucial for embodied AI, yet existing 4D Gaussian Splatting (4DGS) approaches struggle with everyday interactions involving topological changes, such as cutting, assembly, opening, or closing. Since 4DGS methods rely on deforming a fixed representation, events that split, merge, or reveal surfaces cause severe visual artifacts. To address this challenge, we introduce TopoEgo, the first benchmark dedicated to topological changes in egocentric video (covering fission, fusion, open, and close), alongside Topo-4DGS, a topology-aware reconstruction method. Topo4DGS jointly models part-level motion and time-varying surface support by assigning independent rigid transformations to interacting parts and dynamically activating or deactivating Gaussians as surfaces appear, disappear, or separate. Extensive experiments demonstrate that Topo-4DGS significantly outperforms state-of-the-art 4DGS approaches across topological changes, especially on post-event frames. Code and data will be made publicly available.
89. 【2611.16010】Iris-Z: Scaling One Generative Model Past Specialist Geometry Models
链接：https://arxiv.org/abs/2611.16010
作者：Alejandro Cañada,Chema Garabito
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Language moved, parameters and compute, improving with data, generative training task, single generative training
备注： 14 pages, 9 figures, 6 tables. Code and models: [this https URL](https://github.com/speridlabs/iris-z-sdk)
点击查看摘要
Abstract:Language moved from many task-specific models to one unified model: a single generative model with a single generative training task that handles all of them within the same backbone, and keeps improving with data, parameters and compute. We believe the bitter lesson applies just as much to computer vision, 3D and spatial understanding, in the end to visual intelligence: the effort should go into general architectures that solve all these tasks in a unified way, and into scaling them, rather than into task-specific designs. We test this on monocular geometry, a task that has belonged to specialised architectures for years. Iris-Z is a general image generator that produces appearance and geometry together. A single backbone denoises, reasons about and understands the image and its depth at the same time, and one set of weights generates images with their depth, estimates depth from photographs and paints images onto a given depth. At enough scale it surpasses state-of-the-art specialists on established depth benchmarks while keeping the generative abilities of the backbone it started from without specialized layers. We release two models for the community.
90. 【2611.16000】Predicting the Needle in a Petabyte Scale Haystack: Open-Vocabulary Event Anticipation in Satellite Imagery
链接：https://arxiv.org/abs/2611.16000
作者：Shreelekha Revankar,Mikhail Klassen,Creon Levit,Ash Hoover,Kavita Bala,Bharath Hariharan
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：Earth daily, capturing the lifecycle, urban construction, deforestation to urban, Satellite constellations
备注： 29 pages, 9 figures, to be published in NeurIPS 2026
点击查看摘要
Abstract:Satellite constellations now image the Earth daily, capturing the lifecycle of events from deforestation to urban construction. Anticipating these events before completion enables timely intervention, yet existing systems cannot jointly identify where a change occurs, what it will become, and when it will finish across an open vocabulary. Building such a model requires diverse event data, but events are like needles in a haystack, making manual annotation at global scale infeasible. We address this problem by representing change as the vector difference between vision-language model embeddings at distinct time points. This arithmetic approach allows us to search for semantic transformations directly in the latent space, enabling (1) an automated data engine for global event discovery without manual annotation and (2) the largest global satellite event dataset to our knowledge, comprising 21,000+ locations across 64+ event types with ~2M images from PlanetScope and Sentinel-2 spanning six continents, to train (3) a novel global-scale event anticipation model. Our model detects change with a 93.5% max F1 score, outperforms baselines 3.6x on predicted event retrieval, and forecasts completion dates with a 3-day median error, even nine months before completion. Code: this https URL
91. 【2611.15991】Adaptive Distance Detection and Adaptive Instance Segmentation
链接：https://arxiv.org/abs/2611.15991
作者：Kai Yi Ji
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：game Counter Strike, FPS game Counter, Counter Strike, FPS game, game Counter
备注： This is the paper from my Bachelor's degree in University of Birmingham
点击查看摘要
Abstract:This paper is about object detection model and semantic segmentation model in an FPS game Counter Strike: Condition Zero to detect enemies. Semantic segmentation is pixel-wise detection algorithm. We customized the architecture for semantic segmentation. We used YOLOv5s to train object detection model. After training, the inference time of semantic segmentation was compared to object detection. It was observed that object detection was slightly faster and semantic segmentation is slower but better at detecting the exact shape of the object. However, we found out that this slight difference of inference can grow exponentially if the both models get more complex. To solve this, we propose a novel approach called Adaptive distance detection which combines both algorithms. We will also introduce Adaptive instance segmentation to combine semantic segmentation and panoptic segmentation.
92. 【2611.15983】RACE: Trajectory Synchronization for Training-Free Resolution Extension in Video Generation
链接：https://arxiv.org/abs/2611.15983
作者：Libo Zhu,Fan Li,Zhixin Wang,Binglu Wang,Weisheng Dong,Yulun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remain limited, training-free method, high-resolution, TRACE, existing training-free methods
备注：
点击查看摘要
Abstract:More text-to-video models are available, but many remain limited to low resolutions. Training them for higher resolutions is costly, while existing training-free methods still struggle with fine detail, scene structure, and efficiency. We propose TRACE, a training-free method that synchronizes low- and high-resolution generation trajectories. During early denoising, TRACE aligns predicted scene content at corresponding noise levels. It computes high-resolution updates from low-resolution predictions and the current high-resolution state, without high-resolution model inference. The high-resolution trajectory retains fine-grained variation for generating new details. Local window attention then refines fine details in a shared high-resolution latent state. TRACE checks suspected duplicate subjects against the corresponding low-resolution layout and corrects selected regions and their solver history while preserving detail elsewhere. Experiments across all kinds of video generation backbones and resolutions show improved perceptual quality and text-video alignment over FreeSwim, a state-of-the-art training-free method, with 2.0-2.9x end-to-end speedups. Our code and models will be released at this https URL.
93. 【2611.15968】DuoJEPA: Cross-Modal Translation Between Unaligned Self-Supervised Embedding Spaces
链接：https://arxiv.org/abs/2611.15968
作者：Mahmut S. Gokmen,Mitchell A. Klusty,Evan W. Damron,Caroline N. Leach,Samuel E. Armstrong,V.K. Cody Bumgardner
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：modalities is commonly, commonly equated, equated with aligning, embedding spaces remain, shared space
备注：
点击查看摘要
Abstract:Learning from paired modalities is commonly equated with aligning them: two encoders are trained until the embeddings of a pair coincide in a shared space. We study whether cross-modal retrieval and classification can instead be obtained while the two encoders' own embedding spaces remain directly unaligned. DuoJEPA trains one encoder per modality with the self-supervised LeJEPA objective and appends to each encoder a single transformer layer that translates its embedding into the other encoder's space, supervised by a contrastive objective computed entirely within that target space. No loss term compares the two own spaces directly, although the encoders are optimised jointly through the translation objective. In our experiments, the translator's residual connections determine where the cross-modal pressure is absorbed: with a residual translator the two encoders become directly aligned, whereas with a skipless (residual-free) translator a paired-cosine test detects no alignment in the final models, and at most a weak one in the ablations, at comparable cross-modal performance. The learned class-token translation is well approximated by a single scaled rotation of the source space. We evaluate DuoJEPA on two modality pairs that differ in nearly every respect. On chest radiographs and reports from CheXpert Plus, it attains a zero-shot AUC of 86.6 and a cross-modal retrieval score of 78.5, compared with 60.0 and 64.2 for our reimplementation of LeVLJEPA with the same encoders and data. On Sentinel-2 optical and Sentinel-1 radar imagery, the frozen encoders fall within the range of published Sentinel foundation models under our reproduction of the Copernicus-Bench linear-probe protocol, the translator retrieves the paired image of the other sensor among 4,000 candidates in 77-79% of cases, and a patch-level extension transfers the within-image similarity structure of the scene.
94. 【2611.15941】Lang-SVG: Hierarchical Image Vectorization with Language Priors
链接：https://arxiv.org/abs/2611.15941
作者：Xi Liu,Chaoyi Zhou,Run Wang,Jiaang Li,Feng Luo,Junxiang Huang,Siyu Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reconstructs raster images, Image vectorization reconstructs, scalable vector graph, compact scalable vector, editable code representation
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:Image vectorization reconstructs raster images as compact scalable vector graph- ics (SVG), providing a structured and editable code representation of images. However, most existing vectorization methods optimize for pixel-level render- ing fidelity, often producing SVGs that lack alignment with human-perceived object-part hierarchies, making them difficult to manipulate. To address this, we propose Lang-SVG, which introduces an explicit tree structure to organize SVG primitives with semantic labels and parent-child relationships. Lang-SVG incorporates granularity-controllable and open-vocabulary segmentation priors to initialize object-part hierarchies and leverages multimodal large language models (MLLMs) with SVG tree context to assign semantic labels to unlabeled nodes. To reduce redundancy, we introduce depth-adaptive simplification to reduce shape complexity and Tree-Guided Pruning and Merging to eliminate redundant SVG nodes. L1-SAM-Prompting further recovers missing regions to improve recon- struction fidelity and structural completeness. Beyond reconstruction fidelity, we introduce a new evaluation protocol that measures structural quality and semantic part alignment. Experiments demonstrate that Lang-SVG achieves state-of-the-art performance in both rendering fidelity and structural quality. Project website: this https URL.
95. 【2611.15937】MOSAIC: Modular Obstacle and Spatial-Aware Framework for Manipulation In Cluttered Scenes
链接：https://arxiv.org/abs/2611.15937
作者：Richard Shi,Mohammad Mahdavian,Mehrdad Momeni Zadeh,Mohammed Elmahgiubi,Amir Rasouli
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：demonstrated strong performance, leaving scene geometry, language instructions, inferred implicitly, demonstrated strong
备注：
点击查看摘要
Abstract:Vision-Language-Action (VLA) models have demonstrated strong performance in robotic manipulation, yet most rely primarily on 2D visual observations and language instructions, leaving scene geometry and obstacle relationships to be inferred implicitly. This limitation is particularly problematic in cluttered environments, where small spatial errors can lead to unintended contacts or collisions. We propose MOSAIC, a modular spatial- and obstacle-aware framework that can be integrated with pretrained VLA policies to improve object-level scene understanding and action generation. Our method augments the VLA backbone with an auxiliary semantic grounding task that predicts role-specific masks for the target object, destination region, and surrounding obstacles. We further combine the target and destination masks with depth estimated from 3D scene reconstruction to construct role-specific geometric tokens that are injected directly into the action expert. In addition, we propose obstacle-aware attention supervision that emphasizes obstacles near the robot body during task execution. The resulting attention features are subsequently injected into later action-expert layers to further guide action generation. Together, these components provide explicit semantic, geometric, and obstacle-aware cues while preserving the underlying pretrained VLA architecture. We evaluate our framework on pretrained VLA model using the RoboPRO benchmark, including visual perturbation tests, and further validate it on real-world manipulation tasks. MOSAIC improves the success rate by 5.1% in cluttered scenes, and by 9.7% under visual perturbations, with gains of up to 25.0% in the most challenging environment. We will release our code and dataset upon acceptance at the following Github page: this https URL
96. 【2611.15844】Open Vision Banana: A Fully Open Recipe for Generative Visual Perception
链接：https://arxiv.org/abs/2611.15844
作者：Arpit Jadon,Valentinos Pariza,Jona Ruthardt,Ryousuke Yamada,A. Sophia Koepke,Andrei Bursuc,Yuki M. Asano
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent work suggests, encode real-world understanding, Recent work, generators encode real-world, Vision Banana
备注：
点击查看摘要
Abstract:Recent work suggests that pretrained image generators encode real-world understanding beyond image synthesis. Vision Banana exploits this by framing vision tasks as conditional image editing. However, its data, weights, code, and implementation details are not public. We present Open Vision Banana (OVB), a fully open and reproducible recipe for converting pretrained generators into unified multi-task perception systems. Our analyses identify the design choices that matter most for generalization, including color encoding, prompt design, parameter adaptation, and task balancing. These choices interact, so individually helpful choices can hurt when combined with others. Starting from 4B and 9B parameter open-weight base models and using 2.1M-3.8M training pairs from public datasets, OVB surpasses Vision Banana's reported Cityscapes zero-shot performance (73.9 vs. 69.9 mIoU) and rivals state-of-the-art affine-invariant depth estimators. Its non-zero-shot variants come within five points of Vision Banana on referring and reasoning segmentation but remain further behind on instance segmentation. All models largely retain the base model's image-editing abilities. With legend ensembling, we introduce a test-time scaling method for generator-based perception. It segments an image under several class-color legends and fuses the results by majority vote, correcting unstable color-class bindings and improving mIoU by up to 8.7 points on Cityscapes and 15.0 points on COCO-Object without retraining. We release the dataset construction and processing pipeline, the training and evaluation code, as well as the final, intermediate, and ablation checkpoints. Project website: this https URL
97. 【2611.15834】Where to Generate Touch: Do Image Latents Preserve Material Recognition?
链接：https://arxiv.org/abs/2611.15834
作者：Wanghao Ye,Aarosh Das,Sihan Chen,Yiting Wang,Bowei Tian,Guoheng Sun,Shwai He,Zheyu Shen,Ziyao Wang,Yexiao He,Zhaoyi Liu,Meng Liu,Yuning Zhang,Meng Feng,Ziyi Wang,Yilong Dai,Yifei Dong,Siyuan Peng,Zhenle Duan,Joshua Liu,Lang Xiong,Daeun Jung,Aditya Sarkar,Parastoo Pilevar,Xiaochuan Gong,Yancheng Zhu,Yingying Fan,Qiong Wang,Ang Li
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：extend robot learning, Generated touch, Stable Diffusion VAE, recorded contacts, extend robot
备注： 13 pages, 8 figures, 10 tables
点击查看摘要
Abstract:Generated touch could extend robot learning beyond recorded contacts. A tactile generator needs a latent space, and we choose one by testing whether a material classifier trained on real GelSight presses still works on encode-decode reconstructions from pretrained image models. On ObjectFolder Real, the classifier loses 6.5 to 9.7 points on reconstructions from three 16x discrete tokenizers and 0.3 points on those from the Stable Diffusion VAE (SD-VAE). The 16x tokenizers again lose far more on Touch and Go and on DIGIT object recognition (YCB-Slide). Retraining the classifier on reconstructions, with no new labels, narrows the discrete gap. SD-VAE reconstructions also keep object identity, with 76.7% object-matching accuracy against 78.9% for real touch and 67.0% for MAGVIT-v2. We therefore select SD-VAE latents and show a photo-to-touch generator trained in them. Code will be released upon acceptance.
98. 【2611.15809】Fine-Grained Generative Hallucination Detection and Correction for Aerial Image Captioning
链接：https://arxiv.org/abs/2611.15809
作者：Debolena Basak,Somsubhra De,Maunendra Sankar Desarkar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large-scale environmental monitoring, unmanned aerial vehicles, disaster response, plays a vital, environmental monitoring
备注： Accepted at ACCV 2026
点击查看摘要
Abstract:Aerial imagery captured by unmanned aerial vehicles (UAVs) plays a vital role in applications such as surveillance, disaster response, and large-scale environmental monitoring. Automatic generation of textual descriptions for such imagery is essential for reducing manual inspection overhead and enabling better downstream decision-making. However, Multimodal Large Language Models (MLLMs), despite their impressive captioning capabilities, are prone to hallucination, producing descriptions that are inconsistent with the visual input. This problem is significantly amplified in aerial imagery due to its unique challenges such as extreme viewpoint variation, small objects, class imbalance, and ambiguous visual entities. Existing hallucination detection approaches either rely on computationally expensive large external models such as GPT-4, which perform poorly on aerial domains, or treat the problem as a rigid binary classification task, ignoring the inherent uncertainty in ambiguous cases. To address these limitations, we propose a lightweight, reference-free framework for hallucination detection and correction in free-form aerial image captioning. Our method leverages state-of-the-art MLLMs, specifically InternVL3 and Qwen2.5-VL, to detect hallucinated content in generated captions with minimal computational overhead. Detected hallucinations are corrected through a dedicated refinement module that improves the factual consistency of the original captions. Extensive experiments on the Labelled Illusion Dataset (LID) demonstrate that our framework significantly reduces hallucination rates while remaining practical for real-time deployment in resource-constrained environments. Code is available at: this https URL.
99. 【2611.15789】VibePrevisBench: Evaluating Agentic Coding for 4D Scene Generation in Blender
链接：https://arxiv.org/abs/2611.15789
作者：Yuzhe Chen,Muxi Diao,Lele Yang,Wenbin Xu,Xuyang Liu,Qile Su,Changyi Liu,Jiankang Chen,Kaiyu Jiang,Haoyu Zhang,Hongyi Fu,Jianxiong Wang,Tianke Zhang,Haonan Fan,Yingxin Li,Bingyi Li,Xu Wang,Xuanyu Zheng,Bin Wen,Tingting Gao,Wentao Zhang,Jiale Cao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Controllable real-world video, Controllable real-world, rendered graybox proxy, real-world video generation, video generation models
备注： Project page: [this https URL](https://vibeprevisbench.github.io/)
点击查看摘要
Abstract:Controllable real-world video generation models can condition on a rendered graybox proxy video, which fixes layout, motion and camera. Coding agents can build such videos by reconstructing a 4D scene in Blender, yet no benchmark checks both these videos and the long, multi-shot scenes behind them. We introduce VibePrevisBench, a benchmark for 4D scene reconstruction: an agent turns a brief into an executable 4D scene and renders its proxy video. Its 242 tasks span four input kinds, including scripts, photos, continuations, and reference videos. Each delivery is scored along two evaluation dimensions. Rule-based Scene Check re-runs the code and compares the exported 4D scene with hidden ground truth facts in nine dimensions. VLM-based Screen Check asks a VLM judge whether the facts that pass can be recognized in the proxy video. We analyze the evaluation results and trajectories of 11 frontier coding agents and identify three key observations. First, multimodal understanding separates the agents, especially in understanding space and camera motion. Second, all agents seem to already master basic camera work and staging, and fail at challenging requests. Third, agents inspect their own renders but fail to correct their errors. Agents thus need better visual understanding of space and camera, explicit checks for challenging requests, and item-by-item verification of renders against the brief.
100. 【2611.15766】Prior-as-Skill: Remember Outside and Read Inside with On-Policy Self-Distillation for Self-Evolving VLM Agents
链接：https://arxiv.org/abs/2611.15766
作者：Yan Lin,Jingyu Sun,Yifei Qian,Zhengtao Yao,Yuxia Wang,Daizong Liu,Chun Pong Lau,Zhongliang Guo,Stephen McGough
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Self-evolving visual agents, Self-evolving visual, visual agents, order, Self-evolving
备注： under review
点击查看摘要
Abstract:Self-evolving visual agents keep what they learn as skills: key frames with step notes on a task's steps and their order. On-policy self-distillation (OPSD) is now a popular way to train such skills into a vision-language model that matches, on its own answers, a teacher that also reads the written order. At deployment, frames often go missing or show an unusual order, as when a person or a website reorders the steps. Existing internalization methods keep any order they store in the frame-reading weights: trained on full frames, the model guesses when they are missing, and trained with frames withheld, it stores the order, so memory can override what it sees. We propose PriorSplit, which fills in missing frames from an order kept outside the model, with no training beyond OPSD. It counts which of two neighboring steps comes first in training episodes, and the model checks if both asked steps are in view: if so, it answers from the frames, and otherwise the counts answer. Extensive experiments on synthetic skills with five models and on step-tagged order questions in new episodes of seen web, cooking and egocentric tasks demonstrate that, with frames missing, PriorSplit outperforms every compared method at OPSD's training cost. With Qwen3-VL-4B on synthetic skills, it also stays close to OPSD on unusual orders, where methods that gain most by storing the order fall behind.
101. 【2611.15764】AIFR: Adaptive Identity Feature Recovery for Diffusion-Based Makeup and Anime Portraits
链接：https://arxiv.org/abs/2611.15764
作者：Linyan Dai,Xinwei Zhang,Yaxin Xiao,Mengyu Sun,Xinwei Liu,Renyang Liu,Qingqing Ye,Haibo Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：online content creation, identity-based content screening, anime avatar generation, virtual makeup editing, content creation
备注：
点击查看摘要
Abstract:Diffusion-based makeup and anime portraits are increasingly popular in online content creation (e.g., virtual makeup editing and anime avatar generation), but their altered appearances can hinder face recognition (FR) in identity-based content screening. Existing methods mainly adapt FR encoders or restore input images. The former require costly gallery re-encoding, while the latter may be incomplete or distort identity-related facial details. To address these limitations, we aim to correct identity features within a frozen FR model to recover its output embeddings in its original space. Appearance changes vary in strength and affect facial regions differently. To this end, we propose Adaptive Identity Feature Recovery (AIFR), a framework that inserts a lightweight recovery module at a single intermediate layer to predict sample-level correction strength and spatially adaptive residual updates. Module training uses fused identity targets to guide embedding recovery in the original FR space and an identity-shift score to regulate correction strength and limit unnecessary changes. At inference, AIFR processes a single portrait in one forward pass without reference images, producing recovered embeddings that can be directly matched with existing gallery templates without re-encoding. With only 1.22M trainable parameters, AIFR improves the average TAR at FAR=$10^{-4}$ from 66.1\% to 90.2\% over the original ArcFace, and further experiments show improvements across unseen makeup styles, stylization strengths, and generators. Beyond recognition, the recovered embeddings can directly condition a pretrained Arc2Face model to generate faces with improved identity preservation, showing compatibility with embedding-conditioned downstream generation.
102. 【2611.15760】Image Deblending with Diffusion Models
链接：https://arxiv.org/abs/2611.15760
作者：Dan Botchan,Ohad Fried,Yacov Hel-Or
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：composite image back, single blended image, plausible source layers, decomposing a composite, ill-posed problem
备注： Accepted to WACV 2027. 22 pages, 10 figures. Code: [this https URL](https://github.com/DanBotchan/image-deblending-diffusion)
点击查看摘要
Abstract:Image deblending is the task of decomposing a composite image back into its source images, which is an ill-posed problem, as a single blended image can be decomposed into multiple plausible source layers. While diffusion models are often used to solve inverse problems, they typically address single-output reconstruction problems. In this work, we formulate deblending as a joint inverse problem, employing diffusion posterior sampling to simultaneously reconstruct two source images, demonstrating that a single diffusion prior is expressive enough to disentangle two full images at once rather than just one. Drawing inspiration from human perception, where semantic understanding helps disentangle visual inconsistencies, we propose a training-free framework that leverages text prompts to constrain this solution space. We address the blind deblending task through a two-stage architecture: text-guided latent diffusion performs semantic separation using prompts as high-level cues, followed by a pixel-space refinement to recover fine details. Stochastic sampling produces multiple plausible decompositions that can be ranked without ground truth. Extensive experiments show that our training-free method achieves state-of-the-art results on unseen domains and extends to spatially-varying alpha maps, while remaining competitive with supervised baselines on standard scalar blending benchmarks.
103. 【2611.15756】How Far Can Frozen Vision-Language Models Go on Event Data? A Training-Free Study on EventBench
链接：https://arxiv.org/abs/2611.15756
作者：Md Kamrujjaman Mobin,Md Salman Shamil,Md Adnan Arefeen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：General Understanding track, Event Stream Understanding, event-camera understanding tasks, General Understanding, Stream Understanding
备注： "Technical report, EBMV @ ECCV 2026 Challenge. 13 pages, 9 figures
点击查看摘要
Abstract:We present a training-free system for the EBMV @ ECCV 2026 challenge "Event Stream Understanding with EventBench" (General Understanding track), which evaluates vision-language models on five event-camera understanding tasks. We use none of the challenge's training data: our goal is to measure how far off-the-shelf, RGB-pretrained models can go on event data through representation and prompting alone. For four of the five categories (gesture recognition, detailed understanding, causal reasoning, and event OCR) we render event bins as red/ON, blue/OFF frames, select a category-specific subset of bins, stitch them into a single grid image, and query the same frozen Qwen3.5 9B vision-language model with a category-specific prompt for all four tasks. The fifth category, action recognition, feeds every bin directly into the organizers' EventGPT-Plus-2B. The system reaches 62.28% overall accuracy across 2,084 test questions (rank 9/27), led by action recognition and causal reasoning (80.27%, 77.22%) and limited most by gesture recognition and event OCR (54.70%, 34.57%). We visualize test samples from every category together with the exact images the model receives, score six alternative representations against the evaluation server, and analyze the full test set post hoc. That analysis shows that our bounding-box crop almost never tightened around content, so event OCR text reached the model at roughly one fifth of its horizontal resolution, and that detailed-understanding predictions are skewed toward the first two answer options.
104. 【2611.15692】CGOcc: Learning Cross-Gaussian Dependencies for 3D Semantic Occupancy Prediction
链接：https://arxiv.org/abs/2611.15692
作者：Zirui Huang,Jiongle He,Yunfan Zeng,Yuanzhi Lu,Guangye Li,Boyan Tang,Weite SU,Pedro V. Sander,Amy Hui Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian-based semantic occupancy, provide ambiguous class, joint interpretation important, Gaussian-based semantic, ambiguous class predictions
备注： 18 pages, including supplementary material
点击查看摘要
Abstract:In Gaussian-based semantic occupancy prediction, overlapping primitives can provide ambiguous class predictions, making their joint interpretation important for voxel classification. However, current methods using spatially weighted mixtures neglect explicit modeling of cross-primitive dependencies, limiting the readout's ability to utilize category-specific relational evidence. Hence, we introduce CGOcc, a supervised multi-camera framework that explicitly models Cross-Gaussian dependencies for 3D semantic Occupancy prediction. CGOcc integrates appearance and geometric observations to refine Gaussian states and encodes cross-Gaussian dependencies in a diagonal-plus-low-rank representation. To incorporate these dependencies into voxel classification, CGOcc uses a class-conditional projection to extract diagonal and signed cross-Gaussian statistics without constructing a dense dependency matrix. The readout then refines occupied-class probabilities using these statistics while preserving a learned reference's occupied mass and free probability. Extensive experiments on nuScenes demonstrate CGOcc achieves state-of-the-art performance, with larger gains at high Gaussian overlap and improved predictions near boundaries. Ablation studies validate the effectiveness of covariance-aware prediction and support its synergy with geometric interaction.
105. 【2611.15652】aming Neural Fields with a Frequency-Lipschitz Curriculum for Sparse-View CT Reconstruction
链接：https://arxiv.org/abs/2611.15652
作者：Songtao Hu,Jingrui Wu,Hong Ding,Fanhao Zhu,Yunhao Liu,Suyang Xi
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Sparse-view computed tomography, fewer projection views, reduces radiation dose, acquiring fewer projection, resulting under-determined inverse
备注：
点击查看摘要
Abstract:Sparse-view computed tomography (SVCT) reduces radiation dose by acquiring fewer projection views, but the resulting under-determined inverse problem requires careful regularization to prevent reconstruction algorithms from fitting streak artifacts and hallucinated structures. Existing implicit neural representation (INR) methods rely on implicit spectral bias or iterative external denoising, yet they provide limited control over when high-frequency capacity is exposed during optimization. To address this limitation, we propose FLIC (Frequency-Lipschitz INR Curriculum), a capacity-controlled self-prior INR framework that makes the network's representational capacity explicit and schedulable. The core of our method is a joint frequency-Lipschitz curriculum that couples random Fourier feature encoding with spectrally normalized MLP decoding under non-uniform Lipschitz budgets, guiding reconstruction along a coarse-to-fine trajectory from stable global anatomy to fine details. The terminal capacity is automatically calibrated from FBP gradient statistics, enabling scan-adaptive regularization without per-scan manual tuning of the terminal Lipschitz budget. We further introduce a prior-guided adaptive ray sampling strategy that concentrates integration samples near high-gradient anatomical boundaries, improving forward-model fidelity. The entire framework operates in a single training stage without iterative denoising, enabling efficient per-image reconstruction. Extensive experiments on four public CT datasets under noise-free and low-dose settings show that our method achieves state-of-the-art unsupervised reconstruction quality with consistent performance across diverse anatomical structures.
106. 【2611.15645】Ultrasound Elastography: Excitation Methods and Low-Cost Alternative
链接：https://arxiv.org/abs/2611.15645
作者：Corin F. Otesteanu
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：tissue mechanical properties, purpose of aiding, aiding the diagnosis, mechanical properties, tissue
备注：
点击查看摘要
Abstract:Ultrasound elastography (or elasticity imaging) is a method that characterizes the tissue mechanical properties with the purpose of aiding the diagnosis of certain pathologies. Many novel clinical applications use the assumption that these tissue properties are changed in the presence of pathological processes. Characterization of tissue mechanical properties is achieved by imaging the response of the tissue to an induced stress or excitation. A plethora of approaches have been used in the scientific community to induce excitation in tissue, which usually require additional tools or devices than are costly. Furthermore these are usually integrated in the imaging pipeline using additional software or hardware for control. An alternative that is simpler, faster to integrate (and low-cost) is proposed in this work, by using readily available smartphones as a source of mechanical excitation. The induced displacements are used to solve the elasticity inverse problem (IP) using a finite element method (FEM) approach. Preliminary elasticity reconstructions of a phantom that mimics tissue are similar to when using a dedicated actuator as means of inducing harmonic displacements, illustrating the feasibility of our low-cost ultrasound elasography approach.
107. 【2611.15640】MemInStream: Memorizing or Merely Recognizing? Rethinking Streaming Video Memory Evaluation
链接：https://arxiv.org/abs/2611.15640
作者：Zhenqi He,Dunyuan Xu,Yang Bo,Kien T. Pham,Yanghao Wang,Shuhan Li,Xintong Guo,Yuyang He,Fang Liu,Huankang Guan,Jingyan Chen,Rui Liu,Long Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：continuously process incoming, relevant information increasingly, information increasingly important, video history grows, process incoming visual
备注：
点击查看摘要
Abstract:Streaming video understanding aims to continuously process incoming visual observations, making the retention and retrieval of relevant information increasingly important as the video history grows. Although existing benchmarks include memory-related questions, question-answering accuracy alone does not reliably measure memory capabilities. Incorrect predictions may arise from failures in visual understanding rather than forgetting, whereas correct predictions may rely on linguistic priors or recent observations without requiring historical memory. To address these ambiguities, we introduce MemInStream, a benchmark dedicated to evaluating memory capabilities in streaming video understanding. We develop an evidence-controlled validation protocol that associates each question with temporally localized evidence intervals. The protocol validates evidence solvability and memory necessity by retaining questions that models can answer from the annotated evidence but cannot resolve using recent observations, post-evidence observations, or textual input alone. This helps disentangle memory limitations from understanding failures while reducing memory-independent shortcuts. MemInStream provides a systematic evaluation of memory capabilities through four major categories, covering Episodic Retrieval, State Tracking \ Updating, Multi-Evidence Integration, and Contextual Memory across diverse video scenarios. Overall, \textsc{MemInStream} provides a comprehensive and reliable benchmark for systematically evaluating memory capabilities in streaming video understanding.
108. 【2611.15617】WaveletLoRA: Frequency-Aware Content-Style Decomposition for Personalized Image Generation
链接：https://arxiv.org/abs/2611.15617
作者：Peiyao Wang,Jiahui Sun,Weining Wang,Jing Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：separate subject identity, personalized image generation, aiming to separate, flexible recomposition, fundamental challenge
备注：
点击查看摘要
Abstract:Content-style decomposition from a single image is a fundamental challenge in personalized image generation, aiming to separate subject identity from visual style for flexible recomposition. Existing approaches primarily operate in the spatial domain, without explicitly exploiting the distinct frequency characteristics naturally associated with content and style. In this paper, we propose WaveletLoRA, a novel frequency-aware framework for explicit content-style decomposition through wavelet-domain supervision. Specifically, we first apply a multi-level discrete wavelet transform (DWT) to decompose the reference image into low-frequency and high-frequency subbands. We then assign a dedicated LoRA branch to each subband, where the low-frequency branch models global appearance for style acquisition, while the high-frequency branches capture structural details for content preservation. To further improve disentanglement quality, we introduce a dense Mixture-of-Experts aggregation module together with a frequency-domain regularization objective, which reduces style leakage and enhance content fidelity. In addition, we establish WaveBench and develop a VLM-based evaluation protocol that explicitly measures both attribute similarity and attribute separation for disentanglement assessment. Extensive experiments demonstrate that WaveletLoRA consistently outperforms existing methods and produces results that better align with human preference.
109. 【2611.15614】Learning-Based Interpolation of Detector Gaps in Photon-Counting X-ray Imaging
链接：https://arxiv.org/abs/2611.15614
作者：Johannes B. Thalhammer,Patrick Ilg,Tina Dorosti,Sebastian Peterhansl,Theresa Hiu,Daniel Frey,Zijin Huang,Florian Schaff,Daniela Pfeiffer,Franz Pfeiffer
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Image detectors assembled, Image detectors, assembled from tiled, tiled modules, modules have physical
备注：
点击查看摘要
Abstract:Image detectors assembled from tiled modules have physical gaps in the field of view that must be filled before downstream processing such as phase retrieval or tomographic reconstruction. Unlike natural-image inpainting, detector-gap interpolation must leave all other pixels unmodified and preserve the intensity statistics of the filled region, since even a small shift in mean intensity can cause ring artifacts after reconstruction. We adapted two generative models, a Wasserstein GAN with gradient penalty (WGAN-GP) and a conditional Pix2Pix model, to this task. We implemented a masking strategy that restricts all changes to the gap pixels and loss terms that constrain the mean intensity and the intensity distribution of the filled region. Both models were trained on nanoCT projections with simulated gaps and compared with linear interpolation, Navier--Stokes inpainting, and the deep image-inpainting network MADF, quantitatively on simulated gaps and visually on real detector gaps. WGAN-GP and Pix2Pix achieved the best perceptual similarity (LPIPS) and histogram distance and, apart from linear interpolation, the shortest inference time. Pix2Pix required about five times fewer training GPU-hours than WGAN-GP. Ablation studies showed that masking the network output contributes by far the most to plausible inpainting results. Applied to sinograms, Pix2Pix produced the most natural gap filling but improved the reconstruction only slightly compared with linear interpolation. The source code and the weights of the final Pix2Pix model are available at this https URL.
110. 【2611.15610】Contrastive Bootstrap Representation Learning for Label-Efficient Agricultural Image Classification
链接：https://arxiv.org/abs/2611.15610
作者：Hazem Ahmed,Ali Hamdi,Ammar Mohammed
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Expert annotation remains, Expert annotation, agricultural image classification, obtaining reliable labels, image classification
备注： 12 pages, 4 figures. Accepted at ICACIN 2026
点击查看摘要
Abstract:Expert annotation remains a major bottleneck in agricultural image classification, where collecting images is often easier than obtaining reliable labels from domain specialists. Self-supervised learning can reduce this dependence by pretraining transferable representations on unlabelled imagery. Contrastive and bootstrap methods provide two established but distinct training signals, motivating an empirical study of a formulation that applies both signals within one representation path under severe downstream label scarcity. We present Contrastive Bootstrap Representation Learning (CBRL), which jointly optimises SimCLR-style NT-Xent contrastive learning and bidirectional BYOL-style exponential-moving-average target prediction within a shared online projection space. Using a ViT-L/16 backbone and 10% of the downstream labels, we report single-seed point estimates on four primary agricultural test benchmarks plus an exploratory 33-image New Plant Diseases evaluation. CBRL records the highest macro-F1 point estimate on the four primary benchmarks. On DeepWeeds, its 79.77% test macro-F1 is 32.29 points above the random-initialisation, label-only baseline and 15.78 points above the next-highest comparison point estimate; on PlantVillage, its 98.14% macro-F1 is 10.43 and 0.43 points higher, respectively. On PlantDoc, however, all methods fail to reach practically useful performance. These results identify the evaluated joint formulation as a promising candidate for label-limited transfer, but they do not establish objective synergy, statistical superiority, or robustness across stochastic runs.
111. 【2611.15602】CoCode-World: Shared 3D Proxy Representation for Multi-Player World Models
链接：https://arxiv.org/abs/2611.15602
作者：Qirui Li,Xin Zhang,Yabo Chen,Jinkun Hao,Paul L Rosin,Yu-Kun Lai,Haibin Huang,Yin Chen,Ran Yi,Chi Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multiplayer generative world, Multiplayer generative, generative world models, Multiplayer, generative world
备注：
点击查看摘要
Abstract:Multiplayer generative world models must produce observations that agree on shared entities despite different camera motions and occlusions. Explicit world representations provide spatial control, but precise modeling of individual game maps limits scene diversity, while shared geometry alone cannot ensure consistent appearance across views. We present CoCode-World, a shared 3D proxy framework that separates structural control from visual synthesis for two-player video generation. Programmable proxies specify scene layout, motion, and occlusion, while RGB references guide character and scene appearance. To coordinate visual details across players, we concatenate paired proxy videos, appearance references, and target views in a consistent spatial layout and generate both views jointly with a pretrained video model. This formulation uses the model's native attention for cross-view communication within a single generation branch, with LoRA adaptation learning proxy adherence and appearance correspondence from paired observations. We construct a two-player GTA~V dataset that pairs synchronized RGB observations with proxy videos derived from shared map geometry and game-engine state. Experiments demonstrate appearance transfer to characters and scene styles unseen during training, with improvements in video quality and cross-view player identity over the evaluated baseline. Ablations further examine how proxy construction and cross-view communication affect generation. Project page: this https URL.
112. 【2611.15601】Cat Royale Comprehensive Dataset: A Dataset for Pose Detection, Segmentation, Animal Action Recognition and Scene Understanding
链接：https://arxiv.org/abs/2611.15601
作者：Zane K. J. Hartley,Joseph Ho,Alan Chamberlain,Michael P. Pound,Steve Benford
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Animal focused computer, computer vision, focused computer vision, Computer Vision tasks, computer vision datasets
备注： 26 pages, 4 figures, 6 tables. Submitted to the International Journal of Computer Vision. Dataset: [this https URL](https://doi.org/10.5281/zenodo.19498943)
点击查看摘要
Abstract:Animal focused computer vision datasets are of a growing interest in the fields of both Computer Vision and Animal behaviour. The ability to make sense of complex scenes via a variety of Computer Vision tasks has substantial implications for behavioural understanding and welfare. The perfection of these tasks will help lead to better health and emotional outcomes for wild and domestic animals. In this work we present the Cat Royale Comprehensive Dataset (CRCD), a large, comprehensive, multi-modal dataset for feline understanding, based on a huge database of over 500 hours of video captured during the Cat Royale artwork and research project. Our dataset contains annotations for a range of computer vision problems including 20,000 images with instance segmentation masks, 5000 images with multi-subject pose coordinates, over 800 video clips with action classes, and over 800 clips with detailed text description. This is the first such dataset to link this wide range of annotation types together for multi-modal use. We release this entire dataset, and our custom annotation tools will also be made available, in order to allow for ongoing expansion. We also provide a series of benchmarks for the tasks of Instance Segmentation, Pose detection, Temporal Action Localisation, and finally video-text retrieval. The totality of this multi-modal dataset is the data needed to solve both these individual computer vision tasks as well as enabling more complex multi-modal tasks making use of a combination of annotations.
113. 【2611.15589】EMS-Nav: Embodied Multi-Scale Navigation
链接：https://arxiv.org/abs/2611.15589
作者：Zenghui Yang,Xinan Wang,Danyang Li,Zhe Xu,Zheng Yang,Jingao Xu,Qiang Ma
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Industrial inspection robots, Industrial inspection, reach work areas, reach work, inspection robots
备注： 30 pages, including appendices
点击查看摘要
Abstract:Industrial inspection robots must reach work areas and specific equipment. These destinations span spatial scales from regions to objects, so robots must relate each target to its surroundings to interpret the task and determine where to go. Existing methods support multi-scale navigation through rich environment representations, but at substantial computational and storage cost. These costs limit deployment where wireless coverage is incomplete and robots must rely on onboard computation to keep navigating. We introduce EMS-Nav, a biologically inspired multi-scale navigation framework for online, on-device operation. Its core innovation is to organize perception, spatial understanding, and navigation around regions, making local spaces the basic units of both environmental understanding and computation. EMS-Nav groups objects and their relationships into functionally meaningful spaces and builds a hierarchy from local areas to the broader environment. This organization supports efficient map construction alongside the interpretation and execution of language goals at different scales. In multi-scale navigation experiments, EMS-Nav achieves the highest success rates across all four target categories: objects, rooms, regions, and specific instances. It outperforms state-of-the-art open-vocabulary mapping and navigation methods, improving overall first-attempt success by 9.39 percentage points over the strongest baseline while reducing mapping overhead and language-model input size. Local deployment in real indoor environments further demonstrates its applicability to on-device embodied navigation. By establishing regions as the organizing basis for perception, spatial understanding, and language-guided action, EMS-Nav provides a system that combines multi-scale understanding with computational efficiency to support diverse language goals on resource-constrained robots.
114. 【2611.15579】FoveaDet: Software-Hardware Co-Design of Foveated CNN-Transformer for Object Detection
链接：https://arxiv.org/abs/2611.15579
作者：Deepak Mewada,Apporva Saraf,Ashwin Lele
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deploying real-time object, real-time object detection, Deploying real-time, power-constrained edge platforms, processing full-resolution frames
备注： 5 pages, 6 figures. Submitted to IEEE ISCAS 2027
点击查看摘要
Abstract:Deploying real-time object detection on power-constrained edge platforms is challenging as processing full-resolution frames is often computationally redundant. Inspired by biological foveation which assigns variable resolution based on visual saliency, we propose a novel software-hardware co-design framework called FoveaDet. On the software side, FoveaDet dynamically identifies salient regions to predict fixation points, followed by aggressive patch pruning in Vision Transformers (ViT) to discard irrelevant background data. To mitigate slowdowns from sequential patch generation, we implement optimized interpolation and patch selection algorithms. Evaluated on standard GPUs, this foveated approach reduces floating-point operations by 65.4% to 92.2% and accelerates inference by 4.76x, while suffering a negligible mAP drop compared to dense baselines. To eliminate hardware bottlenecks, we complement the algorithm with a custom RISC-V core featuring specialized instructions to accelerate the foveated processing pipeline. FoveaDet provides a scalable, efficient architecture capable of unlocking advanced vision processing on severely constrained mobile platforms.
115. 【2611.15574】RipBench: A Unified Benchmark for Multi-Level Rip Current Detection, Classification and Segmentation
链接：https://arxiv.org/abs/2611.15574
作者：Andrei Dumitriu,Aakash Ralhan,Florin Miron,Florin Tatui,Radu Tudor Ionescu,Radu Timofte
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：coastal drownings worldwide, drownings worldwide, under-addressed threat, coastal drownings, rip current detection
备注： Accepted to NeurIPS 2026, Evaluations Datasets Track. 47 pages, 11 figures. See [this https URL](https://ripbench.ai) for dataset and project updates
点击查看摘要
Abstract:Rip currents are a serious and often under-addressed threat to beach safety and the leading cause of coastal drownings worldwide. They are difficult to detect due to their amorphous structure, similarity to the background, and large variability in viewpoints and environments. Despite their dangers and growing interest in automated detection, existing research remains fragmented across datasets, metrics, models, and approaches, leading to an incomplete understanding of model performance. We introduce RipBench, a unified benchmark that enables controlled evaluation of rip current detection spanning multiple tasks, including classification, axis-aligned and oriented object detection, and instance, semantic, and panoptic segmentation, on the same data with standardized splits. This allows direct comparison of model performance on all levels of visual abstraction. Across $304$ videos ($303{,}491$ frames, $51{,}011$ of them annotated for all six tasks) collected from diverse coastlines, our results expose a clear performance gap between coarse recognition and precise spatial understanding: frame-level classification reaches $F_2 = 0.93$, while the best detector and the best instance segmenter reach $0.72$ and $0.66$, with model rankings that change from task to task. Video-level confidence intervals, a blind inter-annotator study of the spatial labels, stratified analyses by viewpoint and visual signature, and video views with temporal baselines (single-seed, short-schedule reference runs) accompany the benchmark. All tasks are supported with carefully curated annotations and evaluated using standard metrics, with a focus on the $F_2$ score to emphasize recall in this safety-critical setting. RipBench, along with multiple baselines per task, is publicly available at this https URL to support progress in real-world, multi-task vision for beach safety.
116. 【2611.15569】raceKV: Policy-Preserving Low-Rank KV Cache Compression for Reasoning Vision-Language Models
链接：https://arxiv.org/abs/2611.15569
作者：Ke Li,Zishan Shao,Yiran Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：large multimodal contexts, impose substantial, large multimodal, growing reasoning traces, Reasoning vision-language models
备注：
点击查看摘要
Abstract:Reasoning vision-language models (VLMs) impose substantial KV cache demands from both large multimodal contexts and growing reasoning traces. Low-rank KV compression has emerged as a promising paradigm that stores low-dimensional latents of KV states and can be combined with quantization. However, existing low-rank methods often induce growing predictive policy drift from the dense model when compressing reasoning KV states, resulting in reasoning failures. We identify two key causes of this degradation: calibration-state mismatch between static contexts and on-policy reasoning states, and unequal error sensitivity across KV states. To address these challenges, we propose TraceKV, a training-free low-rank KV compression framework that unifies on-policy calibration, sensitivity-aware SVD, and global rank allocation under a single policy-preserving principle, substantially reducing policy-KL divergence during reasoning. Experiments across multiple VLMs and visual reasoning benchmarks demonstrate superior accuracy--memory trade-offs, achieving near-lossless reasoning accuracy with 5.64$\times$ KV cache compression when combined with quantization. Optimized low-rank attention kernels further deliver up to 1.83$\times$ end-to-end decoding speedup. Code will be available at this https URL.
117. 【2611.15530】MAGIC: Modality-Aware Gini Inspection for Clinical Hallucination Detection in LMMs
链接：https://arxiv.org/abs/2611.15530
作者：Sachin Acharya,Niyoj Oli,Shishir Adhikari,Aminu Lawal,Yash Raj Shrestha,Prashnna K Gyawali,Binod Bhattarai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：large multimodal models, clinical decision support, clinically unverifiable outputs, brought promising progress, Recent advances
备注：
点击查看摘要
Abstract:Recent advances in medical large multimodal models (LMMs) have brought promising progress to clinical decision support, yet hallucination, the generation of confident but clinically unverifiable outputs, poses a critical threat to the reliability demanded in high-stakes medical settings. Existing hallucination detection methods, predominantly designed for unimodal settings, fail to capture the visual-linguistic dynamics inherent to medical imaging. We formulate the problem of hallucination detection in LMMs as disproportionate distribution of attention weights across the modalities during answer token generation. We quantify modality-specific attention concentration across layers and heads using the Gini coefficient and demonstrate statistically significant redistribution of attention mass between visual and textual tokens in hallucinated responses. We leverage these features to train a logistic regression-based classifier and evaluate it on two medical LMMs across three medical imaging modalities, demonstrating that our method achieves competitive or superior performance against contemporary hallucination detection baselines.
118. 【2611.15526】SCR-Mamba: Skeleton-conditioned Mamba with cross-scale incremental refinement for efficient 3D human pose estimation
链接：https://arxiv.org/abs/2611.15526
作者：Jie Wang,Xuejing Gu,Congzhe Zhang,Zibo Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：human pose estimation, lack direct exploitation, model long sequences, Mamba-based methods, selective state updates
备注： 15 pages, 9 figures, 11 tables
点击查看摘要
Abstract:Mamba-based methods for video-based 3D human pose estimation can model long sequences with linear complexity, but their selective state updates usually lack direct exploitation of skeletal relations. Meanwhile, stacking modeling blocks at the full temporal resolution leads to high computational overhead, while compressing the temporal sequence makes it difficult to retain per-frame details. To address these issues, we propose SCR-Mamba, whose core consists of Skeleton-Conditioned State Modeling (SCSM) and Cross-Scale Incremental Refinement (CSIR). SCSM generates a skeleton context from bone connections and left-right symmetry relations and generates the selective parameters of the spatial and temporal branches conditioned on it, so that structural relations are involved in the writing, propagation, and reading of state information. CSIR constructs multi-scale motion representations through content-adaptive aggregation and progressively refines the retained per-frame features with the increments produced by coarse-scale modeling, integrating long-range motion context while reducing full-resolution computation. On Human3.6M with Stacked Hourglass (SH) 2D detections and 243-frame inputs, SCR-Mamba-L achieves 36.8 mm MPJPE (P1) with 7.72 M parameters and 15.10 G MACs, less than 1/7 of the computational cost of StructMamPose-L with similar accuracy; SCR-Mamba-X further reaches 36.6 mm P1 and 30.9 mm P-MPJPE (P2), achieving state-of-the-art performance. On MPI-INF-3DHP, SCR-Mamba-X achieves a percentage of correct keypoints (PCK) of 99.3%, an area under the curve (AUC) of 88.1%, and an MPJPE of 14.2 mm.
119. 【2611.15524】Reading the Table: Sim-to-Real Game State Detection for the Chef's Hat Card Game
链接：https://arxiv.org/abs/2611.15524
作者：Connor Gäde,Matthias Kerzel,Hauke Bünning,Jan-Gerrit Habekost,Mariana Barros,Stefan Wermter
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Tabletop games offer, combining social interaction, game state tracking, Tabletop games, game state
备注： Presented at the Dungeons, Neurons, and Dialogues workshop (DnD-SIDC 2026) at ICANN 2026, [this https URL](https://dnd-sidc.github.io/)
点击查看摘要
Abstract:Tabletop games offer a compelling scenario to study the interaction between artificial and human agents, combining social interaction with game state tracking and physical manipulation. To assess the game state, a robot needs to precisely detect closely related game objects, such as different card designs, requiring dedicated training data that is costly to annotate in the real world. Instead, we develop a fully automated synthetic data collection pipeline, using re-projection of known 3D coordinates to generate labels automatically and domain randomization to bridge the reality gap. This approach is used to collect a dataset of 25413 samples to finetune an object detection and a segmentation model, which are combined to assign detected cards to game-relevant zones and infer the game state. When evaluated on a real NICO humanoid robot, our pipeline achieves an F1-score of 0.906 for card-to-zone assignment, thus providing the perceptual foundation for a robot that can autonomously play Chef's Hat against human players.
120. 【2611.15514】Real Pairs Are Not Enough: Physically Anchored Supervision for Volumetric CT Super-Resolution
链接：https://arxiv.org/abs/2611.15514
作者：Haoran Liu,Zipei Yan,Mingzhe Liu,Jizhou Li,Guibin Zan
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：physically acquired pairs, commonly trained, Physically-anchored Implicit Network, synthetic pairs miss, pairs retain inter-scan
备注： 47 pages, 5 figures, including supplementary material
点击查看摘要
Abstract:Volumetric CT super-resolution (SR) models are commonly trained on synthetic or physically acquired pairs of low-resolution (LR) and high-resolution (HR) volumes. However, synthetic pairs miss real acquisition effects, whereas registered physical pairs retain inter-scan noise, artifact, and microstructure differences---causing direct voxelwise regression, and even naive synthetic-real mixing, to oversmooth fine porous structures. We introduce the Physically-anchored Implicit Network (PIN) with Real-Pair Dual-Anchor learning, which decouples physical-pair supervision into two complementary roles. The HR anchor teaches fine structure from registered HR through pair-conditioned spectral replay, while the LR anchor constrains the prediction from acquired LR via affine-calibrated low-pass projection. Together with exact synthetic supervision in one shared volumetric implicit model, PIN learns from both physical scans without forcing the acquired-LR reconstruction to match registered HR voxel by voxel. Inference requires only acquired LR. Across 30 external baseline configurations on real CT, PIN achieves the lowest full-volume LPIPS, reduces average symmetric surface distance by 42.3-49.5% and bone-volume-fraction error by 52.2-53.4% relative to the three strongest baselines for each metric, and lowers the erased reference-pore volume fraction from 37.3-72.9% to 10.4%. Code, pretrained models, and evaluation scripts will be publicly available.
121. 【2611.15491】What Makes a VLA Reactive? A Study of Execution Strategies for Dynamic Manipulation
链接：https://arxiv.org/abs/2611.15491
作者：Zhuoyue Li,Zhendong Han,Pankhuri Vanjani,Wenting Li,Rudolf Lioutikov
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：models predict chunks, pretrained VLA reactive, models predict, objects move, VLA reactive
备注： 13 pages, 7 figures, Efficient Foundation Models for Real-Time Embodied AI, CoRL 2026 Workshop
点击查看摘要
Abstract:Vision-language-action (VLA) models predict chunks of future actions, and when objects move, those chunks go stale before they are executed. We study what makes a pretrained VLA reactive, using \pihalf{} on two dynamic simulation benchmarks and three real-robot tasks. We vary the prediction and execution horizons, compare synchronous and asynchronous inference, test methods that deliver actions sooner or keep successive chunks continuous, and adapt the policy with motion cues and latent-space reinforcement learning. The best prediction horizon is about one second, and the best execution horizon depends on the checkpoint. Short horizons help more with asynchronous execution, and methods that keep the trajectory continuous outperform those that only reduce latency. Adapting the policy repairs targeted failures, but on the conveyor task changing the execution horizon gained as much. Reactivity depends on the execution pipeline as much as on the policy, so both should be evaluated together.
122. 【2611.15481】SkillEarth: Teaching General-Purpose Agents to Act on Earth via Skill Evolution
链接：https://arxiv.org/abs/2611.15481
作者：Haojun Tang,Wenda Zhao,Xiang Zhou,Qiwei Lin,Lida Huang,Yan Wang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Recently developed remote, developed remote sensing, Recently developed, agents execute real-world, execute real-world tasks
备注： 20 pages, 7 figures
点击查看摘要
Abstract:Recently developed remote sensing (RS) agents execute real-world tasks with complex workflows through multi-step tool invocation. These agents, however, typically rely on predefined expertise or parameter updates. They thus require updating expert knowledge or retraining models whenever new tools, tasks, or execution patterns emerge, limiting their continual adaptability in dynamic Earth environments. In this work, we seek to equip general-purpose agents with RS tool-call knowledge that can be automatically extracted from demonstrated trajectories without expert intervention or parameter updates. Specifically, we propose SkillEarth, a self-evolving skill extraction method that externalizes RS tool-call knowledge as reusable, retrievable, and evolvable skill files and refines them through observation-grounded evolution. Unlike existing automatic skill extraction methods that rely on outcome-based reflection to refine skills holistically, SkillEarth grounds skill evolution in real tool-chain execution and combines dual-judge feedback with a grounded observation routing graph for precise component-level refinement. The resulting skills are generalizable, reliable, and transferable: they improve overall RS tool-call performance across three frontier LLMs and four open-source LLMs, are refined through real tool execution feedback, and support cross-model reuse without retraining. Experiments on OpenEarth-Bench and Earth-Bench demonstrate that SkillEarth achieves better tool selection, argument correctness, execution-order consistency, and task completion than existing RS agents and skill extraction methods.
123. 【2611.15459】Fear of Memorizing Objects: End-to-End Zero-Shot Model-Based Object Detection
链接：https://arxiv.org/abs/2611.15459
作者：Leon Greiner,Wout Boerdijk,Junwen Huang,Benjamin Busam,Rudolph Triebel,Maximilian Durner
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Fear of Memorizing, trainable transformer-based architecture, paper presents FOMO, trainable transformer-based, Memorizing Objects
备注：
点击查看摘要
Abstract:This paper presents FOMO (Fear of Memorizing Objects), an end-to-end trainable transformer-based architecture for zero-shot model-based object detection. Existing approaches typically follow a proposal-and-match pipeline: target-agnostic mask proposals are generated and then matched to template features in a set of loosely coupled stages, making them susceptible to fragmented proposals in clutter and degraded matching under occlusions. FOMO elegantly replaces this paradigm by injecting object template information early in the detection pipeline: Bidirectional attention between learnable latent tokens, multi-view CAD templates, and query image features produces object-aware image features and conditioned queries which are subsequently decoded into bounding-box and confidence predictions. We train FOMO on Clutter6D, a novel large-scale synthetic dataset with over 500k images featuring more than 10k diverse object models rendered in highly cluttered scenes with multiple instances and varying occlusion levels, which addresses the limited object diversity and lack of realistic dense clutter in existing datasets for training zero-shot multi-instance algorithms. In true zero-shot fashion, FOMO achieves 54.2 mAP on BOP-Classic-Core at 0.23 s per image, ranking second overall with 3.8 pp difference to the top method while being more than 7x faster. Throughout comprehensive ablation studies we investigate and verify architectural design choices.
124. 【2611.15457】WaveFlow-UIE: A Single-Pipeline Wavelet-Domain Flow Model for Efficient Underwater Image Restoration
链接：https://arxiv.org/abs/2611.15457
作者：Abdulaziz Alfaraj,Mohammed Al Naser,Hassan Al Nasser,Muzammil Behzad
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：image components differently, loss affect low, high-frequency image components, detail loss affect, image restoration remains
备注：
点击查看摘要
Abstract:Underwater image restoration remains challenging because color distortion, scattering, and detail loss affect low- and high-frequency image components differently. Recent diffusion-based methods have shown strong restoration quality, but often rely on multi-stage pipelines and costly iterative refinement. We present WaveFlow-UIE, a single-pipeline wavelet-domain flow model that directly learns to transform degraded underwater wavelet representations into clean ones. Our method applies a discrete wavelet transform, estimates lightweight physics-inspired degradation cues including transmission and ambient light, and conditions a velocity network trained with flow matching in wavelet space. The training objective combines flow-matching, frequency-weighted reconstruction, perceptual, color-consistency, and physics-consistency losses. Across UIEB, LSUI, UFO-120, and EUVP, WaveFlow-UIE achieves a strong quality-efficiency tradeoff, with especially competitive results on perceptual metrics. Relative to a strong wavelet-based diffusion baseline, the proposed model substantially reduces inference cost while maintaining or improving restoration quality on several paired benchmarks. We show that reducing the inference process from five flow steps to a single step preserves nearly all of the restoration quality while providing an additional speedup of about $4\times$ on UIEB at $256\times256$ resolution. This single-step result suggests that a single-pass wavelet-domain model is an effective alternative to heavier diffusion-style refinement.
125. 【2611.15449】Reading the Unreadable: Text-Aware Image Super-Resolution Needs Reasoning
链接：https://arxiv.org/abs/2611.15449
作者：Jaeseong Lee,Jinwoo Kim,Jinho Jeong,Seon Joo Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：preserving textual content, Text-aware image super-resolution, recover high-resolution images, Text-aware image, aims to recover
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Text-aware image super-resolution (TAISR) aims to recover high-resolution images from low-resolution inputs while preserving textual content. Existing methods treat this as a visual restoration problem, yet severely degraded text often cannot be read from local visual evidence alone. Humans instead read it by reasoning over image context, logical patterns, and prior knowledge. This raises a fundamental question: Does TAISR need reasoning? To answer this, we introduce two diagnostic tools. The first, ReasonText, is a human-curated benchmark that separates reasoning-required text from locally recoverable text. The second, Ground-Truth Text-Crop Accuracy (GTTCA), is a recognition-based metric that measures text restoration quality without text detection errors. Evaluating twelve recent super-resolution (SR) models, we find a consistent and substantial performance drop on reasoning-required text, revealing a systematic blind spot. Two observations point to a remedy. One is that text-conditioned SR models restore text substantially better when given ground-truth text. The other is that multimodal large language models (MLLMs) can read degraded text in low-resolution images through reasoning. We therefore propose Reasoning Transfer via Captioning (RTC), a training-free plug-in that uses an external MLLM to infer the degraded text and feeds the resulting caption to a text-conditioned SR model. RTC consistently improves all six text-conditioned SR models we evaluate, especially on reasoning-required text. Surprisingly, a real-world SR model with RTC can even outperform the TAISR model with RTC, suggesting that reasoning should be a core design axis for future TAISR.
126. 【2611.15448】Semantic Consistency of Vision Tokens: A Vision-Centric Perspective on Multimodal Large Language Models
链接：https://arxiv.org/abs/2611.15448
作者：Nikola Đukić,Tim Lebailly,Tinne Tuytelaars
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unique paradigms characterized, vision-only patch representations, high-quality vision-only patch, high-quality patch representations, patch representations
备注：
点击查看摘要
Abstract:In computer vision, vision-language and self-supervised encoders are two unique paradigms characterized by global language alignment and high-quality vision-only patch representations, respectively. Multimodal large language models (MLLMs) often use the former because of language alignment, despite the recent rise in vision-centric tasks resembling traditional dense vision tasks that would likely benefit from the high-quality patch representations, raising the question whether self-supervised models could aid MLLMs in vision-centric tasks. To investigate this, we define semantic (in)consistency of patch tokens from language-aligned encoders and identify two sets of tokens, semantically consistent (SCTs) and semantically inconsistent (SITs). Through systematic probing via the removal of SCTs or SITs from the input of modern MLLMs, we show higher reliance on SCTs than SITs, as removal of the former induces larger performance drops. This demonstrates that MLLMs benefit from semantic consistency of vision tokens. With this in mind, we devise a simple yet effective extension of the MLLM training objective that combines traditional language modeling with semantic guidance via minimization of semantic inconsistency. This strategy, named Semantically-Guided Training (SGT), combines the signals of both loss terms to push the vision encoder towards providing semantically consistent tokens, while preserving language alignment. Extensive evaluation shows that SGT outperforms all baselines and MLLMs with specialized vision encoders on vision-centric benchmarks while keeping strong scores on text-centric benchmarks, thus setting state of the art on average across all tasks. Our results highlight the importance of combining language alignment and semantic consistency through the lens of MLLMs rather than independently from them and pave the way towards the design of better MLLM vision encoders.
127. 【2611.15437】SteinPnP: Non-Parametric Uncertainty Quantification in the Perspective-N-Point Problem
链接：https://arxiv.org/abs/2611.15437
作者：Baptiste Lardinoit,Jongseok Lee,Andres Yubero,Seong Hun Lee,Javier Civera,Rudolph Triebel
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Stein Variational Inference, probabilistic Perspective, camera pose posterior, aging Stein Variational, models the full
备注：
点击查看摘要
Abstract:We propose SteinPnP, a probabilistic Perspective- N-Point (PnP) solver that models the full 6-DoF camera pose posterior using a non-parametric set of pose particles. By lever- aging Stein Variational Inference (SVI), SteinPnP combines the expressivity of particle-based representations with the efficiency of optimization-based solvers. However, a naive application of SVI struggles in the PnP problem, often missing alternative pose hypotheses or assigning incorrect probability weights to them. To address these limitations, we propose practical remedies that discover new potential poses, identify distinct hypothesis clusters, and balance their relative probability weights to capture the true underlying distribution. Our experiments across synthetic and real-world benchmarks demonstrate that SteinPnP accurately captures complex multimodal uncertainties while maintaining competitive accuracy.
128. 【2611.15435】hermalSplat: Generalizable Pose-Free Gaussian Splatting for Sparse-View Thermal 3D Reconstruction
链接：https://arxiv.org/abs/2611.15435
作者：Prasanna S,Gopi Raju Matta,Divya Madhuri Vemunuri,Kaushik Mitra
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Thermal infrared imaging, scene representations remains, autonomous navigation, infrared imaging, imaging is vital
备注： WACV 2027
点击查看摘要
Abstract:Thermal infrared imaging is vital for applications like search-and-rescue and autonomous navigation, yet trans- lating it into 3D scene representations remains a critical bottleneck. The low-texture nature and view-dependent emissivity of thermal images cause standard pose estima- tors to fail catastrophically, collapsing standard 3D Gaus- sian Splatting pipelines under sparse-view constraints. Fur- thermore, existing thermal reconstruction methods rely heavily on dense capture and computationally expensive per-scene optimization. Critically, many of these ap- proaches depend on aligned RGB-thermal datasets to ob- tain reliable camera poses and initial point clouds, ren- dering them unusable in purely thermal, unposed envi- ronments. To break this bottleneck, we present Thermal- Splat, the first generalizable, feed-forward Gaussian splat- ting framework that reconstructs 3D scenes directly from sparse thermal images without requiring known camera poses, RGB guidance, or per-scene training. We over- come thermal-specific challenges using a soft census loss for brightness-invariant structural matching and a bound- ary structure loss to explicitly supervise temperature discon- tinuities. Trained on an aggregated multi-source dataset, ThermalSplat synthesizes sharp reconstructions of unseen scenes in a single feed-forward pass. Extensive experi- ments demonstrate that ThermalSplat holds a strict advan- tage over scene-specific thermal splatting methods in the sparse regime. Furthermore, even compared against these baselines operating under their ideal dense capture set- tings, ThermalSplat achieves superior perceptual fidelity. By eliminating the need for computationally expensive per scene optimization, ThermalSplat offers an efficient and generalizable approach to thermal 3D reconstruction.
129. 【2611.15433】Verifier Choice is a Benchmark Design Variable: Auditing Structural Counting Evaluation in Text-to-Image Models
链接：https://arxiv.org/abs/2611.15433
作者：Shurun Li,Michael Hua Wang,Haibo Zeng,Long Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：converts generated images, implementation detail, automatic benchmark score, automatic benchmark scores, automatic benchmark
备注： Accepted at NeurIPS 2026 (Evaluations and Datasets Track). 24 pages. Data: [this https URL](https://huggingface.co/datasets/neurips2026-ed443/audit-release) . Code: [this https URL](https://github.com/AzusaCat1111/verifier-choice-audit)
点击查看摘要
Abstract:Automatic evaluation is now central to text-to-image benchmarking, but the verifier that converts generated images into scores is often treated as an implementation detail. We argue that this is unsafe: an automatic benchmark score is a property of the image generator, prompt distribution, verifier, verifier-use protocol, and scoring rule, not of the generator alone. We study this issue in structural counting, a controlled setting where human-visible counts can be audited. We construct a verifier-centric audit suite over seven counting objects: cell phones, chairs, and traffic lights for object counting, and clover leaflets, dresser drawer fronts, power-strip sockets, and turbine blades for substructure counting. Across 6,240 generated images from Qwen-Image-2512 and FLUX.2-dev, we compare open MLLM verifiers under count-only, reject-aware, zero-shot and few-shot protocols, plus TIFA-like target queries, a detector baseline, and frontier closed-model checks on two hard objects. On a balanced 2,280-image evaluation split, aggregate score matching can coexist with image-level disagreement, and verifier-use protocols and generator distributions change the measured reliability. Every verifier-protocol configuration also shrinks the human score difference between the two generators, by 7.5-25.0 pp, and with a third generator, Z-Image, all four tested protocols reverse the human ordering of Z-Image and FLUX.2-dev on our fixed prompt suite. GPT-5.5 and Claude Opus 4.7 checks do not remove the failure modes: GPT-5.5 still has only 59.92% clover valid-count fidelity, while Claude Opus 4.7 has lower same-slice agreement ($\kappa=0.432$). We propose reporting automatic benchmark scores with a factorized verifier reliability profile: aggregate score gap, image-level agreement, generator-comparison distortion, valid-image count fidelity, rejection behavior, output compliance, and directional bias.
130. 【2611.15429】IncR-3DSGG: Incremental Posed RGB Image Based 3D Scene Graph Generation via Privileged Depth Supervision
链接：https://arxiv.org/abs/2611.15429
作者：Mrunmai Phatak,Daniel Kienzle,Roman Küble,Jörg Hähner,Rainer Lienhart
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Scene graphs provide, Scene graphs, scene graph, scene graph generation, scene graphs incrementally
备注：
点击查看摘要
Abstract:Scene graphs provide a compact, structured representation of environments by capturing objects and their spatial or semantic relationships in a form suitable for embodied agents. Existing 3D scene graph generation methods often rely on depth sensing at inference, either to associate object instances across views via point cloud overlap or to compute inter-object relations from geometric cues, limiting deployment to platforms with depth sensors. We propose IncR-3DSGG, which builds 3D scene graphs incrementally from posed\footnote{RGB images with camera extrinsics estimated by an off-the-shelf visual SLAM system.} RGB images, eliminating the use of depth sensors at inference. Our method leverages a Parametric Relation Predictor (PRP) that learns to estimate pairwise distances and relative angles between objects from 2D visual features and 2D geometric cues, using 3D geometric supervision available only during training. These learned pairwise measurements are fused across views through Pose Graph Optimization (PGO)~\cite{grisetti2010tutorial} to recover metrically grounded 3D object positions and build a globally consistent 3D scene graph incrementally. On the real-world 3RScan~\cite{wald2019rio} dataset, our method attains $52.2$ mean object recall and $30.8$ mean predicate recall under the 3DSSG~\cite{wald2020learning} evaluation protocol, against $27.0$ and $17.6$ for MonoSSG~\cite{wu2023incremental}, while using no depth or reconstructed geometry at inference. This shows that relations and metrically grounded 3D object representations can be predicted from posed RGB images alone.
131. 【2611.15420】Learning Motion-Appearance Coupling Priors for Solving Video Inverse Problems
链接：https://arxiv.org/abs/2611.15420
作者：Anselm Krainovic,Reinhard Heckel
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
关键词：degraded measurements requires, measurements requires priors, Reconstructing video, degraded measurements, measurements requires
备注： NeurIPS 2026
点击查看摘要
Abstract:Reconstructing video from degraded measurements requires priors that capture both frame appearance and temporal dynamics. Many recent approaches combine pretrained image diffusion priors with motion guidance, sidestepping the costs of training large video models. Temporal consistency is often enforced via photometric losses or warping-based constraints, which implicitly assume that motion explains frame-to-frame or latent-to-latent changes up to small deviations, an assumption that fails under occlusions, lighting changes, and non-rigid deformation. In this paper, we propose to learn the coupling between motion and frame appearance as a generative prior. We learn the distribution of motion-induced appearance residuals with a conditional diffusion model and use it to regularize reconstruction in video inverse problems. Our motion-appearance prior acts as a plug-in regularizer for diffusion-based video reconstruction, preserving the benefits of image diffusion models while remaining compatible with existing appearance regularization techniques. Experiments on dynamic video inverse problems show that reconstruction with a learnt motion-appearance coupling prior outperforms photometric-consistency and noise-warping baselines, and that the approach also transfers to cardiac MRI reconstruction.
132. 【2611.15418】ChartGalaxy++: A Richly Annotated Dataset for Chart Understanding and Generation
链接：https://arxiv.org/abs/2611.15418
作者：Duan Li,Zheng Wang,Jiangning Zhu,Yuhui Yuan,Shixia Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：charts communicate data, Infographic charts communicate, communicate data, data through cohesive, cohesive compositions
备注：
点击查看摘要
Abstract:Infographic charts communicate data through cohesive compositions of visual elements such as charts, text, and images. Existing infographic chart datasets primarily annotate individual elements with bounding boxes and category labels. Such element-level annotations do not capture hierarchical and spatial relationships, limiting their use for understanding how elements are organized and related within an infographic and for generating well-organized designs. To address this limitation, we introduce ChartGalaxy++, a richly annotated dataset of 217,195 infographic charts. At the core of this dataset is a scene graph representation, in which nodes represent visual elements and semantic groups, and edges encode their hierarchical and spatial relationships. For real infographics, we construct scene graphs by detecting and progressively grouping visual elements; for synthetic ones, we derive them directly from the generation process. We demonstrate the utility of ChartGalaxy++ through three applications: 1) image-to-scene-graph prediction, 2) scene-graph-augmented infographic question answering, and 3) evaluation of scene graph preservation in image generation. Together, these applications highlight the value of ChartGalaxy++ for advancing chart understanding and generation.
133. 【2611.15360】CARE-Drive: Coupled Alternating Refinement for Ego-trajectories
链接：https://arxiv.org/abs/2611.15360
作者：Xiao Ma,Yijun Chen,Zhiquan Hu,Jicheng Zhao,Yuming Li,Chuang Dai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：models bring multimodal, bring multimodal understanding, autonomous driving, models bring, bring multimodal
备注：
点击查看摘要
Abstract:Vision-language-action (VLA) models bring multimodal understanding and world knowledge to end-to-end autonomous driving. To further improve the quality of predicted trajectories, existing studies introduce candidate refinement, residual denoising, and token correction. However, these methods typically focus on unified refinement of the entire trajectory, paying limited attention to the distinct physical quantities and their interactions. We further investigate physical specialization and coordination in trajectory refinement, centering on position and heading for simpler and more intuitive correction modeling. To this end, we propose CARE-Drive (Coupled Alternating Refinement for Ego-trajectories), which decomposes trajectory refinement into waypoint residual correction and position-conditioned heading generation. Through imitation learning and a future-token auxiliary task, the backbone provides predictive representations and a base trajectory. The position expert predicts bounded metric waypoint residuals, while the heading expert reconstructs vehicle orientation from adjacent angular increments conditioned on the corrected path. With the backbone frozen, the two experts are optimized alternately through supervised initialization and reinforcement fine-tuning. This design simplifies refinement through clear physical specialization while preserving conditional coupling during prediction and optimization. On NAVSIM v1, CARE-Drive achieves 88.8 PDMS, improving by 2.4 points over the unrefined base trajectories generated by the same backbone. Ablation studies further support the effectiveness of specialized experts and staged training.
134. 【2611.15328】Vision-Grounded Semantic Learning and Alignment for Scalable Multilingual Text-Based Person Retrieval
链接：https://arxiv.org/abs/2611.15328
作者：Xinyu Zhou,Fan Li,Shasha Chen,Min Cao,Ahtamjan Ahmat,Qiaoming Zhu,Mang Ye
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Text-Based Person Retrieval, Multilingual Text-Based Person, Person Retrieval, Text-Based Person, aims to retrieve
备注： Accepted by ACM MM 2026 (Oral). 10 pages
点击查看摘要
Abstract:Multilingual Text-Based Person Retrieval (TBPR) aims to retrieve individuals with texts in multiple languages. Despite its practical importance, it has been overlooked by existing research, which mainly focuses on English-only retrieval. The only prior attempt at multilingual TBPR suffers from (1) the absence of a large-scale, multilingual pretraining dataset and (2) a suboptimal model architecture for multilingual text encoding and cross-modal alignment, which employs a shared encoder that overlooks linguistic heterogeneity and relies on English as a pivot for cross-modal alignment, introducing English-centric bias. For this, we contribute MultiPedes, the first large-scale, pedestrian-centric multilingual pretraining dataset. It contains 10 million image-text pairs across four languages, constructed by a multilingual quality-aware data construction pipeline. We also propose ViSeLA (Vision-grounded Semantic Learning and Alignment), a novel framework featuring: (1) a semantic-aware multilingual learning module that extends the mixture-of-experts architecture by routing language-invariant semantics to specialized experts for improved multilingual feature learning; and (2) a vision-grounded cross-modal alignment module that employs a semantic probe to capture fine-grained semantics across modalities, enabling direct cross-modal alignment without relying on a pivot language. Extensive experiments on both multilingual and English-only TBPR datasets demonstrate the effectiveness of ViSeLA. The dataset and code are available at this https URL
135. 【2611.15325】CaseScope: A Multi-Field Benchmark for Case-Level Pathology Diagnosis with Multimodal LLMs
链接：https://arxiv.org/abs/2611.15325
作者：Wenchuan Zhang,Chengyang Zhang,Fengling Li,Ting Yin,Chen Shu,Jie Chen,Shuwan Zhang,Xiaoyan Wu,Zhang Zhang,Yuhao Yi,Jiancheng Lv,Hong Bu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Pathologists rarely diagnose, power for architecture, zoom into selected, views and scales, scan a section
备注：
点击查看摘要
Abstract:Pathologists rarely diagnose from a single image: they scan a section at low power for architecture, zoom into selected fields for cytology, and integrate the evidence across views and scales. Pathology benchmarks for multimodal large language models (MLLMs), however, mostly ask about one image or require whole-slide pipelines, and the few that show several fields draw nested regions from cancer slides of one public cohort. We introduce CaseScope, a benchmark of diagnosis from several curated fields of one lesion: CaseScope-Teaching, 436 cases from a residency-training image library, reconstructed, de-identified, harmonised against a WHO-based ontology and re-examined by a pathologist wherever an automated pre-review raised a doubt, and CaseScope-Atlas, 800 cases from 88 published atlases (387 of them figure series of one disease), labelled from the captions by two LLMs that must agree. They cover 843 entities across 18 organ systems and pose 4,679 items in six tasks, from open-ended and ten-way diagnosis with ontology-guided hard negatives under circular evaluation to the verification and location of morphological findings. Across twenty-eight open and four proprietary MLLMs, diagnoses are unstable -- the best open and proprietary models are correct under all ten option rotations on 17.9% and 61.7% of the teaching cases -- and wrong answers favour the classic look-alike; open models make little use of the additional fields on teaching cases, where the one-line specimen site matters more, although on atlas cases with three or more fields the fields count about as much as the site; and most open models verify findings barely above chance (median 62.0% vs. 50%, best 81.5%), gaining a median +3.4 points from images; proprietary models reach 83.2-93.2%. Rankings broadly replicate between the sources. The evaluation code is available at this https URL.
136. 【2611.15314】AcrossPlace: Do Vision--Language Models Recognize Places Beyond Their Source Views? A Comprehensive Benchmark
链接：https://arxiv.org/abs/2611.15314
作者：Zhenyu Li,Tianyi Shang,Shuhan Dong,Ruotong Xu,Qingyu Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Language-guided place recognition, recognition requires recovering, requires recovering geographic, Language-guided place, requires recovering
备注：
点击查看摘要
Abstract:Language-guided place recognition requires recovering geographic identity across visual observations beyond the image from which a description originates. However, aggregate retrieval scores often entangle observation transfer, gallery competition, and linguistic evidence, obscuring the underlying recognition capability. We introduce AcrossPlace, a provenance-aware benchmark establishing a systematic evaluation standard for bidirectional language--vision place recognition. Built upon GSV-Cities, AcrossPlace comprises 56,726 places across 23 cities, 156,800 automatically generated, rule-filtered descriptions, and 113,404 target images. Each description retains its source-image provenance, while retrieval operates on disjoint target observations. Text-to-image (T2I) and image-to-text (I2T) retrieval share a unified place-identity relevance criterion supporting multiple valid matches. Two geographic protocols evaluate unseen places within represented cities (P0) and generalization to held-out cities (P1). Paired observation comparisons, gallery-controlled evaluations, fixed-query scaling, and blinded annotation auditing systematically characterize retrieval performance. Across three training seeds, place-supervised SigLIP2 T2I Recall@1 decreases from 19.69% on source images to 12.31% on independent targets under P0. For fixed P1 queries, expanding the gallery from 500 to 8,425 places reduces Recall@1 from 14.67% to 2.87%. A 240-description audit further reveals discrepancies between automated acceptance and factual evidence. These findings establish AcrossPlace as a reproducible evaluation standard for assessing transferable place identity across visual observations and geographic environments.
137. 【2611.15311】Arbor: When Labels Are Not Coarsened at Random
链接：https://arxiv.org/abs/2611.15311
作者：Faisal Mohammad,Mohamed Younis
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Merging datasets labelled, Merging datasets, coarse label, coarse, Coarse labels
备注： 26 pages, 7 figures, 25 tables. Appendices included
点击查看摘要
Abstract:Merging datasets labelled at different levels of a taxonomy leaves some images with only a coarse label, and some classes with no fine-grained label at all. Standard training scores a coarse label by the total probability of the classes under it. Coarse labels name superclasses, and the standard objective is exact only when every class within a superclass is equally likely to receive a coarse label. We call a class novel if it is never labelled finely, and known otherwise. A novel class violates the assumption, and the classifier assigns its images to a known sibling. We propose Arbor, which models how labels become coarse. In each superclass with a novel class, Arbor adds a virtual novel class, and a logistic gate divides the superclass's probability between it and the known classes. The gate is trained with the likelihood of the observed labels under this model, the coarsening likelihood. We prove that at its population optimum the gate equals the Elkan-Noto correction of positive-unlabelled learning, and show that training the correction into the classifier improves on applying it after training. Across Cars, CUB and Aircraft with 90% coarse labels, Arbor correctly assigns 76-85% of novel-class images to their superclass, more than hierarchical classifiers, hierarchical novelty detection and the Elkan-Noto correction. Its top-1 accuracy over the leaf classes on known-class images is within 1.6 points of the best baseline, although its final predictions return the superclass more often. On the more challenging iNaturalist-2019 benchmark, Arbor improves novel-class accuracy from 46% (uniform target, the strongest baseline) to 68%.
138. 【2611.15306】Beyond the Explicit: Benchmarking and Detecting Implicit Harm in Short Videos
链接：https://arxiv.org/abs/2611.15306
作者：Chenyang Li,Qifan Yu,Saihui Hou,Zhaofeng He
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：dominant online medium, online medium, fragmented forms, dominant online, content is increasingly
备注： 9 pages, 4 figures, 8 tables
点击查看摘要
Abstract:Short videos have become a dominant online medium, where harmful content is increasingly conveyed in implicit and fragmented forms. Prior work largely focuses on explicit categories, such as violence and hate speech, and often fails to detect videos that subtly promote misleading values through narrative context, emotional framing, or cross-modal cues, partly due to the lack of dedicated benchmarks for implicit harm. To bridge this gap, we construct DeepHarm-7K, a large-scale harmful short-video dataset comprising 7,110 samples annotated according to a fine-grained harmful-content taxonomy. The dataset systematically covers implicitly harmful videos across diverse real-world scenarios and is constructed through a rigorous multi-stage quality-control process. Building on this dataset, we propose DeepHarm-VL, a multimodal detection framework that integrates visual, audio, and cross-modal reasoning. The framework employs a two-round reasoning strategy to progressively identify surface-level evidence and infer latent harmful implications. Experimental results show consistent improvements over strong baselines and state-of-the-art methods across multiple open-source video-language models, demonstrating its effectiveness in detecting both explicit and implicit harmful short videos.
139. 【2611.15287】rack4D: Representing Dense 3D Tracking for Video Diffusion Models
链接：https://arxiv.org/abs/2611.15287
作者：Yushi Lan,Zeren Jiang,Kelvin Li,Xingang Pan,Chuanxia Zheng,Andrea Vedaldi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：video diffusion models, repurpose video diffusion, diffusion models, pretrained on millions, video
备注： NeurIPS 2026. Project page: [this https URL](https://nirvanalan.github.io/projects/track4d)
点击查看摘要
Abstract:We study how to repurpose video diffusion models (VDMs), pretrained on millions of videos, for dense 3D point tracking, where training data is scarce. Doing so is non-trivial, as it requires representing 3D tracks as video-like signals that may lie outside the natural-video distribution on which the VDM was trained. We thus systematically assess the effectiveness of two such video representations. The first, Residual 3D Tracking Video (RTV), encodes per-pixel 3D offsets relative to a query frame and allows recovery of 3D trajectories directly from the generated video. The second, Normalized Coordinate Map Video (NCMV), labels each pixel with a canonical coordinate invariant through time. This is closer to a natural video and easier for the VDM to learn, but requires additional post-processing with an off-the-shelf 2D tracker to recover 3D tracks. RTV tracks more accurately, while NCMV shows that a VDM can generate dense correspondence as a video. We instantiate both representations with LoRA adaptation of a frozen Wan backbone, conditioned on point maps from an off-the-shelf 3D reconstructor as a geometric scaffold. Trained with a single dynamic 3D tracking dataset, Track4D achieves competitive zero-shot tracking on four real and synthetic benchmarks. A regression readout that bypasses the video VAE and uses additional training data brings further improvement, demonstrating the potential of this direction for dense 3D tracking. We hope our analysis will inspire future work that leverages VDM priors for dense 3D tracking and 4D reconstruction. Project page: this https URL
140. 【2611.15278】PCLSegNet: Anatomy-Aware Deep Learning Framework for MRI-based Pancreatic Cyst Segmentation and Size Assessment
链接：https://arxiv.org/abs/2611.15278
作者：Hanyi Zhang,Tongyu Wang,Manuel Debic,Markus Wennmann,Johannes Haubold,Tamara Schikowski,Wilfried Reichardt,Fabian Bamberg,Christopher L. Schlett,Steffen Ringhof,Thoralf Niendorf,Tobias Pischon,Michael Leitzmann,Carsten Oliver Schmidt,Mark Oliver Wielpütz,Thomas Kroencke,Josua A. Decker,Stefan N. Willich,Thomas Keil,Rafael Mikolajczyk,Miriam Klauß,Hans-Ulrich Kauczor,Philipp Mayer,Bettina K. Budai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：mucinous cystic neoplasms, papillary mucinous neoplasms, pancreatic cystic lesions, intraductal papillary mucinous, cystic neoplasms
备注： 17 pages, 4 figures, 6 tables
点击查看摘要
Abstract:Early detection and follow-up of pancreatic cystic lesions (PCLs) are crucial, as some of their subtypes, such as mucinous cystic neoplasms (MCNs) and intraductal papillary mucinous neoplasms, carry a significant risk of malignant transformation. Although most AI studies investigating PCLs rely on computed tomography (CT) scans, magnetic resonance imaging (MRI) offers superior soft tissue contrast, making it highly suitable for PCLs assessment. In this work, we propose an anatomy-aware two-stage deep learning framework for automated PCLs segmentation on abdominal MRI scans. First, a publicly available pancreas segmentation model is used to localize the pancreas. Then, we introduce the anatomyaware PCLSegNet, which incorporates anatomical priors as guidance for pancreas and PCLs segmentation. To address the class imbalance problem, we develop a Class-Specific ErrorWeighted (CSEW) loss function. Postprocessing is applied through anatomical this http URL proposed method outperforms multi-organ segmentation models such as TotalSegmentator, achieving substantially higher Dice scores for pancreas segmentation. Moreover, it also achieves a superior normalized surface Dice (NSD) and recall for PCLs segmentationcompared to other state-of-the-art models like nnU-Net, while also notably reducing the false negative rate, facilitating the automatic early detection and the noninvasive imaging-based assessment of PCLs.
141. 【2611.15260】Driving World Models Move the Camera, Not the Scene
链接：https://arxiv.org/abs/2611.15260
作者：Yuqiao Feng,Xiaoyu Ao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Plan-conditioned driving world, control metrics check, compare candidate plans, Plan-conditioned driving, driving world models
备注： 23 pages. Project page: [this https URL](https://joefeng0571.github.io/retime-compose/)
点击查看摘要
Abstract:Plan-conditioned driving world models are used to compare candidate plans, so their forecast should change with the plan as the real scene would, yet widely used control metrics check only whether the camera follows the command. Recorded drives already contain real outcomes of plans that were never driven: retiming a log gives pose-matched images and LiDAR for other speeds, and a stereo rig records a laterally shifted view. Against these references, released world models move their camera but barely move the scene: their scene response, the share of the real change in distance that the forecast reproduces, reaches at most about a third of real video's, and the trajectory score cannot tell an executed speed command from an ignored one. Interventions inside the generator trace the failure to the plan's channel. The forecast geometry follows the context frames; once they carry the planned geometry, plan tokens add little. ReTime-Compose therefore delivers the plan as geometry, without training. It transports the frames of one logged-speed rollout to the planned cameras, and the frozen model completes only what no frame covers. Frozen generators then follow a 0.54 m lateral shift nearly as the real scene does on KITTI, nuScenes and Argoverse 2, and respond more than re-sampling to slow-down plans in three generators and to speed-up plans in two.
142. 【2611.15217】Are We Ready for Snow-tonomous Driving? Challenges Toward Robust Automated Driving in Extreme Weather
链接：https://arxiv.org/abs/2611.15217
作者：Eren Erdal Aksoy,Abu Mohammed Raisuddin,Thien-Thu Ngo,Eren Aydemir,Osman Tahir Ekşi,Paula Litkey,Petri Manninen,Heikki Hyyti,Jyri Maanpää,Tarmo Kivioja,Tuomas Herranen,Väisänen Sofie,Niemi Kalle,Isabelle Morvan,Pierre Duthon,Ian Marsh,Martin Sanfridson,Henrik Toss,Thanh Bui,Yuri Poledna,Maikol Funk Drechsler,Mikko Tarkiainen,Matti Kutila,Topi Miekkala,Stefan Parzefall,Valentina Donzella,Pak Hung Chan,Sogol Kharrazi,Mario Ceccarelli
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：gained remarkable momentum, academia investing substantial, investing substantial resources, advance vehicle autonomy, past decade
备注：
点击查看摘要
Abstract:Automated driving has gained remarkable momentum over the past decade, with both industry and academia investing substantial resources in developing perception and control solutions to advance vehicle autonomy. However, these efforts have largely focused on clear-weather scenarios, leaving harsh conditions, such as snow, rain, and fog, comparatively understudied. As a result, inclement weather remains one of the most significant hurdles for autonomous vehicles, often leading to substantial performance degradation in downstream perception and control tasks. In this paper, we present insights from the EU-funded Horizon Europe project ROADVIEW, which aims to develop robust, weather-aware perception and control modules for connected and automated vehicles operating under severe conditions, including snow, rain, and fog. Drawing on four years of large-scale development and real-world demonstrations across multiple vehicle platforms in different locations, we identify ten key challenges that hinder the development of weather-resilient autonomy, including data scarcity, domain shifts, limitations in multimodal perception, control robustness, and validation gaps, among others. We summarize these challenges and lessons learned toward enabling reliable snow-autonomous driving, highlighting critical directions for future research and standardization.
Subjects:
Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.15217 [cs.RO]
(or
arXiv:2611.15217v1 [cs.RO] for this version)
https://doi.org/10.48550/arXiv.2611.15217
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
143. 【2611.15216】Where is My Mug? Training-Free Framework for Personalized Image Segmentation
链接：https://arxiv.org/abs/2611.15216
作者：Quang Qui-Vinh Nguyen,Hung Nguyen,Rang Nguyen,Khoi Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Personalized Image Segmentation, target image, Personalized Image, Image Segmentation, aims to segment
备注：
点击查看摘要
Abstract:\textbf{Personalized Image Segmentation (PIS)} aims to segment the specific object in a target image that matches a user-provided reference. Unlike category-based segmentation or few-shot segmentation, PIS must discriminate between multiple visually similar instances, a requirement central to deployed applications such as augmented reality, personalized content editing, robotics manipulation, inventory tracking, and fine-grained visual retrieval. We show that the strong numbers reported by existing PIS methods are largely an artifact of single-instance benchmarks: when evaluated on realistic scenes with several same-category look-alikes, prior point-prompt methods collapse, because the correct instance is frequently never surfaced as a prompt. We trace this to a recall bottleneck rather than a mask-quality one, and address it with a training-free, modular system. The pipeline first generates high-recall object proposals using an off-the-shelf class-agnostic detector, then matches each proposal to the reference using foundation-model features (e.g., BLIP-2), and finally refines the selected box with SAM. For robust matching we propose \textbf{top-$K$ Sinkhorn}, a patch-level distance that scores each candidate only on its most confidently matched patches; trimming the Sinkhorn dual potentials recovers the robustness of partial optimal transport at more than $100\times$ lower cost, keeping it inside the per-proposal candidate loop. To evaluate this regime, we introduce \textbf{\datasetname}, a realistic multi-instance benchmark. Across \datasetname, PerSeg, PerMIS, and DAVIS, our system surpasses PerSAM, $\mathrm{P}^2\mathrm{SAM}$, and PDM by up to $\sim\!48$ mIoU while matching their runtime and using fewer parameters, establishing a strong, deployable training-free baseline for real-world personalized segmentation.
144. 【2611.15195】A General Concept-based Decomposition for Vision-Language Embeddings
链接：https://arxiv.org/abs/2611.15195
作者：Simone Alberto Peirone,Ortal Senouf,Francesca Pistilli,Giuseppe Averta,Pascal Frossard
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multi-modal alignment, world through multi-modal, remains unclear, representations truly align, naturally describe
备注： Accepted at NeurIPS 2026. Project page at [this https URL](https://sapeirone.github.io/grace/)
点击查看摘要
Abstract:Vision-Language Models are designed to capture the compositional structure of the world through multi-modal alignment; however, it remains unclear whether their representations truly align with the way a human would naturally describe the same visual input. Prior works attempt to decompose visual embeddings into their concept-level contributions, but their instance-level optimization is inherently local and does not capture the model's global semantic structure, which is essential for compositional generalization across different inputs, tasks, and domains. We introduce GRACE, a method that learns this concept-based structure at the feature space level, producing semantic and general concept decompositions. To achieve this, we propose a novel training objective that preserves the geometric relations of different samples in the concept space, enabling a better understanding of how concepts compose and relate to each other. We validate GRACE on several image and video benchmarks, showing that its concept decomposition is aligned with human perception and achieves faithful decompositions across different tasks and domains. With minimal overhead, GRACE makes existing Vision-Language Models more interpretable, while preserving most of their original performance.
145. 【2611.15194】he Neighbour's Label: Opposite Subgroup Effects of Same-Dialogue Exposure in Next-Act Evaluation
链接：https://arxiv.org/abs/2611.15194
作者：Ali Amini,Masoumeh Chapariniya,Rytis Maskeliunas,Robertas Damaševičius
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Window-based next-act evaluation, Window-based next-act, next-act evaluation, evaluation often aims, aims to measure
备注：
点击查看摘要
Abstract:Window-based next-act evaluation often aims to measure generalisation across dialogues, yet overlapping windows and similarity retrieval can expose labelled examples from the test dialogue. The nearest such example is the target's labelled predecessor, whose act is correct when the target continues it and wrong when the target changes act; a model that copies it can gain and lose in two subgroups that one aggregate averages. We induce this exposure under controlled designs on SGD, STAR and AMI, whose official splits are clean. Randomly including the predecessor's row in training raises a lexical classifier's continuation scores and lowers its transition scores in all three corpora, and purging the adjacent rows removes most of the gain. With TF-IDF-retrieved demonstrations, two 7B instruction-tuned models show the same opposite pattern in all eight model-corpus-sample arms (some single-cell intervals include zero; one replication is partial), while natural-weight accuracy changes by only -0.05 to +0.04. Exposure frequency depends on the retrieval pipeline. We evaluate two diagnostic comparisons without model retraining and find that excluding the test dialogue does not detectably reduce accuracy on SGD. All exposure is induced; no published system was re-evaluated.
146. 【2611.15187】OT-BLS: Optimal-Transport-based Backbone Layer Selection for Frozen DINOv3 in Cross-Domain Few-Shot Segmentation
链接：https://arxiv.org/abs/2611.15187
作者：Natsuo Okamoto,Kazuki Kobayashi,Yoshio Kato,Shuhei Tarashima
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cross-domain few-shot segmentation, previously unseen domain, Cross-domain few-shot, Training-free CD-FSS methods, few-shot segmentation
备注： Accepted for publication at the 2026 IEEE International Conference on Visual Communications and Image Processing (VCIP 2026)
点击查看摘要
Abstract:Cross-domain few-shot segmentation (CD-FSS) aims to segment a target class in images from a previously unseen domain using only a few annotated support examples. Training-free CD-FSS methods, which typically leverage vision foundation models such as DINOv3, achieve competitive performance without parameter updates. However, the optimal DINOv3 layer for mask prediction varies across support--query episodes. Although several layer-selection criteria have been proposed, they do not explicitly evaluate whether the predicted query foreground and background labels agree with the corresponding support labels. To address this limitation, we propose a novel layer-selection criterion, Optimal-Transport-Based Backbone Layer Selection (OT-BLS). Our key insight is that an effective layer-selection criterion can be derived from the optimal-transport correspondence between query and support patch-token features. Based on this insight, we first estimate the transport plan using a well-established optimal transport algorithm and then compute a layer-selection score by aggregating the transported mass according to the foreground--background partition defined by each candidate query mask. The resulting score reflects how well the predicted foreground and background of the query correspond to those of the support. Experiments on eight benchmark datasets demonstrate the effectiveness of OT-BLS. It outperforms the conventional last-layer baseline in 12 of 16 dataset/shot settings. Furthermore, OT-BLS improves the average mIoU from 55.72 to 57.62 and achieves a 2.99-point improvement over the best-performing existing layer-selection criterion while running 3.7--14.6$\times$ faster.
147. 【2611.15184】GingivitisSeg: A Public Dataset and Comparative Benchmark for Gingivitis Segmentation in Intraoral Images
链接：https://arxiv.org/abs/2611.15184
作者：Zeynep Ozdemir,Zehra Hasgul,Irem Ulku,Omer Ozgur Tanriover,Fatma Karacaoglu,Murat Akkaya
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：computer-assisted periodontal assessment, foreground-background class imbalance, support computer-assisted periodontal, delineation remains challenging, remains challenging due
备注： Preprint. Under review at Journal of Imaging Informatics in Medicine. Dataset and code: [this https URL](https://github.com/zeynepozdemir/GingivitisSeg) . Dataset DOI: [https://doi.org/10.5281/zenodo.21098897](https://doi.org/10.5281/zenodo.21098897)
点击查看摘要
Abstract:Gingivitis segmentation from intraoral photographs can support computer-assisted periodontal assessment, but pixel-level delineation remains challenging due to severe foreground-background class imbalance, low-contrast boundaries, and variations in illumination and anatomy. We introduce GingivitisSeg, a public benchmark comprising 961 intraoral images with pixel-level annotations of gingival inflammation and predefined training (672), validation (144), and test (145) partitions. Seven semantic segmentation model-backbone configurations were compared using standardized partitions, input resolution, and evaluation metrics. Controlled ablation experiments examined class-weighted cross-entropy loss, Dice loss, and auxiliary supervision. UPerNet with ResNet50 achieved the highest mean Intersection over Union (mIoU) of 76.49% and gingivitis IoU of 54.91%. However, differences from DeepLabV3+ with ResNet50 and SegFormer with MiT-B2 were not statistically significant after Holm correction. The evaluated optimization components improved performance when combined in the UPerNet-ResNet50 configuration. Further analyses showed that performance was associated with gingivitis region size and decreased under stronger image blur. The dataset, benchmark splits, and source code are available at this https URL.
148. 【2611.15168】MAST: Medoid-Anchored Subspace Steering for Visual Grounding in Multimodal LLMs
链接：https://arxiv.org/abs/2611.15168
作者：Zhitao Chen,Zhenxin Cai,Jingyuan Li,Jin Sha
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：large language models, multimodal large language, Existing activation steering, Existing activation, language models
备注：
点击查看摘要
Abstract:Existing activation steering methods for multimodal large language models (MLLMs) use the global activation mean as the steering vector, which tends to cause cross-task interference and unstable performance. We trace this failure to the multi-centered geometry of task activations. The global mean lands in the empty region between clusters and is faithful to no single task. Moreover, the steering signal in each task-pure local cluster is low-rank, and different query tasks benefit from emphasizing different families of local-basis directions under the shared routing protocol. To address this, we propose MAST (Medoid-Anchored Subspace Steering), a training-free, input-adaptive activation steering framework. MAST groups samples by task, performs multi-center clustering within each group, and selects one representative medoid per cluster. At inference time, each query is routed to multiple representative medoids. For each matched cluster, a low-rank local steering direction is extracted and aggregated across clusters to produce the final steering vector. Building on MAST, MAST-PR (Probe-Reweighted) uses a lightweight task-aware probe to reweight task-specialized local-direction families, yielding a further average improvement of +8.09 points over MAST.
149. 【2611.15165】Bridging Update Coordination and Flatness in Federated Learning
链接：https://arxiv.org/abs/2611.15165
作者：Chongwei He,Shichen Huang,Jiayun Li,Deyuan Lin,Wangze Jiang,Shengjia Li,Xu Wang,Xiaofan Li,Zhi-Ri Tang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：sharing raw samples, combines complementary knowledge, raw samples, Federated learning combines, limitations without sharing
备注： 16 pages, 6 figures
点击查看摘要
Abstract:Federated learning combines complementary knowledge across clients to alleviate local data limitations without sharing raw samples. However, data heterogeneity can cause conflicting updates and hinder generalization. Update coordination reduces interference among client updates, while flatness optimization reduces sensitivity to parameter perturbations to improve generalization. Existing joint designs largely target specific algorithms, limiting flexible combinations of these approaches. To address this problem, we propose a unified federated learning framework that bridges update coordination and flatness optimization. Clients separately accumulate descent signals and flatness corrections along the same local trajectory. The server coordinates both groups with independent states before fusing their outputs into a global update. Explicit conversion between trajectory signals and model updates enables different coordination strategies to work with compatible local or globally guided flatness mechanisms without changing the inference architecture. Experiments show that the evaluated combinations generally improve average and worst-client accuracy over update coordination alone, demonstrating the effectiveness of the proposed framework in combining these complementary optimization mechanisms.
150. 【2611.15161】CineMME: From Dialogue Grounding to Narrative Reasoning in Multimodal Video Understanding
链接：https://arxiv.org/abs/2611.15161
作者：Jin Liu,Dawei Du,Yexiang Liu,Sijie Zhu,Fan Chen,Junxian Duan,Huaibo Huang,Ran He,Longyin Wen,Zhenfang Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recognizing visible events, infer narrative meaning, visible events, video understanding requires, recognizing visible
备注： Accepted to NeurIPS 2026 (Evaluations Datasets Track). Project page: [this https URL](https://cinemme.github.io/)
点击查看摘要
Abstract:Narrative video understanding requires more than recognizing visible events: models must extract evidence from dialogue, bind it to speakers, and use it to infer narrative meaning. Existing video benchmarks evaluate aspects of this problem, including video question answering, audio-visual reasoning, and temporal grounding, but rarely test whether these abilities form a coherent dialogue-to-plot evidence chain within the same clips. We introduce \textbf{CineMME}, a human-verified benchmark designed to diagnose dialogue-grounded plot understanding, supported by approximately $1,600$ expert person-hours of annotation. CineMME contains $975$ curated short narrative video clips and two linked tracks: \textit{CineMME-Grounding}, with $13,554$ timestamped speech segments and $33,083$ speaker face boxes for temporal dialogue localization, transcription, and active-speaker grounding; and \textit{CineMME-Reasoning}, with $1,600$ multiple-choice and $316$ open-ended questions spanning perception, audio, narrative, social, and scene-presentation understanding. Our main evaluation compares $20$ MLLMs on reasoning and $9$ omni-modal models on grounding. The results reveal a pronounced who-what-when decoupling: Gemini-3 Pro localizes dialogue in time ($68.34\%$ tIoU) and transcribes it with a WER of $28.99\%$, yet achieves only $7.74\%$ vIoU for active-speaker grounding while achieving $67.66\%$ MCQ accuracy on questions with extractable answers. Modality ablations further show that vision is not uniformly beneficial: it improves performance on perception-heavy questions but can hurt dialogue-centric reasoning. CineMME provides a compact diagnostic testbed for evaluating how multimodal video models connect dialogue, speakers, visual evidence, and narrative meaning.
151. 【2611.15153】MatrixSplat: Matrix-Parallel and Feature-Scalable 3D Gaussian Splatting Rendering on GPUs
链接：https://arxiv.org/abs/2611.15153
作者：Yangming Zhang,Siyi Wu,Jian Wang,Bingzhe Li,Wei Niu,Sheng Di,Ming Li,Miao Yin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Tensor Cores, mainstream representation, representation for real-time, real-time novel view, view synthesis
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) has emerged as a mainstream representation for real-time novel view synthesis and 3D reconstruction. However, existing 3DGS rendering pipelines are poorly aligned with modern GPU architectures: depth-sorted alpha compositing introduces strong per-pixel sequential dependencies, limiting parallelism and resulting in scalar FMA-dominated execution that underutilizes high-throughput matrix units such as Tensor Cores. This mismatch becomes more severe for multimodal and semantically enriched 3DGS, where high-dimensional features must be accumulated from millions of Gaussians, leading to rapidly increasing computation and memory costs. We propose MatrixSplat, a matrix-parallel rendering framework for feature-scalable 3DGS on modern GPUs. We first identify the sequential dependency of alpha compositing as a key obstacle to efficient high-dimensional feature rendering, and adopt an order-independent weighted accumulation formulation that transforms feature rendering into matrix-oriented computation. Our framework features three key designs: (i) a tile-based splatting pipeline that maps feature accumulation to warp-level matrix-multiply-accumulate execution on Tensor Cores; (ii) a warp-granularity Gaussian packing strategy that mitigates visibility irregularity and improves feature reuse; and (iii) a lazy channel-batched feature-fetching pipeline that reduces shared-memory pressure, maintains high warp occupancy, and overlaps memory access with matrix execution for high-dimensional features. On Mip-NeRF 360, LERF, and 3D-OVS, MatrixSplat achieves up to 3.8$\times$ speedup over 3DGS and 2$\times$ over TC-GS while maintaining rendering quality and semantic accuracy, and further reduces render-kernel time by up to 36.7$\times$ for high-dimensional features. Integrated into existing fast renderers, it provides an additional 1.69-2.84$\times$ speedup.
152. 【2611.15149】From Concepts to Interactions: Dynamic Graph Semantic Recomposition for Safe Visual Generation
链接：https://arxiv.org/abs/2611.15149
作者：Qinghui Gong,Jinshan Lai,Xunlei Chen,Hua Meng,Zhengchun Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent advances, flow-matching Transformers, Transformers have greatly, risks producing illegal, greatly improved
备注： 23 pages,15 figures
点击查看摘要
Abstract:Recent advances in flow-matching Transformers have greatly improved Text-to-Image (T2I) and Text-to-Video (T2V) generation, but unconstrained generation risks producing illegal or unethical content. Safety alignment must therefore suppress unsafe content while preserving legitimate generation. A concept's safety depends on context: a knife used for cooking is safe, whereas its use in violence is harmful. Yet most concept erasure methods indiscriminately suppress static, isolated representations, overlooking evolving semantic interactions. Consequently, safe scenes containing potentially sensitive terms may be unintentionally suppressed, compromising generation quality. To address this, we propose Dynamic Graph Semantic Recomposition (DGSR), which dynamically constructs and updates a semantic interaction graph from evolving text visual states during sampling. Context aware graph reasoning captures semantic dependencies, while paired safe/unsafe supervision distinguishes harmful from legitimate interactions, enabling precise identification of and selective intervention on high risk semantic relationships while preserving benign semantics. DGSR freezes the pretrained backbone and supports both image and video generation. Experiments show that DGSR achieves the lowest Attack Success Rate (ASR) in 10 of 12 T2I evaluations and reduces the average T2V unsafe frame rate by 41.2\% relative to the strongest baseline, while maintaining high generation fidelity and temporal consistency.
153. 【2611.15146】Reframing Video Inverse Tone Mapping as Blind Posterior Inference via Latent Luminance Supervision
链接：https://arxiv.org/abs/2611.15146
作者：Hanwool Sul,Chang-Hoon Jeong,Kisung Shin,Bomseok Park,Donghoon Cha,Hansl von Kwon,DoHyung Ku,Byoung-Tak Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：standard dynamic range, archival footage, dynamic range, HDR, standard dynamic
备注：
点击查看摘要
Abstract:High-dynamic-range (HDR) displays are now common, but most video content, such as archival footage, broadcast material, and the output of generative video models, exists only in standard dynamic range (SDR). The need is sharpest for generated video, which has no HDR master at all and is graded alongside live-action and visual-effects material finished in HDR. Converting SDR to HDR means undoing a tone-mapping operation that was never recorded, and clipping destroys the radiance wherever it acts, so HDR recovery is a blind inverse problem. Methods built on generative video priors fill clipped regions with plausible structure, but their reconstructions are systematically biased: in every public method we test, saturated content leans too bright or too dark, and the direction of the lean moves with the tone operator behind the input. We call this failure the luminance error, measure both its magnitude and its sign, and make it the focus of this work. Reframing ITM as posterior inference under an unknown operator locates the failure in two places and yields two corrections. A fixed affine functional of the video-diffusion latent reads log-luminance without decoding; on that coordinate an asymmetric loss selects an expectile of the posterior, applied only where clipping leaves luminance unconstrained. We also synthesize training SDR through an explicit family of tone operators, so the model marginalizes over what the observation cannot show. Trained this way, our luminance error stays flatter across operators and smaller on average than any public method, and the full system achieves the best perceptual quality on all three benchmarks.
154. 【2611.15143】Multi-View 3D Reconstruction Using V-JEPA Features
链接：https://arxiv.org/abs/2611.15143
作者：Anwar Shamim,Jeffrin Sam
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：provide dense visual, reconstruction requires accurate, requires accurate depth, dense visual representations, encoders provide dense
备注： 29 pages, 11 figures. Source code is available at [this https URL](https://github.com/Anwarshamim01/multi-view-3d-reconstruction-using-v-jepa-features)
点击查看摘要
Abstract:Predictive video encoders provide dense visual representations, but adapting them to 3D reconstruction requires accurate depth, camera poses, and cross-view geometry. We study supervised RGB-only multi-view reconstruction using an architecture that combines video-pretrained features, camera estimation, scene aggregation, epipolar transport, and residual pointmaps. Experiments compare global and spatial camera regression with joint relative objectives on CO3D, alongside an independently trained TUM RGB-D model. On 168 CO3D five-view windows, the spatial-camera configuration achieves 29.3% lower absolute trajectory error than the global-camera configuration, but performs worse than identity poses in trajectory error and worse than the global configuration in depth error. The joint relative-objective configuration improves normalized intrinsics error and similarity-aligned Chamfer distance from 0.6447 to 0.5573, but increases raw Chamfer distance from 3.5535 to 4.4374. On 163 indoor windows, camera error is 0.3063 m versus 0.3694 m for identity poses, while depth error is 0.4279 versus 0.2516 for constant median depth. Refinement worsens indoor camera error, and additional experiments show competing depth and pose effects. Overall, the results distinguish representation adaptation, aligned shape, and raw reconstruction, highlighting the need for isolated component and encoder comparisons before attributing reconstruction gains to predictive video pretraining.
155. 【2611.15131】Duo: A Reciprocal World Model for Full-Duplex Interaction
链接：https://arxiv.org/abs/2611.15131
作者：Hengyuan Cao,Biao Gong,Guoshan Lu,Qiyuan Zhang,Lin Liu,Yiding Tian,Yilei Jiang,Yuxin Ma,Chengzhang Wu,Kun Chen,Yiqian Xie,Ting Liu,Xin Zheng,Xijun Gu,Tianren Ma,Jiancheng Pan,Chi Zhang,Xuzhe Zheng,Siyi Li,Zhenzhong Lan
类目：Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
关键词：Reciprocal World Model, Reciprocal World, World Model, RWM treats intelligence, World
备注： [this https URL](https://duo-v1.github.io/)
点击查看摘要
Abstract:In this report, we introduce the Reciprocal World Model (RWM) and present Duo v1, a full-duplex world model that continuously perceives audiovisual inputs while responding to users in real time. The RWM treats intelligence and physical reality as equally fundamental to what constitutes a world. Existing world models largely focus on simulating the latter, leaving reasoning and decision-making as external controls rather than intrinsic parts of the world itself. In RWM, we identify two equally fundamental capabilities: Intent, which provides the cognition underlying world interactions, and Realization, which generates coherent audio-visual behavior. To realize this formulation, Duo v1 introduces three key technical designs: (1) Leveraging autoregressive modeling for continuous interaction reasoning and participation decisions, rather than restricting it to instruction understanding for diffusion models. (2) Constructing chunk-specific conditions and synchronize tokens across Intent and Realization on a unified timeline. Module-specific attention masks enforce causal dependencies both within and across chunks, preventing access to future inputs. (3) Mitigating distribution shift in both modules through dual rollout distillation, training on autoregressively generated Intent tokens and synthesized audiovisual histories from Realization. Both modules continuously perceive real-time audio, video, and text, enabling full-duplex interaction with spontaneous conversations and interruptions. Beyond conversation, users can share real objects, reshape virtual scenes, guide assistants, or play audiovisual games without mouse or keyboard controls. The release of Duo v1 makes our first step, with the next version coming soon. We look forward to broader exploration of this emerging field.
156. 【2611.15125】oward Cross-Rubric Surgical Skill Assessment via Joint Embedding Prediction
链接：https://arxiv.org/abs/2611.15125
作者：Jiajun Cheng,Haidar M. Abdul-Muhsin,Juha Choi,Shan Lin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Expert review, motivating AI-assisted skill, motivating AI-assisted, feedback at scale, provide feedback
备注：
点击查看摘要
Abstract:Expert review of surgical videos is essential for surgical training but labor-intensive, motivating AI-assisted skill assessment to provide feedback at scale. Although surgical assessment rubrics may use different language to describe similar skills, existing automated methods commonly predict predefined skill levels or numerical scores tied to fixed rubrics, limiting their ability to transfer across semantically equivalent assessment criteria. We propose Predictive Rubric Alignment (PRA), a joint embedding prediction approach that scores surgical videos using natural-language descriptions of skill levels. Rather than matching level probabilities, PRA predicts a rater-weighted combination of skill-level description embeddings. Adjacent description features define a score-parameterized path, and the predicted embedding is projected onto this path to read the score. We introduce two variants: \textit{PRA-item}, which uses learned queries for predefined assessment items, and \textit{PRA-cond}, which generates queries from textual item names to enable assessment of unseen items without retraining. On AIxSuture, a dataset of expert-rated suturing videos, PRA outperforms published baselines in skill classification. We further evaluate zero-shot transfer to the smaller surgical skill assessment benchmark JIGSAWS. Trained on only two AIxSuture rubric items, PRA-cond assesses unseen JIGSAWS items without further training, yielding positive score correlations and greater Grad-CAM overlap with instruments and suture than a description-matching baseline. These results support predictive rubric alignment as a promising direction for flexible and explainable automated surgical skill assessment.
157. 【2611.15107】From Seeing to Remembering: Brain-Informed Agentic Text-to-Video Generation for Enhancing Memorability
链接：https://arxiv.org/abs/2611.15107
作者：Shengqi Dang,Yi He,Jiaying Lei,Feilin Han,Nan Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：faithfully convey intended, Generating videos, convey intended semantics, faithfully convey, convey intended
备注：
点击查看摘要
Abstract:Generating videos that faithfully convey intended semantics while remaining memorable to viewers is valuable for applications such as advertising, education, and storytelling. However, memorability-oriented text-to-video generation remains underexplored, as human memory involves complex neural processes that are difficult to model and translate into generation guidance. In this paper, we propose MemCrafter, brain-informed approach that enhances video memorability through iteratively agentic prompt refinement. The agentic framework contains two key components. First, we construct a cortical region-based neuro-memorability signal that predicts video memorability from estimated neural responses, providing both an optimization objective and interpretable region-level information. Second, we develop a sensitivity-aware feedback module, motivated by a conceptual sensitivity analysis of the optimization objective, to derive actionable guidance for prompt refinement while preserving semantic fidelity. Extensive experiments demonstrate that MemCrafter consistently improves predicted video memorability while maintaining semantic alignment and perceptual quality.
158. 【2611.15100】Keep Images in Sight: Visual Position Re-Anchoring for Long-Context MLLMs
链接：https://arxiv.org/abs/2611.15100
作者：Juntao Xu,Qichai Zhao,Rui Sun,Zhouyang Jiang,Shiwei Wu,Zhi Li,Kaisheng Ma,Yu Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Long-context multimodal intelligence, multimodal intelligence requires, intelligence requires revisiting, requires revisiting earlier, Long-context multimodal
备注： 23 pages, including supplementary material
点击查看摘要
Abstract:Long-context multimodal intelligence requires revisiting earlier images as conversations and documents accumulate, yet retaining an image does not guarantee reliable access to its details. By varying context length, redistributing a fixed text passage around the image, and changing positions without adding text, we identify the positional relation between images and questions as a direct influence on visual access. To address this gap, we propose Visual Position Re-Anchoring (VPR), a training-free method that shifts cached visual-key rotary phases toward a short-context reference before question processing. It operates directly on the existing KV cache, preserving standard attention computation without extracting attention maps or adding model forward passes. We develop static and continuous compensation schedules, using the static schedule by default. Across ten checkpoints and ten benchmarks, static VPR improves 97 of 100 model--task scores. Further analysis shows greater attention to regions containing answer evidence across six checkpoints, with minimal runtime overhead under fixed rotary frequencies. These findings demonstrate an efficient way to sustain visual access through positional adjustment within the cache.
159. 【2611.15082】Prediction or Persistence? What Future-Prediction Scores Miss About World Models
链接：https://arxiv.org/abs/2611.15082
作者：Animesh Maheshwari
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：Pretrained video world, robot learning largely, Pretrained video, video world models, compared and chosen
备注： Accepted at the CoRL 2026 Workshop "Do Robots Need World Models?"
点击查看摘要
Abstract:Pretrained video world models are compared and chosen as components for robot learning largely by future-prediction scores. On its own, such a score cannot be read as evidence of prediction, because it mixes encoder quality, the near future's resemblance to the recent past, and the predictor's own contribution. We separate the three with a matched control. On 27,000 future-retrieval trials from household egocentric video, a model must pick the true continuation of a clip among eleven candidates from the same video (chance 0.091), ranked zero-shot by its own training criterion. Each model is paired with a persistence control, an identical copy whose predictor is never invoked, so the paired difference isolates the predictor. Score and contribution dissociate within the native-video V-JEPA family alone: the predictor adds +0.291 top-1 for V-JEPA 2.1 but +0.03 to +0.04 for V-JEPA 2 on the identical trials. Across five models the contribution ranges from +0.291 to negative, and it is negative only for the two action-conditioned models, which we evaluate outside their training regime. Persistence alone recovers the encoder ordering expected from pretraining, a sign that the probe tracks real signal. We suggest reporting each future-prediction score together with its persistence baseline. The gap between them, not the score, is what makes the number interpretable: a necessary check costing one forward pass. Establishing downstream usefulness is a separate matter, for a planning or control evaluation.
160. 【2611.15079】SAVE: Less is More in Agentic Video Reasoning
链接：https://arxiv.org/abs/2611.15079
作者：Tymoteusz Wilk,Sergey Prokudin,Xi Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：frameworks iteratively explore, Agentic, video, iteratively explore, observe based
备注：
点击查看摘要
Abstract:Agentic video-reasoning frameworks iteratively explore a video, choosing what to observe based on the query and evidence gathered so far. Existing methods are typically evaluated with different backbones, preprocessing pipelines, and computational budgets, making it difficult to determine which components actually drive performance, how much they cost, and whether agentic inference is preferable to native video reasoning in the first place. We conduct a controlled evaluation of a diverse set of recent agentic video-reasoning systems across two strong contemporary backbones, with explicit token and monetary-cost accounting. Across Gemini 3 Flash and Gemma 4, most existing agentic frameworks fail to consistently improve over native video inference and often increase computational cost. We investigate two primary questions: (1) How much agentic framework complexity is necessary for effective video reasoning? (2) When, if at all, is agentic video reasoning preferable to just using the backbone directly? To answer the first question, we introduce a deliberately minimal Active Exploration Baseline and show that it remains competitive with substantially more elaborate agents. We then propose targeted extensions to this baseline, yielding SAVE (Simple Agentic Video Explorer). SAVE outperforms all evaluated prior agentic methods in five of six backbone-benchmark settings. Turning to the second question, our results indicate that the advantage of agentic exploration grows when dense processing would otherwise represent answer-relevant events too sparsely, particularly for long videos and temporally concentrated evidence. Overall, our results suggest that agentic video reasoning should favor simple frameworks over increasingly elaborate pipelines and focus primarily on long-form video, where selective evidence acquisition offers the clearest advantage over native inference.
161. 【2611.15069】DiFiT: Distribution-Fidelity-guided Visual Token Pruning for Multimodal Large Language Models
链接：https://arxiv.org/abs/2611.15069
作者：Jingyuan Zhang,Nihao Niu,Xinyang Lv,Beibei Han,Xiaoyun Wang,Yanning Hou,Ke Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal large language, large language models, reflects its effect, inference cost, cost of multimodal
备注： 8 figures, 13 tables
点击查看摘要
Abstract:Visual token pruning reduces the inference cost of multimodal large language models, but answer accuracy only partly reflects its effect. Pruning can change the probabilities of alternative response tokens even when greedy answers remain correct and unchanged. We compare full and pruned response distributions under shared reference prefixes. Average predictive drift grows with compression on fixed correctly answered samples. Separate analyses associate larger drift with more confidence-decision disagreements and sampling failures. We propose DiFiT (Distribution-Fidelity-guided Token pruning) to learn discrete selection from reference answers and full-token response distributions. Dual-View Distillation matches probabilities across the vocabulary, while answer supervision supports task quality. A learned scorer and differentiable Top-$K$ learn which visual evidence to retain. A multi-budget mask objective supports different retention ratios through one shared ranking over a frozen model. On Qwen2.5-VL-7B, DiFiT reduces sampling-induced negative flips by 30.3% relative to FastV at 10% retention on four-task greedy-correct controls. It preserves 98.74% of baseline performance on MME at 30% retention.
162. 【2611.15059】st-Time Selective Adaptation for Cross-Modal UAV Object Tracking with Token Shift
链接：https://arxiv.org/abs/2611.15059
作者：Yun Xiao,Hailong Ye,Zhicheng Zhao,Lei Liu,Amir Hussain
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cross-modal unmanned aerial, unmanned aerial vehicle, faces modality-induced appearance, modality-induced appearance discrepancies, UAV motion
备注：
点击查看摘要
Abstract:Cross-modal unmanned aerial vehicle (UAV) object tracking faces modality-induced appearance discrepancies and abrupt target-position shifts that can arise from modality switching, UAV motion, and inter-sensor offsets. Although existing methods model modality and spatial variations, they primarily rely on offline representation learning and offer limited localization-oriented adaptation during testing. To address these challenges, we propose Test-Time Selective Adaptation with Token Shift (TSAT), which derives spatial and temporal adaptation signals from unlabeled test sequences for online optimization. Specifically, we design a controllable token shift auxiliary task, which imposes explicit spatial correspondence between predefined token translations and resultant localization offsets, generating stable annotation-free spatial adaptation signals. Furthermore, we introduce a temporal backward prediction auxiliary task to exploit frame-wise temporal dependencies, effectively mitigating cumulative localization errors in continuous tracking. To suppress interference from unreliable tracking samples, we develop a reliability-aware update gating strategy to screen valid adaptation signals and stabilize online parameter updates. Experiments on CM-UOT demonstrate that TSAT achieves state-of-the-art performance against existing test-time adaptation methods, exhibiting superior robustness under frequent modality switching and severe spatial displacement. Experiments across tracking frameworks and datasets further validate the effectiveness and generalization capability of TSAT.
163. 【2611.15047】Saying No by Asking Yes: Affirmative Decomposition and Evidence Reflection for Frozen CLIP
链接：https://arxiv.org/abs/2611.15047
作者：Aashish Pokhrel,Tejas Anvekar,Shivanand Venkanna Sheshappanavar
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Frozen vision-language models, match concepts mentioned, Frozen vision-language, respecting their negation, favors an image
备注： 27 pages, 6 figures
点击查看摘要
Abstract:Frozen vision-language models often match concepts mentioned in a caption without respecting their negation: a query "a kitchen with no toaster" favors an image containing a toaster. Yet these models are substantially stronger at matching affirmative descriptions. We exploit this asymmetry with Negation-Aware Evidence Scoring (NAES), which reformulates negated descriptions into affirmative queries and combines their evidence by caption structure. A lightweight text decomposer, NegSplit, identifies this structure by extracting negated spans and the remaining affirmative context. For captions with an affirmative remainder, NAES matches that content and applies a presence-based correction for the denial. When no affirmative content remains, it queries the denied object's presence and reflects the evidence around a reference to score the negated description. With LAION-2B CLIP, NAES achieves 82.4% accuracy on COCO-MCQ and 93.0% on VOC2007-MCQ, surpassing KTN by 2.9 and 0.9 percentage points; with OpenAI CLIP, it exceeds PeakPatch accuracy by 4.4 and 26.0 points, respectively. NAES also improves negated-description retrieval on COCO and MSR-VTT, with gains extending to SigLIP, SigLIP 2, and larger CLIP encoders. The strongest multiple-choice results use competing descriptions to center and align evidence; retrieval improvements persist without this conditioning. These findings show that explicitly separating affirmative matching from denied-object evidence can substantially improve negation-aware ranking.
164. 【2611.15044】Estimating Image Creativity
链接：https://arxiv.org/abs/2611.15044
作者：Nisan Chhetri,Christopher G. Healey,Sina Baghbanijam
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
关键词：creativity, image, creativity dimensions, image creativity, machine learning
备注： 9 pages, 1 figure
点击查看摘要
Abstract:What makes an image creative? Although this may seem like a highly subjective decision, research in psychology suggests that creativity may be based on a set of fundamental creativity dimensions such as novelty, surprise, and arousal. A deeper understanding of image creativity can benefit both research and practical applications. Exploring how human viewers use creativity dimensions to evaluate image creativity may allow us to predict a target image's human-rated creativity automatically. We present a novel framework to estimate the perceived creativity of an image by: (1) predicting the strengths of an image's novelty, surprise, and arousal creativity dimensions, and (2) combining the creativity dimension strengths to estimate an image creativity score. Controlled human-subject experiments were conducted on Amazon Mechanical Turk to collect data to train supervised machine learning models to estimate an image's strengths on the three creativity dimensions. A final machine learning model takes the predicted dimension strengths as input to produce an estimated image creativity score. Results showed that our estimated creativity scores are statistically equivalent to human ratings of creativity for the images we tested. The novel contributions of our research are: (1) identification and validation of three psychological creativity dimensions used to estimate image creativity; (2) supervised machine learning models to automatically estimate novelty, surprise, and arousal strengths for an input image; (3) a supervised machine learning model to predict a creativity score from novelty, surprise, and arousal strengths for an input image, and (4) experimental methods to confirm the accuracy, advantages, and limitations of our approach.
165. 【2611.15041】AROMA: Adaptive Representation-Oriented Multimodal Actuation for Vision-Language Model Control
链接：https://arxiv.org/abs/2611.15041
作者：Zhaoning Zhang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：accurate local direction, reachable numeral target, Adaptive Representation-Oriented Multimodal, Mechanistic localization, accurate local
备注： 39 pages, 16 figures
点击查看摘要
Abstract:Mechanistic localization does not by itself yield usable control: causal sensitivity may occupy little activation energy, an accurate local direction may fail at finite scale, and a reachable numeral target may be wrong. We introduce AROMA (Adaptive Representation-Oriented Multimodal Actuation), a frozen-VLM control framework separating where to intervene, which geometry and gain to use, how to reach a target, which target to pursue, and when to act. In Llama-3.2-11B-Vision-Instruct, four dimensions of a causally validated cross-attention head explain 89.82% of cardinality sensitivity but only 9.52% of median activation energy; magnitude-normalized causal subspace actuation converts this mismatch into finite control, improving exact-count accuracy on untouched procedural data by +8.00 pp. Iterative Minimal-Effort Actuation (MEA) reaches 81.25% of oracle targets versus 15.18% for a frozen direction under matched step budgets. With target and gate frozen before evaluation, targeted MEA improves the previous frozen policy from 34.444% to 38.730% on a new natural Stage-2 cohort (N=630; paired p=4.63e-7) and yields 65.741% versus 65.153% over all 7,992 examples while editing only 63 inputs. Prospective routing, replication across heads and models, and comparisons with attribution-steering baselines further characterize each stage, separating localization, actuation, reachability, target quality, and selective deployment as distinct control problems.
166. 【2611.15039】Back to the Question: Tracing Visual Distraction Through Text Tokens
链接：https://arxiv.org/abs/2611.15039
作者：Marie Amale Huynh,Regev Cohen,Serena Yeung-Levy,Sivan Doveh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires ignoring irrelevant, reasoning requires ignoring, world is cluttered, robust vision-language reasoning, requires ignoring
备注： 25 pages, 18 figures, including appendix
点击查看摘要
Abstract:The visual world is cluttered: robust vision-language reasoning requires ignoring irrelevant information. Yet vision-language models (VLMs) can suffer substantial accuracy losses when answering questions about a target image with distractors present. Existing mitigations focus on selecting relevant images or limiting information exchange between images. Through a systematic analysis of three open 7-8B VLMs on five perception benchmarks adapted to include distractor images, we show that distractors reduce accuracy even when models correctly identify the relevant image, suggesting that selection alone is not enough. To understand the mechanism behind this interference, we combine attention analysis with targeted knockouts in Qwen2.5-VL and identify middle-layer distractor-to-text connections as a pathway through which irrelevant visual information affects reasoning. We introduce answer consistency regularization, which encourages consistent answer distributions with and without distractors. Without directly constraining attention, this objective reduces middle-layer attention from question tokens to distractor images, consistent with the pathway our analysis implicates. With five distractors, our approach improves circular accuracy by an average of 16 percentage points over the Qwen2.5-VL baseline across the five benchmarks while preserving single-image performance.
167. 【2611.15025】Federated Class Incremental Learning: A Pseudo Feature Based Approach Without Exemplars
链接：https://arxiv.org/abs/2611.15025
作者：Min Kyoon Yoo,Yu Rang Park
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Federated Class Incremental, Class Incremental Learning, data continuously arrives, causing catastrophic forgetting, Federated learning
备注：
点击查看摘要
Abstract:Federated learning often assumes that data is fixed in advance, which is unrealistic in many real-world scenarios where new data continuously arrives, causing catastrophic forgetting. To address this challenge, we propose FCLPF (Federated Class Incremental Learning with Pseudo Features), a method that uses pseudo features generated from prototypes to mitigate catastrophic forgetting. Our approach reduces communication costs and improves efficiency by eliminating the need for past data and avoiding computationally heavy models like GANs. Experimental results on CIFAR-100 show that FCLPF achieves an average accuracy of 51.87% and an average forgetting of 9.62%, significantly outperforming existing baselines with an average accuracy of 47.72% and forgetting of 20.46%. On TinyImageNet, FCLPF achieves 37.56% accuracy and 3.14% forgetting, compared to the baselines' 27.69% accuracy and 24.46% forgetting, demonstrating the superior performance of FCLPF.
168. 【2611.14993】Validation of a Facial-Video Digital Hydration Biomarker Score for Tracking Hydration State Transitions in a Real-World Fasting Model
链接：https://arxiv.org/abs/2611.14993
作者：Yudara Kularathne,D.M.J. Prathapa,Thanveer Ahamed,Janindu Athukorala,Thisara Perera
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：repeated practical measurement, Hydration influences physiology, settings remains limited, everyday settings remains, daily function
备注： 12 pages, 6 tables, 5 figures
点击查看摘要
Abstract:Hydration influences physiology and daily function, yet repeated practical measurement in everyday settings remains limited. We present initial real-world evidence that a facial-video lifestyle digital biomarker score can track the direction of hydration state transitions. Using Ramadan fasting as a model of prolonged fluid abstinence, we assessed whether the score tracks the transition between the fasting (pre-drink) state and the rehydrated (post-drink) state across three validation layers. In the primary cohort (104 participants, 208 videos), the score increased from a mean of 36.6 in the fasting (pre-drink) state to 70.6 in the rehydrated (post-drink) state (change = +33.9, 95% CI [+30.7, +37.1], p 0.001, Cohen's d = 2.03), with 102 of 104 participants (98.1%) showing an upward shift. In a nested body-weight subgroup (20 participants), body weight increased by +0.74 kg after fluid intake (p 0.001), confirming fluid uptake and providing supportive physical anchoring. In a nested serum osmolality subgroup (10 participants), osmolality decreased by -5.1 mOsm/kg (p 0.001), with all post-drink values within the normal clinical range, providing exploratory biological support. An exploratory secondary comparison of water versus electrolyte rehydration showed no statistically significant difference in short-term score change (p = 0.247). This study does not establish a clinical diagnostic test for dehydration. Rather, these findings support the score as a lifestyle digital biomarker for tracking the direction of hydration state change in real-world settings.
169. 【2611.14970】Poison-then-Hide: Finetuning-Activated Backdoor Attack on Pretrained Vision Encoders
链接：https://arxiv.org/abs/2611.14970
作者：Qixuan Jin,Abinitha Gourabathina,Vinith Menon Suriyakumar,Walter Gerych,Marzyeh Ghassemi
类目：Machine Learning (cs.LG); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)
关键词：control model behavior, threaten the integrity, integrity of machine, allowing attackers, attackers to control
备注：
点击查看摘要
Abstract:Backdoor attacks threaten the integrity of machine learning models by allowing attackers to control model behavior through triggers. Models can be compromised during finetuning by backdoor attacks through either poisoned data or adversarial training objectives. Because existing finetuning-activated attacks assume limited domain shift or frozen encoder layers, they often fail under full-model finetuning. We target a stealthy finetuning-activated attack where a dormant backdoor is implanted in a pretrained encoder, and later activated by finetuning on clean downstream data. We propose Poison-then-Hide, a novel attack that remains effective when the entire model is finetuned in a domain transfer. Our approach consists of three components: trigger optimization, base encoder poisoning, and targeted unlearning to conceal the backdoor. We evaluate our method on six datasets and three model architectures, and achieve state-of-the-art (up to 97%) attack success rates. We find that jointly learning the benign target task alongside the poisoning is critical to the attack's success. We demonstrate standard detection and mitigation defenses cannot fully remove the backdoor, which can reappear after benign finetuning.
170. 【2611.14958】Adapting Monocular Depth Estimation in Novel Scenes through Disparity Refinement and Robot Ego-Motion
链接：https://arxiv.org/abs/2611.14958
作者：Dimitrios Chatziparaschis,Georgios Georgakis,Adnan I. Ansar,Shehryar Khattak,Konstantinos Karydis
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Monocular Depth Estimation, efficient robotic operations, unstructured environments, geometric understanding, crucial component
备注： 17 pages, 12 figures, journal
点击查看摘要
Abstract:The geometric understanding of a scene is a crucial component for safe and efficient robotic operations in novel and unstructured environments. The recent emergence of foundation models for Monocular Depth Estimation (MDE) has provided an opportunity to enrich robotic perception capabilities with dense long-range depth predictions, replacing expensive onboard hardware (e.g., LiDARs and stereo cameras). However, these offline models are primarily trained on affine-invariant depth representations, and their generalization to novel scenes remains unclear. In this work we present EM-ViT, a monocular depth estimation model that learns to adapt online relative depth inputs from a foundation model prior to the metric scale with observations collected during robotic operations. Motivated by the stereo camera parameterization, our method decomposes depth prediction via dense disparity refinement to recover the scene's relative structure and an effective baseline scalar prediction to determine the missing metric scale. The learning process leverages sparse LiDAR points and, optionally, the robot's Ego-Motion (EM) to rapidly train a lightweight Vision Transformer (ViT), while an internal gradient matching loss preserves the fine-grained semantic structure of the input disparity in real-time. We demonstrate the efficacy of our method on publicly available sequences, such as KITTI, and show that our online learning pipeline can adapt to novel scenes faster and with higher accuracy than existing MDE foundation models. The code and supplementary materials will be publicly available at this https URL.
171. 【2611.14953】RSLiveBench-UAV: A Continually Evolving Vision-Language Benchmark for Aerial Spatial Intelligence
链接：https://arxiv.org/abs/2611.14953
作者：Yue Zhou,Jiawei Liu,Jue Chen,Ziyang Gong,Haojia Wei,Jingxiang Li,Xue Jiang,Zhihang Zhong,Pai Peng,Xue Yang,Yansheng Li,Jonathan Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Aerial spatial intelligence, Aerial spatial, aerial spatial questions, viewpoints and scales, understand objects
备注： 10 pages, 6 figures
点击查看摘要
Abstract:Aerial spatial intelligence (ASI) requires models to understand objects and spatial relationships across changing viewpoints and scales. Evaluating these abilities as models evolve calls for fresh physical observations, yet producing new aerial spatial questions requires repeatedly establishing entity identities, geometric references, and cross-view correspondences. We introduce \textbf{RSLiveBench-UAV}, a continually evolving vision-language benchmark driven by recurring acquisition of real UAV imagery. Its update protocol admits images captured after the preceding release and delays answer disclosure. An entity-centered production workflow uses geometry-assisted association to link repeated observations of physical vehicles, reuse human-verified attributes, and combine them with view-specific annotations and spatial references for traceable question generation. All tasks use deterministic scoring without model judges. We evaluate 30 general-purpose, remote-sensing, and embodied models on 35,491 question records from ten scenes, covering 17 tasks across 2D perception, 3D perception, cross-view perception, and reasoning. All 18 tested embodied models outperform the three selected remote-sensing comparators in Overall, although the strongest embodied model scores 43.29 versus 59.88 for GPT-6-Astra. Fine-grained vehicle recognition remains challenging, and performance varies across heights and camera pitches. Retrospective scene-group comparisons and rolling-window replay characterize score-pattern consistency under scene renewal. RSLiveBench-UAV connects fresh physical observations, entity-centered answer production, and systematic model evaluation to support continual assessment of ASI. Benchmark will release at this https URL
172. 【2611.14942】Emergent Vision-Shaped Thinking in Text-Only Reasoning through Multimodal Training
链接：https://arxiv.org/abs/2611.14942
作者：Qi Zhang,Bohan Wang,Qianru Sun,Hanwang Zhang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal training shape, language model, multimodal training, multimodal, training shape
备注：
点击查看摘要
Abstract:Does multimodal training shape how a language model thinks, even when the input is text only? We test this with targeted causal ablations across 10 multimodal configurations from 6 model families, with matched text-only backbones and cross-family transfer controls. We contrast spatial-imagery tasks that invite mental scene construction with symbol-manipulation tasks solvable by symbolic rules alone. We identify a vision-language axis in hidden-state space and ablate its projection at inference. In Chameleon-7B, this ablation drops accuracy on BIG-Bench Hard (BBH) navigate by 27.6 pp while leaving boolean expressions intact (+5.6 pp), a 33.2 pp double dissociation. The effect is direction-specific and layer-localized, extends to mental-simulation tasks such as mental rotation, paper folding, and perspective taking, and is not explained by task difficulty, reasoning depth, or sequential update load. Together, these results reveal emergent vision-shaped thinking (EVT): text-only reasoning that causally recruits representations introduced or strengthened by vision-language training, without assuming an image-like internal format. The measured effect is spatially concentrated at 7-8B and broadens to non-spatial visual attribute binding in the tested 32B configuration. In dual-path unified models (BAGEL, Janus-Pro), the causal handle localizes to the generation pathway as a compact one-dimensional carrier. The understanding pathway also encodes spatial information in a higher-rank, probe-decodable form, but is not the causal handle. To separate decodability from causal use, we analyze concentration, alignment, and semantic location. These diagnostics explain why behavior, probing, and intervention can diverge. Multimodal training thus reshapes the geometry of text-only reasoning, not just how visual input is processed.
173. 【2611.14941】Reality Perception Gap: Are AI-Manipulated Video Detectors Ready for the Real World?
链接：https://arxiv.org/abs/2611.14941
作者：Xiangrui Liu,Xinmiao Luan,Xinyuan Wang,Zhiyuan Fang,Chi-Yao Huang,Douglas C. Montgomery,Yanjie Fu,Felix Juefei-Xu,YeZhou Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reality Perception Gap, curated datasets, evaluated on clean, typically evaluated, AI-manipulated video detectors
备注：
点击查看摘要
Abstract:AI-manipulated video detectors are typically evaluated on clean, curated datasets. In deployment, however, videos have usually passed through repost compression on social-media platforms and sometimes were captured by imperfect hardware. To measure detection under these conditions, we introduce Reality Perception Gap (RPG), a benchmark of 10,000 videos from frontier generators and partially synthetic edits, processed with cross-platform repost compression and paired with real footage that carries camera-side optical artifacts. RPG also includes socially fragile content, such as crime and wartime footage, where fabricated videos can cause severe social harm. Across 18 detectors, none catches more than 15% of fakes at a 1% false-positive rate. A positive control and a re-encoding sweep separate two sources of failure: generator and content shift degrades detectors before any compression, and repost compression erases the low-level traces that the artifact-based detectors relies on. Existing detectors therefore struggle when deployment conditions strip away the generation artifacts they rely on. These complementary failures suggest that robust detection requires training under deployment conditions and combining low-level, temporal, and semantic evidence, where passive detection may have reached its limits.
174. 【2611.14931】Hint-Informed Self-Distillation for Reasoning Segmentation
链接：https://arxiv.org/abs/2611.14931
作者：Kunze Jiang,Yuchen Wang,Kang Li,Qixing Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：provide relevant visual, visually similar objects, relevant visual evidence, tokens provide relevant, query among visually
备注： 11 pages, 5 figures, 7 tables. The first two authors contributed equally
点击查看摘要
Abstract:Reasoning segmentation requires identifying the target referred to by a query among visually similar objects, yet trajectory-level rewards cannot directly indicate which tokens provide relevant visual evidence. We propose Hint-Informed Self-Distillation (HISD), which uses target-disambiguation evidence for token-level credit assignment. An external model generates Segment Hints offline from training images, queries, and ground-truth target annotations, organizing target identity, discriminative attributes, confusable objects, and anchoring paths. A hint-conditioned exponential moving average teacher scores the student's own trajectories, and HISD computes the teacher-to-student evidence ratio over a token support set to adjust only the magnitudes of positive group-relative advantages, leaving nonpositive advantages unchanged. This design encourages concise reasoning while retaining the information needed for target disambiguation, and the student requires neither hints nor a teacher at inference. Under a unified training protocol, HISD improves ReasonSeg test gIoU and cIoU over our reproduction of DPAD by 3.00 and 3.55 percentage points, respectively. Across the five evaluated splits of ReasonSeg and the RefCOCO family, HISD achieves higher segmentation metrics than this baseline and reduces the average token count of valid reasoning spans by 80.17 to 91.83 percent.
175. 【2611.14907】Lines Are Ideas: Visual Creativity Assessment in Hyperbolic Space
链接：https://arxiv.org/abs/2611.14907
作者：Baoliang Chen,Zihao Lin,Hao Liu,Xiangjie Sui
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Assessing human creativity, Assessing human, human creative ability, evaluate human creative, evaluate human
备注：
点击查看摘要
Abstract:Assessing human creativity from drawings provides a scalable way to evaluate human creative ability. However, existing approaches either rely on costly expert annotation or treat creativity as a single regression target, overlooking its underlying structure. Psychological theories have long emphasized that creativity emerges from balancing novelty and appropriateness. Motivated by this principle, we recast creativity as structured semantic deviation between paired drawings, where novelty measures the extent of departure from the original base sketch, and appropriateness determines whether such departures remain meaningful. This formulation naturally leads to a hyperbolic representation, in which novelty is quantified by geodesic distance and appropriateness is evaluated conditionally via a learned decision boundary, further regulated by an abstraction-conditioned adaptive constraint. Experiments on AuDrA-Drawings demonstrate state-of-the-art alignment with expert judgments and strong robustness under rater and task shifts. Beyond performance gains, our framework reveals an interpretable radial organization of creative variation, offering a principled geometric foundation for automatic creativity assessment.
176. 【2611.14898】From Pixels to Prompts: Physics-Guided Language Enhancement for AI-Generated Image Detection
链接：https://arxiv.org/abs/2611.14898
作者：Mei Qiu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：exhibit limited generalization, substantially narrowed, narrowed the visual, visual gap, existing detectors
备注：
点击查看摘要
Abstract:AI-generated content (AIGC) has substantially narrowed the visual gap between natural and synthetic images, while existing detectors often rely on generator-specific artifacts and exhibit limited generalization to unseen models. This motivates a fundamental question: which intrinsic physical image characteristics provide stable, discriminative cues for distinguishing natural from AI-generated images? We investigate this by systematically identifying robust physical features and incorporating them into a vision-language representation without external textual prompts at inference. We first analyze 15 handcrafted physical descriptors across images from over 20 generative models. Based on cross-generator stability and real-fake discriminability, we propose a Feature Stability-Discriminability Validation Assessment (FSDVA) to select a compact set of reliable features. Five core features, including Laplacian variance, Sobel statistics, and residual-noise variance, are then used to construct structured textual descriptions encoding physical evidence for CLIP-based learning. We integrate these physics-enriched descriptions with image representations via a native physics-guided multimodal framework, adapting CLIP ViT-L 14 with LoRA. At inference, the model requires only the input image, with no external captions or manual prompts. On GenImage, our method achieves 99.0 percent accuracy on SDv1.4 and 96.7 percent on Wukong, with a mean of 97.23 percent across eight generative models versus 95.8 percent for C2pCLIP under the same setting. On UniversalFakeDetect, it maintains strong, stable generalization across diverse and unseen generation settings. These results show that carefully selected physical image statistics provide complementary forensic evidence to pretrained vision-language representations, enabling interpretable, more generator-agnostic AIGC detection.
177. 【2611.14895】HeadIO: Body-Frame Heading Decomposition for Neural Inertial Odometry on Head-Mounted Devices
链接：https://arxiv.org/abs/2611.14895
作者：Taeyoung Yeon,Yiquan Li,Chenfeng Gao,Vasco Xu,Karan Ahuja
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Inertial Measurement Units, Measurement Units, Inertial Measurement, enables camera-free head, camera-free head tracking
备注： Submitted to ICRA 2027
点击查看摘要
Abstract:Inertial odometry (IO) using only Inertial Measurement Units (IMUs) enables camera-free head tracking in head-mounted devices such as VR headsets, AR glasses, and earbuds. Prior IO methods operate in a gravity-aligned world frame, which is not yaw-equivariant. Yaw augmentation improves robustness but does not guarantee equivariance; learned equivariant layers achieve it, but EqNIO's full pipeline costs nearly 3$\times$ the FLOPs of ours. While raw body-frame IMU inputs are inherently yaw-invariant, head tilt redistributes both gravity and motion signals across device axes, making the representation tilt-variant. We propose HeadIO, which combines a body-frame heading decomposition with a bidirectional Mamba backbone for head-mounted inertial odometry. Our decomposition achieves tilt invariance by separating gravity-aligned and horizontal components using only the tilt component of device orientation. We evaluate on four head-mounted datasets and find that HeadIO improves RTE-5s by 8.1% (0.260 m $\to$ 0.239 m) over world-frame methods with learned equivariant layers on Nymeria, the largest benchmark dataset, at nearly 3$\times$ lower FLOPs and 8$\times$ fewer parameters. HeadIO achieves state-of-the-art performance on our primary metric, RTE-5s, on all Aria-glasses datasets, which natively provide body-frame semantics for our decomposition method. We further evaluate the IMU-only deployment scenario on Nymeria, where HeadIO remains state-of-the-art. We show that our method relies mainly on tilt accuracy, which can be obtained from the gravity signal; for yaw, a single-coefficient gyroscope correction removes 11.6% of the yaw error and improves RTE-5s by 2.5%, and sparse external yaw corrections (for example, one every 30 s) can improve RTE-5s by 12.0%. Our decomposition is lightweight, composes with any backbone, and is suitable for real-time deployment on head-mounted devices.
178. 【2611.14857】In-orbit demonstration of object-based change detection applied to the maritime domain
链接：https://arxiv.org/abs/2611.14857
作者：Cristopher Castro Traba,Tom Hendrix,Amaury Perrocheau,Francesco Pasanisi,Finian Rogers,Aubrey Dunne,David Rijlaarsdam,Roberto Del Prete,Nicolas Longépé,Gabriele Meoni
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：object-based change detection, change detection pipeline, low latency maritime, latency maritime monitoring, maritime monitoring onboard
备注： 11 pages, 8 figures
点击查看摘要
Abstract:This article presents the successful in-orbit validation of an object-based change detection pipeline for low latency maritime monitoring onboard the CogniSAT-6 mission. We propose and validate a lightweight, three-phase operational sequence: optimized ground-based dual-acquisition scheduling, real-time onboard AI-based vessel segmentation, and multi-temporal matching. Upon acquiring consecutive images over a targeted Area of Interest (AoI), the onboard system correlates vessel detections using a hybrid matching approach that integrates the Hungarian algorithm for optimal assignment with RANSAC-driven spatial and size filters for outlier rejection. A series of in-orbit validations demonstrated robust performance across 11 diverse maritime scenarios, achieving valid recall and precision values (considering only vessel size and location) exceeding 0.8. The validation demonstrated the ability of the system to track both cooperative targets and uncooperative "dark" vessels strictly through geometric consistency. This capacity to autonomously generate and act upon real-time intelligence establishes a foundation for next-generation Insight-as-a-Service (IaaS) and tipping-and-cueing architectures.
179. 【2611.14856】Honest Fusion Evaluation for Cross-Domain Deepfake Detection: Leakage Audits and Tail Robustness
链接：https://arxiv.org/abs/2611.14856
作者：Luke Collins,Chang-Tsun Li,Duc Thanh Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cross-domain video deepfake, deepfake detection increasingly, video deepfake detection, per-video router picking, frozen foundation-model experts
备注： Accepted at WACV 2027. 19 pages including supplementary material; 6 figures, 10 tables. Code: [this https URL](https://github.com/lukegcollins/WACV27-HFEFCDD)
点击查看摘要
Abstract:Cross-domain video deepfake detection increasingly uses frozen foundation-model experts, combined by calibrated score averaging, a per-video router picking one expert, or a learned head over concatenated features. Expressive routing and feature fusion are often reported to beat plain averaging. Across a 22-dataset frozen-expert testbed, we find those gains are largely evaluation artifacts. A corner theorem locates the gap routing aims to close: because AUC depends only on score ordering, the best any score-space router can do is an oracle reading the test label to pick each video's expert, a ceiling no realisable, label-blind router reaches. The theorem does not order real routers against a calibrated global average; the case against routing is empirical, and no router we test beats that average. Feature fusion reads raw features, falls outside the theorem, and is audited empirically. Reported gains trace to leakage: holding out one dataset leaks siblings sharing identities and reals (over-crediting routing), while holding out one manipulation keeps that dataset's reals in training (over-crediting feature fusion). A $2\times 2$ over fold and evaluation granularity pins the $+2.6$pp feature-fusion "win" to the fold alone: 12/12 significant under leaky folds vs. 0/12 under honest family-held-out folds, where both gains vanish. Fusion still pays off in the tail of hard videos and families: as experts are added, videos every expert misclassifies drop from 15.2% to 2.3%, and global calibrated fusion (InvB) beats the best single expert on worst-family AUC, selective risk (AURC), and low-false-positive recall, stably across protocols. Practitioners should calibrate and combine globally, hold out whole dataset families, and measure tail performance. For score-space routing under ranking metrics, honest evaluation and expert diversity matter more than combiner complexity.
180. 【2611.14851】Paired Geometric Supervision for Generalizable Deepfake Detection
链接：https://arxiv.org/abs/2611.14851
作者：Luke Collins,Chang-Tsun Li,Duc Thanh Nguyen,Victor Sanchez
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cross-domain deepfake detection, single preprocessing pipeline, recent transfer-learning detectors, authors' released checkpoints, reported gaps reflect
备注： Accepted at BMVC 2026 (poster). 37 pages including supplementary material; 8 figures, 22 tables
点击查看摘要
Abstract:We present OrthoPairGTL, a geometric training framework for cross-domain deepfake detection, built on a partially frozen DINOv3 backbone ($\sim$300M parameters), and make three contributions: (1) We re-evaluate six recent transfer-learning detectors (Forensics Adapter, Effort, three GenD variants and FakeSTormer) using the authors' released checkpoints under a single preprocessing pipeline across 17 cross-domain datasets (2018-2025), so that the reported gaps reflect method rather than per-method pipeline tuning. (2) We model the transformation between paired real and fake samples, training Parameter-Efficient Fine-Tuning (PEFT) adapters with an orthogonal pair decomposition, hyperspherical regularisation, and (in the GSD-LoRA variant) a set-level coherence objective. (3) Under LoRA, this regularisation gives a more stable optimisation profile: GSD-LoRA's post-peak validation degradation is $4.2\times$ shallower than plain LoRA at the same parameter footprint, and the time-averaged validation AUC across training is 1.82 pp higher. On the 17 datasets, GSD-LoRA matches or exceeds every re-evaluated baseline (92.82% vs. 91.58% for the strongest; paired Wilcoxon signed-rank $p=0.015$, 13/17 per-dataset wins), with the largest gains on modern reenactment-heavy benchmarks (DSv1.1, DSv2). Under strict parameter budgets, LayerNorm-only tuning ($\approx$0.03% of the backbone) is the most stable configuration and matches the strongest baseline with a mean of 91.97%.
181. 【2611.14838】Sophon: A Procedural Diagnostic for Spatial Reasoning in Vision-Language Models
链接：https://arxiv.org/abs/2611.14838
作者：J. Zach Gazak,Ryan Swindle,Justin Fletcher
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：simple geometric questions, Open-weight Vision-Language Models, BLINK Spatial, score 85-94, collapse to chance
备注： NeurIPS 2026 (Evaluations Datasets Track). 10 page main text, 44 pages total. Code and data: [this https URL](https://github.com/zgazak/sophon)
点击查看摘要
Abstract:Open-weight Vision-Language Models (VLMs) score 85-94% on spatial benchmarks (BLINK Spatial, What's Up CLEVR) yet collapse to chance on simple geometric questions when object, scene, and texture priors are stripped away. We introduce and open-source Sophon, a procedurally generated diagnostic of paired colored point-cloud stimuli across three coordinate systems (1D linear, 2D Cartesian, 2D polar) and four question types (binary, categorical, comparative, quantitative). Across four open architectures (LLaVA-NeXT, LLaVA-OneVision, Qwen2.5-VL, Idefics3), accuracy clusters at 47-52% while frontier models (Opus 4.6, Gemini 2.5 Pro, GPT-5.4) clear 77-83% and humans reach 84-94%. We use linear probes and low-rank adaptation (LoRA) to trace the open-weight failures. Probes of the vision encoder (ViT) and language decoder (LLM) recover Sophon spatial information at 83-85% and 80-86% accuracy, respectively, and the language tower's reasoning circuit answers text-only controls (point clouds as sets of coordinates) at +40 pp over visual stimuli. Language tower per-layer attention attribution localizes visual integration to mid-stack layers. At readout, models elevate the correct answer-set tokens but select among them randomly. We localize the mechanism by tuning individual and grouped components across every architecture's stack, including the vision tower (ViT workspace and reader), the projector, and the language tower (LLM workspace and reader). These experiments demonstrate that this mid-stack workspace holds circuitry capable of organizing the spatial signal so that the frozen reader can decode it. LoRA fine-tuning adjusts that circuitry such that 7B-class VLMs answer Sophon spatial reasoning questions at frontier aggregate accuracy. This work suggests that these models do not have a capability gap for spatial reasoning but suffer from a routing bottleneck that targeted fine-tuning repairs.
182. 【2611.14834】Learning Low-Latency Action Verification for Frozen Vision-Language-Action Models
链接：https://arxiv.org/abs/2611.14834
作者：Wen-Han Hsieh,Ken Jiankun Zheng,Chia-Chien Chen,David M. Chan,Trevor Darrell
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：made significant progress, general-purpose robotic manipulation, models have made, made significant, significant progress
备注：
点击查看摘要
Abstract:Vision-language-action (VLA) models have made significant progress in general-purpose robotic manipulation. However, sampled action sequences can be ineffective, while evaluating alternatives with computationally expensive verifiers adds latency at each policy query. In this work, we propose HDH, a lightweight framework that uses hindsight from a frozen VLA's own deployments to improve action verification. The framework has three stages. First, we deploy the policy and collect its autonomous rollouts. We then train a compact action verifier to assign each action chunk a predicted task-success score. Finally, the frozen VLA generates action candidates, and the verifier selects the candidate with the highest score for execution. Across four LIBERO-10 tasks, HDH achieves an average success rate of 82.3\% and on three real-world manipulation tasks, HDH improves average success over the baseline policy by 22.6\%.
183. 【2611.14832】Neural Compression for Scientific Particle Data: Perspectives on How Learning Can Help
链接：https://arxiv.org/abs/2611.14832
作者：Tian Qiu,Carolina Cuesta-Lazaro,Sheng Di,Haewon Jeong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：particle-based simulations grow, grow in scale, particle-based simulations, simulations grow, efficient compression
备注： 10 pages, 2 figures. Extended version of paper accepted at 2026 Conference on Physics and AI (PAI26)
点击查看摘要
Abstract:As particle-based simulations grow in scale, efficient compression of scientific data becomes critical. Neural point cloud compression (PCC) methods excel on computer vision (CV) benchmarks, but do they transfer to scientific particle data? We highlight that scientific particles differ from CV point clouds in fractal dimension: CV point clouds are locally planar, but particles are not. This key difference limits the effectiveness of the octree data structure that underpins most PCC methods. Neural codecs achieve only marginal bitrate reductions over the traditional G-PCC baseline on scientific data, revealing a significant performance gap. Supported by an evaluation spanning domains of cosmology, molecular dynamics, and plasma physics, we outline where the structure of scientific data limits current neural approaches and where learning can help in the future.
184. 【2611.14821】From Classification to Generation: Vision-Language Models for Roman Imperial Coin Description
链接：https://arxiv.org/abs/2611.14821
作者：Pedro Lourenco,Ognjen Arandjelović
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Roman Imperial coin, Cataloguing a Roman, Roman Imperial, Imperial coin involves, standard reference catalogue
备注：
点击查看摘要
Abstract:Cataloguing a Roman Imperial coin involves reading its legends and identifying its imagery in order to match it to an entry in the standard reference catalogue. Previous work has automated individual parts of this process, such as identifying the issuer or recognizing reverse motifs, by formulating each part as a classification task over a predefined set of labels. We instead formulate coin description as image-to-text generation and adapt an open-weight vision-language model (VLM), Qwen3-VL-8B-Instruct, to four tasks: transcribing the obverse and reverse legends, and describing the obverse and reverse imagery. To obtain training data, we convert approximately 30,000 auction records into structured image-text pairs. We separate the two sides of each coin, extract and normalize legends and descriptions, and standardize obverse descriptions against a bust-type taxonomy. We then train a separate low-rank adapter for each task on a single 20GB GPU, and evaluate each task with metrics that we define to capture the key components of numismatic descriptions. The adapted models outperform both the unadapted base model and GPT-4.1 on all four tasks, reducing the normalized edit distance of legend transcriptions by over 40% relative to GPT-4.1. The improvement is smaller, but still present, on legends absent from the training data.
185. 【2611.14815】BirdDreams: Joint Perspective and BEV Video Generation for a Plausible, Reactive Driving World Model
链接：https://arxiv.org/abs/2611.14815
作者：Junyoung Seo,Jaewoo Seo,Seungryong Kim,Laura Leal-Taixé,Xiuming Zhang,Seung Wook Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：aim to simulate, Driving world, Driving world models, BEV, world models aim
备注： Project page: [this https URL](https://research.nvidia.com/labs/sil/projects/birddreams/)
点击查看摘要
Abstract:Driving world models aim to simulate how a scene unfolds under different ego actions. This requires plausible motion of surrounding vehicles as well as precise ego-trajectory control. Learning vehicle motion from perspective video alone is challenging because motion is entangled with appearance and vehicles can be occluded. Prior work therefore conditions video generation on layouts that specify vehicle motion, providing control over surrounding vehicles but requiring their future trajectories as inputs. We introduce BirdDreams, an autoregressive driving world model that jointly generates perspective video and a schematic bird's-eye-view (BEV) video, making scene layout part of the predicted future. The BEV, rendered from scene annotations for training, depicts roads and vehicles as simple shapes at a fixed metric scale, providing a top-down view of their positions and motion with reduced occlusion between vehicles. Perspective video, by contrast, retains scene details that the BEV omits, such as traffic signals and object appearance. Joint attention between two video diffusion transformers, one per stream, lets each stream inform the other during generation. The predicted BEV also provides a geometric interface for ego control: we translate and rotate its latest frame along an input ego trajectory and use the resulting frames as a soft condition that shows how the scene would appear to move if only the ego vehicle moved. At inference, BirdDreams generates both videos from a single camera image without requiring an HD map or vehicle-state inputs. On PhysicalAI-AV and nuScenes, BirdDreams follows input ego trajectories more faithfully than prior driving world models and generates more plausible ego motion without ego-action conditioning. Human evaluation shows that BirdDreams outperforms a perspective-only baseline in generating realistic surrounding-vehicle behavior.
186. 【2611.14763】RECALL: Real-Time Recalibration of Multi-Camera Rigs via Learned OEM-Anchored Residuals
链接：https://arxiv.org/abs/2611.14763
作者：Mario Alberto Tapia de la Cruz,Charalambos Poullis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：rigs ship pre-calibrated, Multi-camera rigs ship, thermal cycling, continuously through wear, ship pre-calibrated
备注： WACV 2027 submission
点击查看摘要
Abstract:Multi-camera rigs ship pre-calibrated from the manufacturer, but their calibration goes stale each time the rig is repositioned, and drifts continuously through wear, thermal cycling, and vibration. Recovering it on-the-fly is hard: classical bundle adjustment needs a fresh multi-view capture and a global optimization whose cost grows with the rig, ruling out real-time use. In this paper we present RECALL, a feed-forward method that recalibrates a movable multi-camera rig in a single pass. From the nominal OEM calibration as an anchor and a brief observation of a known object, it predicts each camera's current intrinsics and extrinsics, written as a shared global rotation of the rig composed with a small per-camera drift. Instead of regressing the calibration in one shot, RECALL refines its estimate with a learned, rig-coupled recurrent operator that reprojects through a differentiable projection and applies attention across the cameras at each step, and solves for the shared rotational gauge in-network with a learned Gauss-Newton step rather than regressing it. Because the ground truth is synthesizable, we train entirely on data generated on-the-fly and need no captured dataset. On a synthetic 10-camera benchmark, RECALL is more accurate than per-camera and rig-coupled joint bundle adjustment ($0.26^\circ$ vs $0.47^\circ$ rotation, $5.4$ vs $8.9$ px focal) and runs about $10^5\times$ faster at about $0.12$ ms per rig. On real data (TotalCapture, CMU Panoptic) it matches or beats offline rig-coupled bundle adjustment on absolute and relative rotation while running four-to-five orders of magnitude faster, and on the Panoptic surround rig it also matches the strongest image-only foundation models (VGGT, VGGT-$\Omega$, $\pi^3$) on relative pose while staying metric and about $15\times$ more accurate in focal length. Code: this https URL
187. 【2611.14728】SyntheIce: A Synthetic Radargram Annotation Benchmark for Englacial Layer Reconstruction
链接：https://arxiv.org/abs/2611.14728
作者：Muhammad Behroze Hassan,Bayu Adhi Tama,Sanjay Purushotham,Vandana P. Janeja
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：subsurface ice images, Englacial layers, encode the climate, sheets and glaciers, climate and flow
备注： 10 pages, 10 figures, 3 Tables, accepted in IEEE International Conference on Big Data (BigData) 2026
点击查看摘要
Abstract:Englacial layers in radio-echo-sounding radargrams (subsurface ice images) encode the climate and flow history of ice sheets and glaciers. However, large-scale extraction is hindered by time-consuming manual annotation and semi-automated detectors that produce fragmented rather than continuous horizons. We address two challenges: reconstructing complete layers from partial detections across radargram profiles and validating layer continuity across adjacent tile boundaries. We introduce a slope-aware greedy fragment-linking algorithm that reconstructs full-width layers using row-similarity gating and an exponentially weighted moving average (EWMA) slope predictor. Each reconstruction receives a content-based hash ID for stable cross-radargram identification. For quantitative evaluation, we generate SyntheIce, a synthetic dataset of 600 radargrams spanning multiple complexity levels and realistic noise conditions, including 150 wide radargrams divided into four adjacent tiles. All samples include exact ground-truth annotations. We evaluate the dataset using XCheck, a consistency-based validation framework, extending its original two-image setting to four consecutive tiles and enforcing continuity at every boundary. This demonstrates the dataset's utility for developing and evaluating real-world annotation algorithms. Our findings extend beyond ice science: when spatial features are fragmented but retain consistent local geometry, trajectory-based linking is more reliable than appearance-based matching. Evaluation against expert-labeled real radargrams demonstrates high precision, recall, F1-score, and mean IoU, supporting the method's transfer to real-world data.
188. 【2611.14686】What Entropy-Based View Selection Cannot See: An Audit of Test-Time Adaptation for Vision-Language Models
链接：https://arxiv.org/abs/2611.14686
作者：Sivasuthan Sukumar,Uthayasanker Thayasivam
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：CLIP can classify, Vision-language models, test images differ, trained to recognize, training data
备注： Accepted at NeurIPS 2026 Workshops on VLM4RWD
点击查看摘要
Abstract:Vision-language models such as CLIP can classify images into categories they were never explicitly trained to recognize, but accuracy degrades when test images differ in style or source from their training data. A common remedy generates randomly cropped and flipped copies of each test image, called views, and combines their predictions. Since some views miss the object, methods must identify which views to trust. The dominant approach uses prediction entropy to measure confidence and retains the most certain views. Other methods use signals such as embedding typicality. Despite repeated refinements of these scoring functions, the information they rely on, the model's own response to each view, remains largely unexamined. We investigate this choice while holding other pipeline stages fixed. First, we show that view selection, rather than the gradient update, accounts for almost all accuracy gains. We then examine whether entropy identifies useful views when predictions are wrong, despite at least one view predicting the correct class. In these cases, entropy ranks correct views above incorrect ones no better than chance, recovering only about one-twentieth of the accuracy recovered by an oracle over the same views. This finding holds across two image encoders and under a control ruling out an obvious statistical artifact. An exact analysis explains this limitation: entropy measures confidence but not which class a view favors. We identify an unused signal already available in the augmentation pipeline: the fraction of the original image retained by each crop. Ranking views by this quantity improves accuracy on 14 of 15 benchmark datasets over entropy and on 11 of 15 over the strongest scoring function tested. A pre-method measurement also predicts which datasets benefit.
189. 【2611.14677】Fast Slice-Wise Deep Learning Motion Correction for Spinal Cord Functional MRI
链接：https://arxiv.org/abs/2611.14677
作者：Thomas Dagonneau,Sandrine Bédard,Nontharat Tucksinapinunchai,Uten Yarach,Loïc Le Folgoc,Pietro Gori,Julien Cohen-Adad
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：MRI time series, functional MRI time, Spinal Cord Toolbox, Respiratory and bulk, functional MRI
备注： 4 pages, 3 figures
点击查看摘要
Abstract:Respiratory and bulk motion displace the spinal cord between the volumes of a functional MRI time series. Current methods such as the Spinal Cord Toolbox (SCT) take several minutes per time series, and general-purpose brain tools register whole volumes, whereas the cord moves mainly slice by slice. We propose a lightweight convolutional neural network that regresses the in-plane translation aligning each axial slice to a reference. Two models, trained without motion labels, correct large and then residual motion. On a 3T (120 scans) and a 7T (59 scans) dataset, the proposed method improves on SCT on every metric (tSNR +10 to +25%, DVARS -20 to -38%), leaves almost no slice displaced by more than one voxel (0.1%), performs on par with a slice-wise AFNI variant and better than slice-wise FSL FLIRT, and runs in about 10 s per scan, about 30 times faster than SCT. The code is available at this https URL and the method is available in SCT v7.4.
190. 【2611.14608】FreeDeshadow: Shadow Removal for User-Specified Objects With Multimodal Prompts
链接：https://arxiv.org/abs/2611.14608
作者：Zhiliang Wu,Jihao Gu,Kun Li,Hanyu Xuan,Hehe Fan,Meng Wang,Weisi Lin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：perform global shadow, shadow, shadow removal, global shadow removal, target shadow region
备注：
点击查看摘要
Abstract:Existing shadow removal methods either perform global shadow removal or rely on precise shadow masks to guide restoration. Such paradigms limit their ability to selectively remove the shadow cast by a user-specified object in practical applications. To this end, we introduce an object-aware controllable shadow removal task, which allows users to specify a target object through a simple prompt and removes only its cast shadow while preserving other content. However, object-shadow asymmetry makes it challenging to establish accurate correspondence between the specified object and its spatially separated cast shadow and to confine restoration to the target shadow region. To address these challenges, we propose FreeDeshadow, a unified controllable shadow removal framework that supports both visual and textual prompts. It consists of an object-aware generator and a shadow-aware local refiner. The former interprets the user prompt and produces a high-quality shadow-free proposal, while the latter establishes the correspondence between the object and its cast shadow and constrains the generated changes to the target shadow region. To support training and evaluation, we further construct PCSRD+, a large-scale dataset containing 154,571 quadruples at 1024$\times$1024 resolution and covering six types of user prompts. The visual prompts include a dot, a line, and an object mask, while the textual prompts describe the target object using attributes, spatial relations, or states. Extensive experiments demonstrate that FreeDeshadow accurately removes the shadow of the target object under both visual and textual prompts while effectively preserving non-target regions. It also outperforms existing methods in shadow removal performance and controllability. Project Page: this https URL
191. 【2611.08631】BEVCast: Path-Adaptive BEV for Efficient End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2611.08631
作者：Qiren Wang,Mingyu Guo,Zixuan Wang,Weisong Shi
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Camera-based driving models, Camera-based driving, build a dense, planning horizon, driving models build
备注：
点击查看摘要
Abstract:Camera-based driving models build a dense bird's-eye-view (BEV) grid and spend the same computation on every cell of it, although the vehicle crosses only a few of those cells within the planning horizon. We present BEVCast, a two-stage BEV whose resolution adapts to the predicted driving path. A coarse pass encodes the whole scene on a grid of 4.096 m cells. A heat head trained on the recorded path assigns a heat to every coarse cell and the cells with the highest heat are refined into 1.024 m cells under a fixed budget. The remaining cells keep their coarse resolution, so the trajectory head reads a mixed-resolution BEV that still covers the entire scene and needs neither an HD map nor a navigation command. Against a full grid of 1.024 m cells with the same architecture and training recipe, BEVCast at a 10% refinement budget encodes 28% of the BEV queries and needs 66% of the BEV encoder time at batch size 1. On nuScenes its mean displacement error is 1.078 m against 1.149 m and its drivable area violation rate is 1.46% against 2.29%. On NAVSIM navtest its mean displacement error is 0.577 m against 0.598 m and its extended predictive driver model score is 82.51 against 81.28. Next to published planners BEVCast reaches a comparable error on both benchmarks without a navigation command. The resolution of a driving BEV can therefore follow the task instead of the grid.
192. 【2606.21115】MS-rPPG: Multi-spectral State Space Model for Remote Photoplethysmography in Driver Monitoring Systems
链接：https://arxiv.org/abs/2606.21115
作者：Jiho Choi,Sang Jun Lee
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
关键词：measuring physiological signals, cardiac activity, camera-based technique, technique for measuring, measuring physiological
备注：
点击查看摘要
Abstract:Remote photoplethysmography (rPPG) is a camera-based technique for measuring physiological signals, particularly cardiac activity. From the remotely measured signals, heart rate can be estimated, which is crucial for health monitoring. In this study, we investigate a driver health monitoring system based on remote heart rate estimation. However, driving environments represent uncontrolled settings where videos are subject to varying illumination conditions and frequent head movements. We introduce MS-rPPG, a multi-spectral framework that combines RGB with near-infrared (NIR) face video to alleviate rPPG estimation under challenging driving conditions. To combine the complementary features from two spectral videos, we propose a cross-spectral linear modulation (CSLM) strategy based on frequency-domain analysis. Moreover, we introduce MS-Mamba, a novel state space model designed to effectively model long-range temporal dependencies while jointly capturing cross-channel interactions between multi-spectral features. We collected a real-world dataset called MS-Drive, which was recorded from 50 participants while driving the vehicle. The proposed method was evaluated on the MR-NIRP Car dataset and MS-Drive datasets. The experimental results indicate that MS-rPPG shows better robustness and heart rate estimation accuracy than previous methods, highlighting its promise for driver health monitoring. The codes are available at this http URL.
193. 【2611.17111】Spatiotemporal learning improves quantification of pore-space evolution and fluid displacement
链接：https://arxiv.org/abs/2611.17111
作者：Zhuangzhuang Ma,Rukuan Chai,Qianqian Ma,Yanghua Wang,Branko Bijeljic,Martin J. Blunt
类目：Fluid Dynamics (physics.flu-dyn); Computer Vision and Pattern Recognition (cs.CV)
关键词：underground hydrogen storage, geological carbon storage, affecting geological carbon, groundwater contaminant transport, carbon storage
备注： 48 pages, 9 figures, 18 tables, including Supplementary Information
点击查看摘要
Abstract:Pore-space evolution and fluid displacement influence how rocks transmit and store fluids, affecting geological carbon storage, underground hydrogen storage and groundwater contaminant transport. A single time-resolved micro-CT experiment may produce tens to hundreds of three-dimensional images, and segmentation is required to quantify physical properties and run image-based simulations. Traditional methods such as thresholding perform poorly on noisy, low-contrast images and need manual adjustment per image; 3D deep learning networks segment each image without temporal information, so their errors vary between images and could be mistaken for physical change. Here we introduce a transformer-based 4D segmentation framework combining spatial and temporal information. It uses sequential images to resolve ambiguous phase assignments and separate physical change from segmentation error. The method is tested on images of mineral dissolution: it measures pore-volume growth and rock boundaries more accurately than an equivalent 3D model that ignores temporal information. It also captures the increase in permeability verified against reference segmentations and flow simulations. The advantage transfers to another dissolution sample without retraining. On two other datasets of fluid displacement, it reduces spurious changes in predicted rock and porosity fluctuations and accurately identifies filling events. Spatiotemporal segmentation turns sequences of hundreds of three-dimensional images into more reliable quantitative measurements of pore-space evolution and fluid displacement without per-image parameter adjustment to support the analysis of time-resolved CT imaging.
194. 【2611.15758】Physics-based simulation unlocks scaling laws for generalizable MRI reconstruction
链接：https://arxiv.org/abs/2611.15758
作者：Hong Shang,Zijian Zhan,Sen Jia,Xiang Fan,Jintao Meng,Yang Zhou,Xiang Zhou,Tianyu He,Xinran Chen,Qiaoling Zeng,Keyan Yu,Jianhua Yao,Dong Liang
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：holds great promise, translation remains bottlenecked, clinical translation remains, magnetic resonance imaging, reconstruction holds great
备注：
点击查看摘要
Abstract:Deep-learning-based magnetic resonance imaging (MRI) reconstruction holds great promise for accelerating acquisitions, yet its clinical translation remains bottlenecked by poor generalizability across unseen scanners, populations, anatomies, and protocols. Gathering sufficiently diverse clinical datasets to overcome this bottleneck is hindered by high acquisition costs, privacy restrictions, and institutional biases. Here, we introduce Scalable Inverse Model (SIM), a framework that systematically co-designs physics-simulated training data, model architecture, and learning paradigms around scalability--leveraging compute scaling to overcome historical data bottlenecks and achieve robust zero-shot MRI reconstruction. Across 14 public and in-house datasets--spanning seven international centers, five vendors, field strengths of 0.3-7 T, over ten anatomical regions, more than ten acquisition protocols, downstream quantitative and molecular tasks, and a 150-scan blinded radiologist study--SIM demonstrates robust zero-shot generalizability, recovering fine anatomical details while suppressing aliasing artifacts where conventional deep-learning methods fail. Attention-map analyses confirm that SIM learns physically explainable, dynamically adaptive reconstruction primitives rather than anatomy-specific priors. SIM establishes a scalable, privacy-preserving, and democratized infrastructure for universal MRI reconstruction, providing a blueprint for generalizable AI across inverse problems in medical imaging.
195. 【2611.15370】Supervision-Aware Evaluation of MedGemma for Reference-Assisted Radiotherapy Contour Ranking
链接：https://arxiv.org/abs/2611.15370
作者：Jaden Moon,Caiwen Jiang,Songlin Zhao,Wei Liu
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Radiotherapy contour ranking, support quality assurance, Radiotherapy contour, score construction, quality assurance
备注： 5 pages, 1 figure, 3 tables. Submitted to IEEE ISBI 2027
点击查看摘要
Abstract:Radiotherapy contour ranking can support quality assurance, but vision-language model (VLM) gains may reflect supervision, score construction, available inputs, or representation access. We evaluated frozen MedGemma 1.5 in a single-institution study, a 12-patient held-out HaN-Seg test, five-fold cross-fitting on 30 non-test HaN-Seg patients, and transfer without refitting to 120 SegRap2023 patients. On held-out HaN-Seg, a supervised readout of the final prompt state exceeded a supervised readout of the model's yes/no output probabilities by +0.3047 pooled average precision (AP; 95% patient-bootstrap interval [+0.2822, +0.3269]); the advantage persisted against a parameter-count-matched nonlinear control. A readout of projected visual tokens exceeded the final-state readout in cross-fitting and transfer (+0.0706 AP averaged equally across patients on SegRap; 95% interval [+0.0607, +0.0804]), while a structured panel-feature readout remained competitive with visual tokens. The anatomy-conditioned readout did not demonstrate an advantage over the native-feature comparator. These results motivate visual-token and structured-feature controls in medical-imaging VLM evaluations; outcomes were computational or synthetic, not clinical acceptability.
196. 【2611.14979】Coarse-to-Fine 3D MRI Reconstruction via Resolution-Agnostic Neural Operators
链接：https://arxiv.org/abs/2611.14979
作者：Jiayun Wang,Ram Daftari,Weijie Gan,Valentin Duruisseaux,Ruibo Wang,Armeet Singh Jatyani,Boris Bonev,Anima Anandkumar
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：GPU memory, ignores through-plane, MRI reconstruction, limited in practice, memory and compute
备注： NeurIPS 2026
点击查看摘要
Abstract:Deep-learning-based 3D MRI reconstruction is limited in practice by the GPU memory and compute cost of full-volume training; 3D acquisitions are thus most often reconstructed by 2D models applied slice-by-slice and then stacked, which ignores through-plane (stacking-axis) structure. We reconstruct in full 3D and ask whether a model can be trained at low resolution (fast and memory-feasible) yet deployed at higher resolution. This coarse-to-fine strategy needs reliable cross-resolution performance, but standard networks are resolution-specific and degrade substantially when evaluated outside the training setting. We therefore use resolution-agnostic neural operators (NOs) and propose KIR-NO (k-space-to-Image Reconstruction Neural Operator), a discretization-agnostic framework for accelerated 3D MRI reconstruction. KIR-NO is trained with full backpropagation on low-resolution volumes and applied zero-shot to higher-resolution volumes at inference. Its core building block is a 3D neural operator based on discrete-continuous convolutions: convolutional filters are parameterized in a continuous basis and sampled at arbitrary voxel resolutions while preserving the local inductive bias of convolution. KIR-NO integrates these learned operators with physics-based consistency: a k-space neural-operator head first refines the undersampled Fourier measurements, and image-space neural-operator cascades then refine the reconstruction through interleaved data-consistency updates. Across 3D knee and brain MRI benchmarks, KIR-NO improves over classical and CNN baselines: it improves over a state-of-the-art 3D CNN by 2.2 dB PSNR at half resolution under 4x acceleration on SKM-TEA, with gains persisting at 8x and 16x. These results show that resolution-agnostic operators make coarse-to-fine 3D MRI reconstruction - cheap low-resolution training with high-resolution deployment - practical across anatomies.
197. 【2611.14975】Aggregate Accuracy Hides Diagnosis-Specific Failure in Medical Vision-Language Models
链接：https://arxiv.org/abs/2611.14975
作者：Shreya Ajay Kale,Angad Ripudaman Singh Bajwa
类目：Image and Video Processing (eess.IV); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：hide complete failure, Medical vision-language models, open medical VLMs, single diagnosis, hide complete
备注： Accepted at the NeurIPS 2026 Workshop on Medical Reasoning with Vision Language Foundation Models (Med-Reasoner). 16 pages including NeurIPS checklist, 1 figure, 5 tables
点击查看摘要
Abstract:Medical vision-language models (VLMs) are compared mainly by accuracy averaged across findings, a summary that can hide complete failure on a single diagnosis. We audit five open medical VLMs (MedGemma-4B, Lingshu-7B, HuatuoGPT-Vision-7B, Qwen2.5-VL-7B, and MedVLM-R1) on 6,048 ChestX-ray14 questions balanced by sex, age, finding, and label. On the 432 pneumothorax-positive X-rays, HuatuoGPT-Vision and Qwen2.5-VL detect zero cases while MedGemma and Lingshu detect 38% and 67% of the same images. The two failing models answer "no" to all 864 pneumothorax cases (balanced accuracy 0.500, chance), yet produce fluent, anatomically specific explanations that name the signs of a collapsed lung and then deny them, with no hedge or abstention. This failure is not an artifact of prompting, image resolution, label ambiguity, or model scale. It persists across four prompt formats, at native resolution, and on single-label cases. A within-model control shows the same forced prompt gives HuatuoGPT 79% recall on nodule but only 6% on pneumothorax. It survives a tenfold scale increase (Qwen2.5-VL-72B detects 4%) and replicates on SIIM-ACR, an independent dataset with radiologist-drawn masks, where the failing models detect 0 of 432 confirmed pneumothoraces, including 0 of the 144 largest lesions. Reading the models' logits and internal states shows this is not blindness. The two failing models are highly confident yet no better than chance and a linear probe recovers pneumothorax from their hidden representations even where recall is zero, so the finding is represented internally but suppressed at the output. Aggregate accuracy therefore cannot establish that a medical VLM can see a given finding, because a model that misses one can still describe it convincingly. Reporting per-finding recall and specificity on balanced cases is needed to tell the difference.
198. 【2611.14947】One Block Is Enough: LoopMR for Accelerated MRI Reconstruction
链接：https://arxiv.org/abs/2611.14947
作者：Yimeng He,Yibin Xie,Yi Zheng,Yifan Gao,Lixia Wang,Yin-Chen Hsu,Yufeng Wang,Meng Lu,Debiao Li,Xiuzhen Huang
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep-learning unrolled networks, Deep-learning unrolled, unrolled networks, leading approach, approach to accelerated
备注： 10 pages, 7 figures, 6 tables. Code: [this https URL](https://github.com/hym97/LoopMR)
点击查看摘要
Abstract:Deep-learning unrolled networks are the leading approach to accelerated MRI reconstruction. State-of-the-art models such as PromptMR+ learn a distinct block for every cascade, so their size grows with the number of cascades. Sharing one block across iterations avoids adding parameters, but earlier shared-weight models typically used a tiny block and produced worse images than models with distinct weights. Therefore, it remained unclear whether weight sharing itself or the choice of block was the problem. Recent advances in looped transformers, which reuse the same block across layers, show that they can match or outperform their distinct-weight counterparts on several tasks. Motivated by this, we propose LoopMR, which reuses a single Restormer block at every iteration as its core. Besides the current image estimate, the block receives data-consistency inputs and latent images. On four datasets covering the brain (CC359), knee (fastMRI), heart (CMRxRecon2023) and carotid (in-house), LoopMR significantly outperforms E2E-VarNet, PromptMR and PromptMR+ in PSNR and SSIM at every acceleration factor (p 0.01), with about 1/9 of PromptMR+'s parameters (10.3M versus 92.9M). It also keeps its lead at unseen acceleration factors and on an unseen dataset. With our transformer block, the shared model matches or outperforms its distinct-weight counterpart at 6, 12 and 24 iterations. At a fixed number of iterations, shared transformer blocks match or outperform their distinct-weight versions, while shared CNN blocks perform worse. These results suggest that looping one well-chosen block can outperform stacking distinct cascades in MRI reconstruction, with a fraction of the parameters.
