Loading...

SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution
###摘要最近DeepSeek-R1的发布展示了强化学习(RL)在提升大语言模型(LLMs)通用推理能力方面的巨大潜力。虽然DeepSeek-R1及后续工作主要聚焦于将RL应用于竞赛编程和数学问题,但本文介绍了SWE-R

SPECTRE: An FFT-Based Efficient Drop-In Replacement to Self-Attention for Long Contexts
###摘要传统的自注意力机制具有二次复杂度,这限制了它们在长序列上的可扩展性。我们引入了FFTNet,这是一种自适应频谱滤波框架,它利用快速傅里叶变换(FFT)在\(O(nlogn)\)时间内实现全局令牌混合。通过将输入转换到频

Binary Neural Networks for Large Language Model: A Survey
###摘要大语言模型(LLMs)在自然语言处理(NLP)领域有着广泛应用,如GPT-4和Llama。然而,随着模型参数规模呈指数级增长,大语言模型带来了巨大的资源开销。低比特量化作为一项关键技术,通过减小模型参数、激活值和梯度的

ZEBRA: Leveraging Model-Behavioral Knowledge for Zero-Annotation Preference Dataset Construction
###摘要近期,大语言模型(LLM)校准领域取得了进展,旨在通过利用预训练模型生成偏好数据,从而降低人工标注的成本。然而,现有方法常常对能力差异巨大的模型的回复进行比较,只能得出表面上的区别,无法为判断何种回复更优提供有意义的指导。为

Self-Training Elicits Concise Reasoning in Large Language Models
###摘要思维链(CoT)推理使大语言模型(LLMs)能够通过中间标记利用额外计算来解决复杂任务。然而,我们认为典型的推理痕迹包含许多冗余标记,从而产生额外的推理成本。在检查当前大语言模型的输出分布时,我们发现有证据表明,相对于其默认

KEDRec-LM: A Knowledge-distilled Explainable Drug Recommendation Large Language Model
###摘要药物发现是生物医学自然语言处理(NLP)中的一项关键任务,然而可解释的药物发现仍有待深入探索。与此同时,大语言模型(LLMs)在自然语言理解和生成方面展现出了卓越的能力。利用大语言模型进行可解释的药物发现,有望改进下游任务和

Re-evaluating Open-ended Evaluation of Large Language Models
###摘要传统的评估方式主要聚焦于针对特定技能对候选对象进行排名。而诸如大语言模型(LLMs)这样的现代通用模型,显然超越了这种范式。开放式评估系统应运而生,在该系统中,候选模型会依据用户提交的提示进行比较,成为了一种流行的解决方案。

HaLoRA: Hardware-aware Low-Rank Adaptation for Large Language Models Based on Hybrid Compute-in-Memo
###摘要低秩自适应(LoRA)是一种主流的参数高效微调方法,用于使大语言模型(LLMs)适应下游任务。在本文中,我们首次提出将LoRA微调后的大语言模型部署在混合内存计算(CIM)架构上(即,预训练权重存储在RRAM中,Lo

Secure Speculative Decoding for Large Language Models
#SecureSpeculativeDecodingforLargeLanguageModels论文总结与翻译>论文信息:arXiv:2610.08678,已被**IEEES&P2027**接收,18页;作者

Selective Critique for Cost‑Aware LLM Agents in Long‑Horizon Decision Making
#SelectiveCritiqueforCost‑AwareLLMAgentsinLong‑HorizonDecisionMaking>arXiv:2610.07335|NeurIPS2026##文章主要

ThinkFuse: Trajectory‑Aware Test‑Time Fusion for Small Reasoning Models
#ThinkFuse:Trajectory‑AwareTest‑TimeFusionforSmallReasoningModels>arXiv:2610.07803,接收于EMNLP2026Findings##

Learning to Retrieve via Reinforcement Learning in Embedding Space
LearningtoRetrieveviaReinforcementLearninginEmbeddingSpace论文总结与翻译论文arXiv地址:https://arxiv.org/abs/2610.07731

Foresight-over-Graph: Reasoning Beyond Local Horizons for Knowledge Base Question Answering
>说明:当前仅获取到论文摘要元数据,**无法拿到Introduction与Conclusion原文**,因此仅完成:文章主要内容&创新点总结、Abstract中英对照翻译;Introduction、Conclusion部分因缺少全文文本无

SquidAgent: Parallelize Wisely, Coordinate Efficiently
#SquidAgent:ParallelizeWisely,CoordinateEfficiently论文总结与翻译>论文信息:arXiv:2610.08647,NeurIPS2026接收,37页(含附录)##一、文

The Model Plants the Trigger: Answer‑Side Backdoor Attacks in Multi‑Turn Large Language Models
#TheModelPlantstheTrigger:Answer‑SideBackdoorAttacksinMulti‑TurnLargeLanguageModels>Paper:arXiv:2610.077

COMPASS: Finding Where Reasoning Lives in Language Models(arXiv:2610.07469)
#COMPASS:FindingWhereReasoningLivesinLanguageModels(arXiv:2610.07469)>论文链接:https://arxiv.org/abs/2610.07469#

WASD: Wasserstein‑based Knowledge Distillation for Large Language Models 论文总结与翻译
#WASD:Wasserstein‑basedKnowledgeDistillationforLargeLanguageModels论文总结与翻译>论文信息:arXiv:2610.07706,NeurIPS2026

Safeguarding LLMs via Model‑Agnostic Latent Safety Signals from Dark Knowledge 论文阅读笔记
#SafeguardingLLMsviaModel‑AgnosticLatentSafetySignalsfromDarkKnowledge论文阅读笔记>论文arXiv链接:[https://arxiv.org/a

Beyond Refusal Patterns 论文总结与翻译
#BeyondRefusalPatterns论文总结与翻译>论文信息:arXiv:2610.07023|BeyondRefusalPatterns:Safe‑RoleInternalizationforRobus

Distributionally Robust Mixture‑of‑Experts Training(DRMoET)论文总结与翻译
#DistributionallyRobustMixture‑of‑ExpertsTraining(DRMoET)论文总结与翻译>论文信息:arXiv:2610.07207,NeurIPS2026,作者:XinTeng,M

欢迎留下您的脚印