* = equal contribution · # = corresponding author. See also my Google Scholar.
Foundation Model
Chain-of-Model Learning for Language Model.
Kaitao Song*,#, Xiaohua Wang*, Xu Tan*, Huiqiang Jiang, Chengruidong Zhang, Yongliang Shen, Cen Lu, Zihao Li, Zifan Song, Caihua Shan, Yansen Wang, Kan Ren, Xiaoqing Zheng, Tao Qin, Yuqing Yang, Dongsheng Li, Lili Qiu.
NeurIPS 2025.Let LLMs Break Free from Overthinking via Self-Braking Tuning.
Haoran Zhao, Yuchen Yan, Yongliang Shen, Haolei Xu, Wenqi Zhang, Kaitao Song, Jian Shao, Weiming Lu, Jun Xiao, Yueting Zhuang.
NeurIPS 2025.Mind the Gap: Bridging Thought Leap for Improved Chain-of-Thought Tuning.
Haolei Xu, Yuchen Yan, Yongliang Shen, Wenqi Zhang, Guiyang Hou, Shengpei Jiang, Kaitao Song, Weiming Lu, Jun Xiao, Yueting Zhuang.
NeurIPS 2025.Learning To Teach Large Language Models Logical Reasoning.
Meiqi Chen, Yubo Ma, Kaitao Song#, Yixin Cao, Yan Zhang, Dongsheng Li.
ACL 2024, Oral.Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers.
Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, Yujiu Yang.
ICLR 2024.Deliberate then Generate: Enhanced Prompting Framework for Text Generation.
Bei Li, Rui Wang, Junliang Guo, Kaitao Song, Xu Tan, Hany Hassan, Arul Menezes, Tong Xiao, Jiang Bian, JingBo Zhu.
Preprint, 2023.Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling.
Kaitao Song, Yichong Leng, Xu Tan, Yicheng Zou, Tao Qin, Dongsheng Li.
NeurIPS 2022.PVTv2: Improved Baselines with Pyramid Vision Transformer.
Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, Ling Shao.
Computational Visual Media (CVM), 2022, Honorable Mention Award.Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions.
Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, Ling Shao.
ICCV 2021, Most Influential Papers (Rank 2).MPNet: Masked and Permuted Pre-training for Language Understanding.
Kaitao Song, Xu Tan, Tao Qin, Jianfeng Lu, Tie-Yan Liu.
NeurIPS 2020.MASS: Masked Sequence to Sequence Pre-training for Language Generation.
Kaitao Song, Xu Tan, Tao Qin, Jianfeng Lu, Tie-Yan Liu.
ICML 2019, Most Influential Papers (Rank 9).
AI Agent
Foresight Optimization for Strategic Reasoning in Large Language Models.
Jiashuo Wang, Jiawen Duan, Jian Wang, Kaitao Song, Chunpu Xu, Johnny KW Ho, Fenggang Yu, Wenjie Li, Johan F Hoorn.
ACL 2026.UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimization.
Zhengxi Lu, Fei Tang, Guangyi Liu, Kaitao Song, Xu Tan, Jin Ma, Wenqi Zhang, Weiming Lu, Jun Xiao, Yueting Zhuang, Yongliang Shen.
ACL 2026.Controllable Memory Usage: Balancing Anchoring and Innovation in Long-Term Human-Agent Interaction.
Muzhao Tian, Zisu Huang, Xiaohua Wang, Jingwen Xu, Zhengkang Guo, Qi Qian, Yuanzhe Shen, Kaitao Song, Jiakang Yuan, Changze Lv, Xiaoqing Zheng.
ACL 2026.Trade in Minutes! Rationality-Driven Agentic System for Quantitative Financial Trading.
Zifan Song, Kaitao Song#, Guosheng Hu, Ding Qi, Junyao Gao, Xiaohua Wang, Dongsheng Li, Cairong Zhao.
ICLR 2026.EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms.
Siyu Yuan*, Kaitao Song*,#, Jiangjie Chen, Xu Tan, Dongsheng Li, Deqing Yang.
NAACL 2025.EASYTOOL: Enhancing LLM-based Agents with Concise Tool Instruction.
Siyu Yuan*, Kaitao Song*,#, Jiangjie Chen, Xu Tan, Yongliang Shen, Kan Ren, Dongsheng Li, Deqing Yang.
NAACL 2025.TaskBench: Benchmarking Large Language Models for Task Automation.
Yongliang Shen*, Kaitao Song*,#, Xu Tan, Wenqi Zhang, Kan Ren, Siyu Yuan, Weiming Lu, Dongsheng Li, Yueting Zhuang.
NeurIPS 2024.Can Graph Learning Improve Task Planning?
Xixi Wu, Yifei Shen, Caihua Shan, Kaitao Song, Siwei Wang, Bohang Zhang, Jiarui Feng, Hong Cheng, Wei Chen, Yun Xiong, Dongsheng Li.
NeurIPS 2024.HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends in Hugging Face.
Yongliang Shen*, Kaitao Song*,#, Xu Tan, Dongsheng Li, Weiming Lu, Yueting Zhuang.
NeurIPS 2023, Most Influential Papers (Rank 8). [paper] [code] [demo]MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models.
Dingyao Yu, Kaitao Song*,#, Peiling Lu, Tianyu He, Xu Tan, Wei Ye, Shikun Zhang, Jiang Bian.
EMNLP 2023 (Demo Track).
Survey
Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems.
Bang Liu*, Xinfeng Li*, Jiayi Zhang*, Jinlin Wang*, Tanjin He*, Sirui Hong*, Hongzhang Liu*, Shaokun Zhang*, Kaitao Song*, Kunlun Zhu*, Yuheng Cheng*, Suyuchen Wang*, et al.
Preprint.A Survey on (M)LLM-based GUI Agents.
Fei Tang, Haolei Xu, Hang Zhang, Siqi Chen, Xingyu Wu, Yongliang Shen, Wenqi Zhang, Guiyang Hou, Zeqi Tan, Yuchen Yan, Kaitao Song, Jian Shao, Weiming Lu, Jun Xiao, Yueting Zhuang.
Preprint.
NLP Application
Improving Long-Context Summarization with Multi-Granularity Retrieval Optimization.
Xueyu Chen, Kaitao Song, Zifan Song, Dongsheng Li, Cairong Zhao.
AAAI 2026.Learning Domain Invariant Prompt for Vision-Language Models.
Cairong Zhao, Yubin Wang, Xinyang Jiang, Yifei Shen, Kaitao Song, Dongsheng Li, Duoqian Miao.
IEEE Transactions on Image Processing (TIP), vol. 33, pp. 1348-1360, 2024.DiffusionNER: Boundary Diffusion for Named Entity Recognition.
Yongliang Shen, Kaitao Song#, Xu Tan, Dongsheng Li, Weiming Lu, Yueting Zhuang.
ACL 2023.Towards Understanding Omission in Dialogue Summarization.
Yicheng Zou, Kaitao Song#, Xu Tan, Zhongkai Fu, Tao Gui, Qi Zhang, Dongsheng Li.
ACL 2023.Analyzing and Mitigating Interference in Neural Architecture Search.
Jin Xu, Xu Tan, Kaitao Song, Renqian Luo, Yichong Leng, Tao Qin, Tie-Yan Liu, Jian Li.
ICML 2022.NAS-BERT: Task-Agnostic BERT Compression with Adaptive Size.
Jin Xu*, Xu Tan*, Renqian Luo*, Kaitao Song*, Jian Li, Tao Qin, Tie-Yan Liu.
KDD 2021.DeepRapper: Neural Rap Generation with Rhyme and Rhythm Modeling.
Lanqing Xue, Kaitao Song, Duocai Wu, Xu Tan, Nevin L. Zhang, Tao Qin, Wei-Qiang Zhang, Tie-Yan Liu.
ACL 2021.SongMASS: Automatic Song Writing with Pre-training and Alignment Constraint.
Zhonghao Sheng*, Kaitao Song*, Xu Tan, Yi Ren, Wei Ye, Shikun Zhang, Tao Qin.
AAAI 2021.Bi-Modal Progressive Mask Attention for Fine-Grained Recognition.
Kaitao Song, Xiu-Shen Wei, Xiangbo Shu, Renjie Song, Jianfeng Lu.
IEEE Transactions on Image Processing (TIP), vol. 29, pp. 7006-7018, 2020.Neural Machine Translation with Error Correction.
Kaitao Song, Xu Tan, Jianfeng Lu.
IJCAI 2020.Double Path Networks for Sequence to Sequence Learning.
Kaitao Song, Xu Tan, Di He, Jianfeng Lu, Tao Qin, Tie-Yan Liu.
COLING 2018.
Speech Application
NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models.
Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao.
ICML 2024, Oral.PromptTTS 2: Describing and Generating Voices with Text Prompt.
Yichong Leng, Zhifang Guo, Kai Shen, Xu Tan, Zeqian Ju, Yanqing Liu, Yufei Liu, Dongchao Yang, Leying Zhang, Kaitao Song, Lei He, Xiang-Yang Li, Sheng Zhao, Tao Qin, Jiang Bian.
ICLR 2024.End-to-End Word-Level Pronunciation Assessment with MASK Pre-training.
Yukang Liang, Kaitao Song#, Shaoguang Mao, Huiqiang Jiang, Luna Qiu, Yuqing Yang, Dongsheng Li, Linli Xu, Lili Qiu.
INTERSPEECH 2023.A Hierarchical Regression Chain Framework for Affective Vocal Burst Recognition.
Jinchao Li, Xixin Wu, Kaitao Song#, Dongsheng Li, Xunying Liu, Helen Meng.
ICASSP 2023.Leveraging Pretrained Representations with Task-related Keywords for Alzheimer’s Disease Detection.
Jinchao Li, Kaitao Song#, Junan Li, Bo Zheng, Dongsheng Li, Xixin Wu, Xunying Liu, Helen Meng.
ICASSP 2023.SoftCorrect: Error Correction with Soft Detection for Automatic Speech Recognition.
Yichong Leng, Xu Tan, Wenjie Liu, Kaitao Song, Rui Wang, Xiang-Yang Li, Tao Qin, Edward Lin, Tie-Yan Liu.
AAAI 2023, Oral.Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech.
Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna Qiu, Jiahang Xu, Liping Jiang, Qun Lou, Yuqing Yang, Dongsheng Li, Xudong Wang, Lili Qiu.
INTERSPEECH 2022.Mixed-Phoneme BERT: Improving BERT with Mixed Phoneme and Sup-Phoneme Representations for Text to Speech.
Guangyan Zhang, Kaitao Song, Xu Tan, Daxin Tan, Yuzi Yan, Yanqing Liu, Gang Wang, Wei Zhou, Tao Qin, Tan Lee, Sheng Zhao.
INTERSPEECH 2022.A Study on the Efficacy of Model Pre-training in Developing Neural Text-to-Speech System.
Guangyan Zhang, Yichong Leng, Daxin Tan, Ying Qin, Kaitao Song, Xu Tan, Sheng Zhao, Tan Lee.
ICASSP 2022.