Welcome to my homepage! I am a Ph.D. student at HKU CS, advised by Prof. C.M. Kao. I also work with the NLP group of Shanghai AI Lab and HKUNLP, focusing on topics related to LLM Agents. Previously, I was a master’s student at NUS, advised by Dr. Xiaoli Li at I2R, A*STAR. Before that, I completed my B.Eng with distinction in the School of Data Science and Engineering at East China Normal University, where I was privileged to be instructed by Prof. Weining Qian, Prof. Xuesong Lu, and Prof. Xiang Li for research and engineering projects. My research interests include neural code intelligence, LLM-based agents, and broad deep learning topics in general.
🍀 Office hours: I am holding office hours (1~2 hours per week) dedicated to offering consultation for COMP7607 students and mentorship programs. If you want to have a chat (whether or not it’s about research), please book me through this link!
🔥 News
- 2024.08: ⭐️⭐️ (Physically) started my PhD at The University of Hong Kong 🇭🇰!
- 2024.07: 🎉🎉 One paper get accepted by COLM 2024! See you at Upenn!
- 2024.05: 🥂🥂 Four papers are accepted by ACL 2024! See you in Bangkok!
- 2024.03: 📑📑 Check out our Code Intelligence Survey Paper🔥
- 2024.02: 🎓🎓 Graduated from National University of Singapore.
- 2023.12: ⛱️⛱️ Attending EMNLP 2023 in SG 🇸🇬
- 2023.07: ✨✨ Started my research intern at NLP Group, Shanghai AI Lab
- 2023.05: 🚀🚀 HugNLP Framework (CIKM'23 Best Demo Paper) is ready for use! Please check our Paper, Repo and Blogs
- 2023.05: 👏👏 We release SelfAware for benchmarking LLMs' self-knowledge
- 2023.01: 🌟🌟 Started my research intern at I2R, A*STAR, Singapore
- 2022.12: 🎉🎉 Our team won second prize (100k RMB) in the International Algorithm Case Competition: PLM Tuning Track.
- 2022.08: 📚📚 Started my master's studies at National University of Singapore. 🇸🇬
- 2022.07: 🎓🎓 Awarded outstanding UG thesis and graduated from ECNU as a Shanghai Outstanding Graduate.
- 2021.09: 📚📚 Started serving as a TA for Deep Learning for Computer Vision course this semester.
- 2021.05: 🏆🏆 Led my team to win the Finalist Award in the Mathematical and Interdisciplinary Contest in Modeling!
- 2021.02: ❄️❄️ Attending Data Science Winter School at Imperial College London.
📝 Publications
Survey
A Survey of Neural Code Intelligence: Paradigms, Advances and Beyond 🔥🔥
Qiushi Sun, Zhirui Chen, Fangzhi Xu, Chang Ma, Kanzhi Cheng, Zhangyue Yin, Jianing Wang, Chengcheng Han, Renyu Zhu, Shuai Yuan, Pengcheng Yin, Qipeng Guo, Xipeng Qiu, Xiaoli Li, Fei Yuan, Lingpeng Kong, Xiang Li, Zhiyong Wu
[Paper] | [Slides] | [Project] | [Video] | 
Let me walk you through the development of neural code intelligence:
- Follow LMs for code as a thread to trace the field’s development 🚀
- Explore cross-domain synergies and opportunities 🌱
- Present a broad array of promising research avenues 💡
PreprintInteractive Evolution: A Neural-Symbolic Self-Training Framework For Large Language Models, Fangzhi Xu, Qiushi Sun, Kanzhi Cheng, Jun Liu and Zhiyong Wu.PreprintKS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Models, Fei Yuan, Chang Ma, Shuai Yuan, Qiushi Sun and Lei Li.COLM 2024Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaboration, Qiushi Sun, Zhangyue Yin, Xiang Li, Zhiyong Wu, Xipeng Qiu and Lingpeng Kong. [LLMAgents @ ICLR 2024] SlidesACL 2024Boosting Language Models Reasoning with Chain-of-Knowledge Prompting, Jianing Wang*, Qiushi Sun*, Xiang Li and Ming Gao. SlidesACL 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents, Kanzhi Cheng, Qiushi Sun, Yougang Chu, Fangzhi Xu, Yantao Li, Jianbing Zhang, Zhiyong Wu. [LLMAgents @ ICLR 2024]ACL 2024Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Models, Fangzhi Xu, Zhiyong Wu, Qiushi Sun, Siyu Ren, Fei Yuan, Shuai Yuan, Qika Lin, Yu Qiao and Jun Liu.LREC-COLING 2024TransCoder: Towards Unified Transferable Code Representation Learning Inspired by Human Skills, Qiushi Sun, Nuo Chen, Jianing Wang, Xiang Li and Ming Gao.LREC-COLING 2024Make Prompt-based Black-Box Tuning Colorful: Boosting Model Generalization from Three Orthogonal Perspectives, Qiushi Sun, Chengcheng Han, Nuo Chen, Renyu Zhu, Jingyang Gong, Xiang Li and Ming Gao. | 🥈 100K RMB Award-winning SolutionLREC-COLING 2024Aggregation of Reasoning: A Hierarchical Framework for Enhancing Answer Selection in Large Language Models, Zhangyue Yin, Qiushi Sun, Qipeng Guo, Zhiyuan Zeng, Xiaonan Li, Tianxiang Sun, Cheng Chang, Xipeng Qiu and Xuanjing Huang.EMNLP 2023Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communication, Zhangyue Yin, Qiushi Sun, Cheng Chang, Qipeng Guo, Junqi Dai, Xuanjing Huang and Xipeng Qiu. Slides | VideoEMNLP 2023Uncertainty-aware Parameter-Efficient Self-training for Semi-supervised Language Understanding, Jianing Wang, Qiushi Sun, Nuo Chen, Chengyu Wang, Xiang Li, Ming Gao and Jun Huang.EMNLP 2023Pass-Tuning: Towards Structure-Aware Parameter-Efficient Tuning for Code Representation Learning, Nuo Chen, Qiushi Sun, Jianing Wang, Xiang Li and Ming Gao.CIKM 2023 (Demo)HugNLP: A Unified and Comprehensive Library for Natural Language Processing, Jianing Wang, Nuo Chen, Qiushi Sun, Wenkang Huang, Chengyu Wang and Ming Gao. | 🏆 Best Demo Paper Award
ACL 2023Do Large Language Models Know What They Don’t Know?, Zhangyue Yin, Qiushi Sun, Qipeng Guo, Jiawen Wu, Xipeng Qiu and Xuanjing Huang. Slides | Video |ACL 2023When Gradient Descent Meets Derivative-Free Optimization: A Match Made in Black-Box Scenario, Chengcheng Han, Liqing Cui, Renyu Zhu, Jianing Wang, Nuo Chen, Qiushi Sun, Xiang Li and Ming Gao.EMNLP 2022CAT-probing: A Metric-based Approach to Interpret How Pre-trained Models for Programming Language Attend Code Structure, Nuo Chen*, Qiushi Sun*, Renyu Zhu*, Xiang Li, Xuesong Lu and Ming Gao. Slides | Video |
*Denotes equal contribution. More working drafts / preprints under review will be released later ⌛️
💻 Internships
- 2023.06 - 2024.10, NLP Research Intern, NLP Group, Shanghai AI Laboratory
, Shanghai, China. - 2023.01 - 2023.06, NLP Research Intern, Institute for Infocomm Research, A*STAR
, Singapore. - 2021.10 - 2022.07, Research Assistant, School of Data Science and Engineering
, ECNU, Shanghai, China.
🎖 Honors and Awards
- 2023.10 CIKM Best Demo Paper Award, ACM & SIGIR
- 2022.12 International Algorithm Case Competition: PLM Tuning, Second Prize, Guangdong-Hong Kong-Macao Greater Bay Area
- 2022.07 Shanghai Outstanding Graduates, Shanghai Municipal Education Commission
- 2022.05 Excellent Bachelor Thesis Award, East China Normal University
- 2021.11 Outstanding Student, East China Normal University
- 2021.10 First Class Scholarship, East China Normal University
- 2021.05 Finalist (Special Class Prize), Mathematical and Interdisciplinary Contest in Modeling
🧑🏫 Teaching
I serve(d) as a teaching assistant for:
- COMP7607: Natural Language Processing (for masters), HKU, 2024 Fall. Instructor: Lingpeng Kong
- Deep Learning for Computer Vision (for UG), ECNU, 2021 Fall. Instructor: Xuesong Lu
📖 Educations
- 2024.08 - Present, Ph.D, The University of Hong Kong
, Hong Kong SAR. - 2022.08 - 2024.01, Master, National University of Singapore
, Singapore. - 2018.09 - 2022.07, Undergraduate, School of Data Science and Engineering, East China Normal University
, Shanghai, China. - 2011.09 - 2018.07, Middle School, Pudong Foreign Languages School
, SISU, Shanghai, China.
🔍 Services
- I serve(d) as a reviewer / program committee member for the following conferences, journals, and workshops:
- Conferences: EMNLP’22, ACL’23, CIKM’23, EMNLP’23(Best Reviewer Award), ICLR’24, NeurIPS’24, NLPCC’24, ICLR’25, COLING’25, NAACL’25.
- Journals: ACL Rolling Review (2023.4 - Present), Frontiers of Computer Science
- Workshops: WiNLP’24.
“What’s past is prologue.” – William Shakespeare (The Tempest)