I am a second-year Ph.D. candidate at HKU, supervised by Lingpeng Kong. I obtained my bachelor’s and master’s degrees from the Department of Computer Science at Fudan University, advised by Prof. Xipeng Qiu. My current research focuses on building effective long-context LLMs, including: (1) Fully utilizing the training context. (2) Efficient inference on over 1 million tokens. (3) Developing better evaluation tasks for current long-context LLMs.
Publications (2023 - )
Why Does the Effective Context Length of LLMs Fall Short?
Chenxin An, Jun Zhang, Ming Zhong, Lei Li, Shansan Gong, Yao Luo, Jingjing Xu, Lingpeng Kong
STRING 
L-Eval: Instituting Standardized Evaluation for Long Context Language Models (ACL 2024)
Chenxin An, Shansan Gong, Ming Zhong, Mukai Li, Jun Zhang, Lingpeng Kong, Xipeng Qiu (Outstanding paper, ACL2024)
L-Eval 
Training-Free Long-Context Scaling of Large Language Models (ICML 2024)
Chenxin An, Fei Huang, Jun Zhang, Shansan Gong, Xipeng Qiu, Chang Zhou, Lingpeng Kong
ChunkLlama 
Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective (ICLR 2024)
Ming Zhong, Chenxin An, Weizhu Chen, Jiawei Han, Pengcheng He
Scaling laws of rope-based extrapolation (ICLR 2024)
Xiaoran Liu, Hang Yan, Shuo Zhang, Chenxin An, Xipeng Qiu, Dahua Lin
Temporal Reasoning Transfer from Text to Video
Lei Li, Yuanxin Liu, Linli Yao, Peiyuan Zhang, Chenxin An, Lean Wang, Xu Sun, Lingpeng Kong, Qi Liu
Scaling Diffusion Language Models via Adaptation from Autoregressive Models
Shansan Gong, Shivam Agarwal, Yizhe Zhang, Jiacheng Ye, Lin Zheng, Mukai Li, Chenxin An, Peilin Zhao, Wei Bi, Jiawei Han, Hao Peng, Lingpeng Kong
Honors and Awards
- Outstanding paper, ACL 2024
- Hong Kong PhD Fellowship Scheme (HKPFS), 2023
- National Scholarship at Fudan University, 2022
- National Scholarship at Fudan University, 2021