Lingyun Yang

Senior Engineer
Alibaba Group
yanglingyun.yly [at] alibaba-inc.com

About Me

I am currently a senior engineer at Alibaba Group, working on AI infrastructure. Before that, I received my Ph.D. degree in Department of Computer Science and Engineering from Hong Kong University of Science and Technology (HKUST) and my B.Eng. degree in School of Computer Science and Engineering from South China University of Technology (SCUT).

I am open to potential collaborations. Please feel free to contact me if you are interested in my research.

Research Interests

Resource management for large-scale AI/GPU clusters
Efficient and low-cost model serving systems

Recent News [View All]

08/2025: FlashPS accepted to ACM EuroSys ‘26 (CCF-A, acceptance rate: 79/404=19.6%).
08/2025: I passed my PhD thesis defense!
04/2025: Katz accepted to USENIX ATC ‘25 (CCF-A, acceptance rate: 100/634=15.8%).
12/2024: Prism accepted to USENIX NSDI ‘25 (CCF-A, acceptance rate: 55/401=13.7%).

Education

Ph.D., Computer Science and Engineering, Hong Kong University of Science and Technology, 2020 – 2025
B.Eng., Computer Science and Engineering, South China University of Technology, 2016 – 2020

Experience

Research Intern, Alibaba Group, Dec. 2020 – Dec. 2025
Research Intern, Microsoft Research Asia (MSRA), Jul. 2019 – Jun. 2020

Selected Publications [View All]

ATC

Katz: Efficient Workflow Serving for Diffusion Models with Many Adapters

Suyi Li*, Lingyun Yang* (Co-first author), Xiaoxiao Jiang, Hanfeng Lu, Dakai An, Zhipeng Di, Weiyi Lu, Jiawei Chen, Kan Liu, Yinghao Yu, Tao Lan, Guodong Yang, Lin Qu, Liping Zhang, Wei Wang

USENIX Annual Technical Conference (ATC), 2025.

PDF Code Slides arXiv Trace BibTeX

NSDI

GPU-Disaggregated Serving for Deep Learning Recommendation Models at Scale

Lingyun Yang, Yongchen Wang, Yinghao Yu, Qizhen Weng, Jianbo Dong, Kan Liu, Chi Zhang, Yanyi Zi, Hao Li, Zechao Zhang, Nan Wang, Yu Dong, Menglei Zheng, Lanlan Xi, Xiaowei Lu, Liang Ye, Guodong Yang, Binzhang Fu, Tao Lan, Liping Zhang, Lin Qu, Wei Wang

USENIX Symposium on Networked Systems Design and Implementation (NSDI), 2025.

PDF Slides Trace BibTeX

ATC

Beware of Fragmentation: Scheduling GPU-Sharing Workloads with Fragmentation Gradient Descent

Qizhen Weng*, Lingyun Yang* (Co-first author), Yinghao Yu, Wei Wang, Xiaochuan Tang, Guodong Yang, Liping Zhang

USENIX Annual Technical Conference (ATC), 2023.

PDF Poster Code Slides Trace BibTeX

SoCC

Morphling: Fast, Near-Optimal Auto-Configuration for Cloud-Native Model Serving

Luping Wang*, Lingyun Yang* (Co-first author), Yinghao Yu, Wei Wang, Bo Li, Xianchao Sun, Jian He, and Liping Zhang

ACM Symposium on Cloud Computing (SoCC), 2021.

PDF Code BibTeX

Selected Honors

Postgraduate Scholarship, HKUST, 2020 – 2024
Star of Tomorrow Internship Award of Excellence, MSRA, 2020
National Scholarship, China, 2019
The First Prize Scholarship, SCUT, 2017

Academic Services

Artifact Evaluation Committee: ACM SOSP (2023, 2025), ACM SIGCOMM (2024), IEEE HPCA (2024), USENIX OSDI (2023), USENIX ATC (2023), MLSys (2023)
External Conference Reviewer: IEEE INFOCOM (2022 – 2025), IEEE ICDCS (2023, 2025), IEEE ICNP (2024), ACM APSys (2021), IEEE MSN (2021), EAI Qshine (2020)
External Journal Reviewer: IEEE Transactions on Cloud Computing (2025)
Student Volunteer: ACM APNet (2023), IEEE ICMLC & ICWAPR (2018)

Teaching Assistant

CSIT6000O: Advanced Cloud Computing (Spring 2022, Spring 2023)
COMP4651: Cloud Computing and Big Data Systems (Spring 2021, Fall 2021, Spring 2024)
COMP3511: Operating Systems (Fall 2023)

Others

I’m actively maintaining a personal website about my paper reading notes (including machine learning, systems, and other interesting stuffs) and a personal blog (in Chinese).

Powered by Jekyll and Minimal Light theme.