Biography
Hi, there! This is Zhisheng Ye, a final-year Ph.D. student in Computer Science. I received a B.S. degree in computer science and technology from School of Electronics Engineering and Computer Science, Peking University, China, in 2019. Currently I am working towards a Ph.D. degree in the Institute of Networking and Energy-efficient Computing (NEEC) at Peking University. I am co-advised by Prof. Yingwei Luo, the director of NEEC, and Prof. Xiaolin Wang.
My research interests include distributed systems, machine learning systems and resource management, etc. I am also interested in high performance computing and GPU systems, as a former member of Peking University Cluster Competition Team. I also receive mentorship from Prof. Tianwei Zhang of NTU and have strong collaborations with his students, including Wei Gao, Dr. Qinghao Hu, Meng Zhang, and Qiaoling Chen, and Dr. Peng Sun of Shanghai AI Lab.
Download my CV.
- Distributed Systems
- Machine Learning Systems
- Resource Management
-
Ph.D. Student in Computer Science, since 2019
Peking University
-
BSc in Computer Science and Technology, 2019
Peking University
Experience
- Large scale model (e.g., LLM, MoE) training infrastructure optimization.
- Deeply involved in the development of InternLM.
- Supercomputing cluster scheduling and optimization for deep learning training workloads in Sensetime Research (now SenseCore).
- Design and implementation of a fair scheduler for DLT jobs as first author.
- Contributed to development of OpenI-Octopus, an open-sourced scheduler for deep learning training workloads based on Kubernetes.
- Safe GPU sharing and efficient migration mechanisms on Kubernetes.
- Monitoring and logging systems.
- Participated in analyzing, compiling, profiling, optimizing, and improving parallelizability of general HPC tasks.
- First Price (Team), ASC19 Student Supercomputer Challenge