Efficient LLM Scheduling by Learning to Rank

Yichao Fu; Aurick Qiao; Ion Stoica; Runlong Su; Hao Zhang; Siqi Zhu

doi:10.52202/079017-1882

Preprint2024

Efficient LLM Scheduling by Learning to Rank

Yichao Fu, Siqi Zhu, Runlong Su, Aurick Qiao, Ion Stoica, Hao Zhang

Article2011

Rank-SIFT: Learning to rank repeatable local interest points

Bing Li, Rong Xiao, Zhiwei Li, Rui Cai, Bao‐Liang Lu, Lei Zhang

Preprint2025

Locality-aware Fair Scheduling in LLM Serving

Shiyi Cao, Yichuan Wang, Ziming Mao, P.-h.J. Hsu, Liangsheng Yin, Tian Xia, Dacheng Li, Shu Liu, Yuanhang Zhang, Yang Zhou, Ying Sheng, Joseph E. Gonzalez, Ion Stoica

Article2024

Energy-Efficient Satellite Range Scheduling Using a Reinforcement Learning-Based Memetic Algorithm

Yanjie Song, Ponnuthurai Nagaratnam Suganthan, Witold Pedrycz, Ran Yan, Dongming Fan, Yue Zhang

Preprint2020

Learning Mixtures of Low-Rank Models

Yanxi Chen, Cong Ma, H Vincent Vincent Poort, Yuxin Chen

Efficient LLM Scheduling by Learning to Rank

Discussion(0)

Related publications

Efficient LLM Scheduling by Learning to Rank

Rank-SIFT: Learning to rank repeatable local interest points

Locality-aware Fair Scheduling in LLM Serving

Energy-Efficient Satellite Range Scheduling Using a Reinforcement Learning-Based Memetic Algorithm

Learning Mixtures of Low-Rank Models