LoRAX (LoRA eXchange) is a framework that allows users to serve thousands of fine-tuned models on a single GPU, dramatically reducing the cost of serving without compromising on throughput or latency.

Abstract: Federated Learning (FL) has gained popularity across various industries due to its ability to train machine learning models without explicit sharing of sensitive data. While this paradigm ...