Rajkumar Buyya

CELLServe: An SLO-Aware and Cost Efficient LLMs Serving System for Serverless Computing Environments

Large Language Models (LLMs) have enabled diverse AI applications. However, LLMs inference impose unprecedented computational and memory overhead, creating an inherent trade-off between latency Service Level Objectives (SLOs) and resource constraints. Serverless computing, with o...

Security in the Fine‐Tuning Lifecycle of Large Language Models: Threats, Defenses, Evaluation, and Future Directions

ABSTRACT Background Fine‐tuning has become a core mechanism for adapting pretrained Large Language Models (LLMs) to downstream tasks. However, the dependence of fine‐tuning on training data, parameter update mechanisms, and reusable components provides entry points for attackers....