Baoheng Zhang

Hermes \({}^{+}\) : Adaptive Memory-Efficient Pipeline Inference for Large Models on Edge Devices

The application of Transformer-based large models has achieved significant success in recent years. However, the exponential growth in the parameters of large models introduces formidable memory challenges for edge deployment. Prior works to address this challenge mainly focus on...