From the source
Deploying the GPT-J 6B model for inference using Hugging Face Transformers and
Deploy GPT-J 6B for inference using Hugging Face Transformers and Amazon SageMaker
From the source
In this blog post, you will learn how to easily deploy GPT-J using Amazon SageMaker and the Hugging Face Inference Toolkit with a few lines of code for scalable, reliable, and secure real-time inference using a regular size GPU instance with NVIDIA T4 (~500$/m).
