From the source
Replit announced Ghostwriter, an AI-powered pair programmer integrated into its IDE, with a flagship feature called Complete Code that provides real-time code completion.
The feature is currently in closed beta.
Replit built Ghostwriter using open-source large language models like Salesforce's CodeGen, optimized for low latency (median response time under 400ms) through techniques including FasterTransformer, Triton inference server, knowledge distillation, and quantization.
