From the source

Run a Chatgpt-like Chatbot on a Single GPU with ROCm

Image published with the post by Hugging Face — Image from huggingface.co

Running the Vicuna 13B open-source chatbot model on a single AMD GPU using ROCm, including quantization with GPTQ to reduce memory footprint.

From the source
In this blog, we will delve into the world of Vicuna, and explain how to run the Vicuna 13B model on a single AMD GPU with ROCm.
huggingface.co

Other stories

Hugging Face · 8 Oct

The model that didn't exist, so you made it yourself

A user creates six custom models via ML Intern in days

Hugging Face · 2 OctResearch paper

AutoSynthData: Generating Training Data for Enterprise Agents

Turning model failures into training data for enterprise agents

Hugging Face · 30 Sep

Open TTS Leaderboard: Scalable Evaluation for Multilingual Text-to-Speech and Voice Cloning

Announced: 15 May 2023
Detected: 03 Aug 2026 21:12 UTC (+1175d after)

ModelsVicuna-13B, Vicuna

Visit source ↗huggingface.co

Objective metrics for TTS evaluation, complementing human preference arenas.

Replit · 15 MayCapability change

Making Git Good

Replit rewrites its Git integration for accessibility and reliability

Status page
Replicate · 18 MayInfrastructure
Introducing the ChatGPT app for iOS
OpenAI · 18 MayProduct launch