# Hugging Face — Federated Learning using Hugging Face and Flower

- Company: Hugging Face (huggingface.co)
- Announced: 2023-03-27
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://huggingface.co/blog/fl-with-flower
- Record: https://forck.live/items/2082-federated-learning-using-hugging-face-and-flower
- Subject: Platform
- Models affected: distilBERT, distillBERT, distilbert-base-uncased

This is a tutorial on using Hugging Face with Flower to perform federated learning, specifically fine-tuning a pre-trained distilBERT model for sequence classification on the IMDB dataset.

## Evidence

Verbatim from https://huggingface.co/blog/fl-with-flower:

> This tutorial will show how to leverage Hugging Face to federate the training of language models over multiple clients using Flower. More specifically, we will fine-tune a pre-trained Transformer model (distilBERT) for sequence classification over a dataset of IMDB ratings.

---

Record: https://forck.live/items/2082-federated-learning-using-hugging-face-and-flower
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md