# Hugging Face — Distributed Training: Train BART/T5 for Summarization using 🤗 Transformers and Amazon SageMaker

- Company: Hugging Face (huggingface.co)
- Announced: 2021-04-08
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://huggingface.co/blog/sagemaker-distributed-training-seq2seq
- Record: https://forck.live/items/2261-distributed-training-train-bart-t5-for-summarization-using-transformers-and
- Subject: Platform
- Models affected: BART, T5, facebook/bart-large-cnn

To use Hugging Face Transformers and Amazon SageMaker to fine-tune a distributed BART/T5 model for summarization, using the SageMaker Data Parallelism library and the samsum dataset.

## Evidence

Verbatim from https://huggingface.co/blog/sagemaker-distributed-training-seq2seq:

> We will use the new Hugging Face DLCs and Amazon SageMaker extension to train a distributed Seq2Seq-transformer model on the summarization task using the transformers and datasets libraries, and then upload the model to huggingface.co and test it.

---

Record: https://forck.live/items/2261-distributed-training-train-bart-t5-for-summarization-using-transformers-and
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md