# Hugging Face — Databricks ❤️ Hugging Face: up to 40% faster training and tuning of Large Language Models

- Company: Hugging Face (huggingface.co)
- Announced: 2023-04-26
- Category: developer-tool-release
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://huggingface.co/blog/databricks-case-study
- Record: https://forck.live/items/2071-databricks-hugging-face-up-to-40-faster-training-and-tuning-of-large-language
- Subject: Platform

Databricks contributed a new 'from_spark' function to Hugging Face's Datasets library, allowing users to directly convert Spark dataframes into Hugging Face datasets, reducing processing time by up to 40%.

## Evidence

Verbatim from https://huggingface.co/blog/databricks-case-study:

> our first of many official commits to the Hugging Face codebase that allows users to easily create a Hugging Face Dataset from an Apache Spark™ dataframe.

---

Record: https://forck.live/items/2071-databricks-hugging-face-up-to-40-faster-training-and-tuning-of-large-language
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md