# forck.live — 9–15 November 2020

> AI lab announcements, news reports and podcasts.

forck.live follows what companies announce about their own products. Press may
corroborate an official story; it never leads and never appears as an item of its
own. A missing date stays missing. A title is the publisher's words — where a
company does not publish in English, an English rendering is listed separately
as `Title in English` and named as this site's translation, never as theirs.

This file is one issue of the weekly archive: every confirmed
first-party announcement of ISO week 2020-W46, 9–15 November 2020, newest
first. The window never moves, so this URL always names the same seven days —
but a post published inside them and detected later is added when it arrives,
so a closed week can still gain entries.

Every entry is one first-party announcement, and carries the same eight fields
in this order before any others:

    Company · Announced · Category · Coverage · Announcement · Group · Source · Record

`Source` is the company's own page the announcement was traced to and `Record`
is this site's page for it. Both are safe to cite.

`Coverage` is a number of outlets, or `not counted` — which means this record
reached no count of its own, never that nobody wrote about it.

`Category` is this tracker's own analysis, and is authoritative wherever it is
stated. `not stated` means either that nothing has analysed the post yet or
that the analysis placed it outside this taxonomy; neither is a verdict about
the announcement.

`Announcement` is whether the post is news of something the company did, rather
than a how-to, a customer story, a changelog listing or a staffing note.

`Group` is which of this record's groups the entry falls in, carried on the
entry itself so it holds where the groups are headings and where they are not.
One of: `models`, `covered`, `announcements`, `routine`.

Anything after `Record` is held detail that only some announcements carry.

- This week's page: https://forck.live/week/2020-W46
- The current issue, and the catalogue of the other weeks: https://forck.live/briefing.md
- Catalogue: https://forck.live/llms.txt

## Announcements

### Hugging Face — Leveraging Pre-trained Language Model Checkpoints for Encoder-Decoder Models

- Company: Hugging Face (huggingface.co)
- Announced: 2020-11-09
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://huggingface.co/blog/warm-starting-encoder-decoder
- Record: https://forck.live/items/2273-leveraging-pre-trained-language-model-checkpoints-for-encoder-decoder-models
- Subject: Platform

To warm-start encoder-decoder models using pre-trained language model checkpoints like BERT and GPT2 to avoid expensive pre-training. It provides theoretical background, analysis from Rothe et al. (2020), and a practical code example using the 🤗Transformers library.