Personalizing AI Models with Kelvin Guu, Senior Staff Research Scientist, Google Brain
About this episode
From the show’s notesHow do you personalize AI models? A popular school of thought in AI is to just dump all the data you need into pre-training or fine tuning. But that may be less efficient and less controllable than alternatives — using AI models as a reasoning engine against external data sources. Kelvin Guu, Senior Staff Research Scientist at Google, joins Sarah and Elad this week to talk about retrieval, memory, training data attribution and model orchestration. At Google, he led some of the first efforts to leverage pre-trained LMs and neural retrievers, with >30 launches across multiple products. He has done some of the earliest work on retrieval-augmented language models (REALM) and training LLMs to follow instructions (FLAN). No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode. Show Links:
Kelvin Guu Website
Read the show’s notes in full
Google Scholar
FLAN: Finetuned Language Models Are Zero-Shot Learners
Simfluence: Modeling the Influence of Individual Training Examples by Simulating Training Runs
ROME: Locating and Editing Factual Associations in GPT
Branch-Train-Merge: Scaling Expert Language Models with Unsupervised Domain Discovery
Large Language Models Struggle to Learn Long-Tail Knowledge
Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @Kelvin_Guu Show Notes:
