Lead story
Models & availability
Latest
Lead story
Models & availability
Latest
At NeurIPS 2023, many sessions were held in the field of large language models (LLM). In addition to research on improving LLMs' performance, various topics were covered, including reliable evaluation methods, alignment between LLMs and humans, optimization in training and inference, various applications using LLMs, and privacy/bias that can be caused by LLMs. This post will look at the latest LLM research trends presented at NeurIPS 2023 and provide an in-depth look at some of the most impressive research on LLM pre-training data. Section 1. Trends in LLM Research from NeurIPS 2023 Oral Papers Oral and poster presentations were held over three days during NeurIPS 2023. Seventy-seven oral papers were presented on the following schedule (local time). 2023.12.12 Morning: Reinforcement Learning(1), Datasets & Benchmarks(1), Tractable Models Afternoon: Efficient Learning Objects, Neuroscience, Vision Causality Privacy 2023.12.13 Morning: Neuro NLP/Tools, Diffusion Models Afternoon: Optimization Datasets & Benchmarks(2), CoT/Reasoning 2023.12.14 Morning: Privacy/Fairness, Probability/Sampling, Vision(1) Afternoon: LLMs, Reinforcement Learning(2), Vision(2), Theory(2) …