From the source
Tencent researchers investigate how batch size affects the efficiency of reinforcement learning training for large language models, analyzing the trade-off between throughput gains and sample efficiency.
- The study develops a framework to identify the batch size that minimizes wall-clock time to reach target performance, showing that while moderate batch increases with learning-rate retuning can improve efficiency, excessively large batches incur sample costs that outweigh throughput benefits.




