Making LLMs more accurate by using all of their layers
Research paper
Google Research introduces SLED (Self Logits Evolution Decoding), a decoding strategy that improves LLM factual accuracy by using all layers of the model rather than just the last layer.
It requires no external data or fine-tuning and was featured at NeurIPS 2024.