From the source
Self-speculative decoding, a technique that uses early layers of a large language model for drafting tokens and later layers for verification, achieving faster text generation and memory savings.
It provides implementation details using the transformers library and benchmarks comparing with traditional speculative decoding.
