P-EAGLE: Faster LLM inference with Parallel Speculative Decoding in vLLM

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.