Parallel Compute: A Case study of Speculative Decoding
This note surveys five parallelism strategies for large-scale computing. It then follows speculative decoding from vanilla draft-then-verify and EAGLE to diffusion-based drafting, …
This note surveys five parallelism strategies for large-scale computing. It then follows speculative decoding from vanilla draft-then-verify and EAGLE to diffusion-based drafting, …