Polymathic AI and Princeton Researchers Release FlashMap, a Flow Map Drafter for 6.14x Faster LLM Decoding
Polymathic AI and Princeton Researchers Release FlashMap, a Flow Map Drafter for 6.14x Faster LLM Decoding Researchers from Polymathic AI, Princeton, and USC ISI have released FlashMap, a speculative decoding drafter designed to accelerate large language model (LLM) inference. Key Capabilities Joint drafting: FlashMap drafts 16 tokens jointly in one [...]
