Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
Doctor-Shotgun 's Collections
Doc's Choice
Stable Diffusion Things
LLMs
LLM Loras
LLM Speculative Decoding

LLM Speculative Decoding

updated Aug 31, 2024

Tiny language models meant to serve as draft models for speculative decoding.

Upvote
3

  • Doctor-Shotgun/TinyLlama-1.1B-32k

    Text Generation • Updated Feb 2, 2024 • 323 • 28

  • Doctor-Shotgun/TinyLlama-1.1B-32k-Instruct

    Text Generation • Updated Jun 7, 2024 • 1.63k • 12

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta

    Text Generation • Updated Jan 10, 2024 • 12 • 1

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft

    Text Generation • Updated Jan 10, 2024 • 5 • 2

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft-limarp

    Text Generation • Updated Jan 10, 2024 • 8

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-linear

    Text Generation • Updated Jan 10, 2024 • 13
Upvote
3
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs