Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
MiniLLM 's Collections
MiniPLM
MiniLLM

MiniPLM

updated Oct 21, 2024

Pre-trained models in MiniPLM: Knowledge Distillation for Pre-Training Language Models

Upvote
2

  • MiniLLM/MiniPLM-Qwen-200M

    Text Generation • 0.2B • Updated Oct 27, 2024 • 162 • 9

  • MiniLLM/MiniPLM-Qwen-500M

    Text Generation • 0.5B • Updated Mar 25, 2025 • 183 • • 7

  • MiniLLM/MiniPLM-Qwen-1.2B

    Text Generation • 1B • Updated Mar 25, 2025 • 10 • 4

  • MiniLLM/MiniPLM-Mamba-130M

    Text Generation • 0.1B • Updated Mar 25, 2025 • 9 • 3

  • MiniLLM/MiniPLM-llama3.1-212M

    Text Generation • 0.2B • Updated Mar 25, 2025 • 5 • 6
Upvote
2
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs