Kernels

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v0.14.1).

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

Installation

Install the kernels package with pip (requires torch>=2.5 and CUDA):

pip install kernels

or with uv

uv pip install kernels

or if you want the latest version from the main branch:

pip install "kernels[benchmark] @ git+https://github.com/huggingface/kernels#subdirectory=kernels"

On Windows, we recommend using the Linux version of Torch through WSL 2, since many more kernels support Linux. If you want to use GPU acceleration, check out the CUDA on WSL and PyTorch with DirectML on WSL 2 guides.

We strongly recommend not using a free-threaded Python build yet. These builds are not only experimental, but do not support the stable ABI on Python versions before 3.15. Kernels are compiled with the stable ABI to support a wide range of Python versions.

Update on GitHub

←Why kernels? Talks→