petals.devWebsite

Practical guides

Where to Find Petals Documentation, Code, and Community Channels

Petals' official entry points are its website (petals.dev), a "Try now in Colab" link for a hands-on demo, "Docs on GitHub" for documentation and sou…

Which Large Language Models Does Petals Support and How Fast Are They?

Petals supports Llama 3.1 (up to 405B), Mixtral (8x22B), Falcon (40B+), and BLOOM (176B), and it can run them on consumer-grade GPUs or Google Colab …

How to Start Using Petals to Run or Fine-Tune LLMs

You can start with Petals in two ways: open the Colab notebook for a zero-setup trial, or install the library locally and load a slice of a model ont…

How does Petals' BitTorrent-style distributed LLM serving work?

Petals lets you run large language models such as Llama 3.1 (up to 405B), Mixtral (8x22B), Falcon (40B+), or BLOOM (176B) without owning enough GPU m…

What is Petals (petals.dev)?

Petals is a system for running and fine-tuning very large language models across multiple machines instead of on a single GPU. You load one part of a…