FlashML-org/FreeToken

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

★ 16.7k · 1.6k forks · Python

Add it to your README

Charts use snapshots recorded by Repostream, starting at the first observation. README images are cached for 6 to 12 hours. Limited history is shown as collecting, never estimated.

Star history chart

[![Star history](https://repostream.com/chart/FlashML-org/FreeToken.svg)](https://repostream.com/repo/FlashML-org/FreeToken)

Trending rank badge

[![Trending on Repostream](https://repostream.com/badge/FlashML-org/FreeToken.svg)](https://repostream.com/repo/FlashML-org/FreeToken)

Want to see what is gaining stars fastest right now? Open the live leaderboard.