sybil-solutions/inference-optimisation-skill

Agent skill for hill-climbing local LLM serving speed (decode, speculative decoding, prefill, KV, startup, TTFT) on any hardware and quantization

★ 808 · 72 forks · Python

View on GitHub
Star history chart for sybil-solutions/inference-optimisation-skill

Add it to your README

Charts use snapshots recorded by Repostream, starting at the first observation. README images are cached for 6 to 12 hours. Limited history is shown as collecting, never estimated.

Star history chart
[![Star history](https://repostream.com/chart/sybil-solutions/inference-optimisation-skill.svg)](https://repostream.com/repo/sybil-solutions/inference-optimisation-skill)
Trending rank badge
[![Trending on Repostream](https://repostream.com/badge/sybil-solutions/inference-optimisation-skill.svg)](https://repostream.com/repo/sybil-solutions/inference-optimisation-skill)
Trending rank badge preview

Want to see what is gaining stars fastest right now? Open the live leaderboard.