bojieli/ai-infra-book
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
An Open Book That Derives LLM Infra Design From Hardware Numbers — This free, open-source book works from hardware constraints and model architecture to quantitatively derive LLM training and inference system design, covering topics like KV-cache, MoE, and datacenter networking. It's a companion to the author's earlier AI Agent book and targets engineers who want to reason about latency and cost tradeoffs, not just use infra as a black box. Includes full text, PDF/EPUB, calculation tools, and experiments.
Metrics
Retention can be computed 30 days after a repository first trends (it isn't shown until then). See About for how each metric is defined.
Star growth and Trending appearances (last 30 days)
Bands mark days on the trending list (darker = higher rank)
Daily trending ranks as a table (1 days)
| Date | Daily |
|---|---|
| Nov 16, 2026 | python #4 +127 |
Created Aug 23, 2026 · First on trending Nov 16, 2026
Other notable repositories in the same category (LLMs & ML)
- hyperionaidev/smolmaxxing
- huawei-csl/MACaQ
- yuu551/amazon-bedrock-practical-guide-samples
- hatchet-dev/distributed-ray-tracer
- AInVFX/ainvfx-paintaplate
See all LLMs & ML repositories →
Rank within deepseek
| # | Repository | ★ |
|---|---|---|
| 1 | ollama/ollama | 187,682 |
| 2 | huggingface/transformers | 169,298 |
| 3 | langgenius/dify | 161,533 |
| 4 | Snailclimb/JavaGuide | 159,624 |
| 5 | nexu-io/open-design | 108,555 |
| 6 | vllm-project/vllm | 97,238 |
| 7 | cheaper-inference/OmniRoute | 88,975 |
| 8 | lobehub/lobehub | 85,881 |
| 9 | Ebony-Vinyl/dsh-our-free-model | 81,200 |
| 10 | unslothai/unsloth | 79,804 |
| 25 | bojieli/ai-infra-book | 8,137 |