CUDA for LLMs

CUDA for LLMs (English Edition) book cover

CUDA for LLMs (English Edition)

Author(s): Elliot Arledge (Author)

  • Publisher Finelybook 出版社: Manning
  • Publication Date 出版日期: 8 Dec. 2026
  • Language 语言: English
  • ASIN: B0HP271VJX
  • ISBN-13: 9781638358459

Book Description

Get the eBook free when you register your print book at Manning.

CUDA (Compute Unified Device Architecture) provides a powerful parallel programming model AI engineers can use to tap the massive processing power of NVIDIA GPUs. CUDA delivers direct control, debugging power, and acceleration at the GPU level that can’t be matched by other types of optimizations.

This book shows you how to work within the CUDA ecosystem, from your first kernel to implementing advanced LLM features like Flash Attention. You’ll learn to profile with Nsight Compute, identify bottlenecks, and understand why each optimization works. By solving problems at multiple levels of abstraction, you’ll develop a deep understanding of CUDA, along with a practical mastery of kernel-building skills. Written for the latest NVIDIA hardware, the book builds a deep understanding of CUDA fundamentals that will stay relevant as chips upgrade and evolve.

What’s inside

• 56 kernels to utilize in your models
• PyTorch C++ extension pipeline for integrating custom kernels
• Exploit advanced NVIDIA GPU features (Ampere, Hopper, Blackwell)
• Build backpropagation from scratch, ending with a single-file MNIST MLP

About the reader

For software and AI engineers comfortable with C/C++. No prior CUDA experience required.

About the author

Elliot Arledge created the 12-hour CUDA course and the 6-hour LLM from Scratch course for FreeCodeCamp, and consults on deep learning performance.

Editorial Reviews

Product description

About the Author

Elliot Arledge created the 12-hour CUDA course and the 6-hour LLM from Scratch course for FreeCodeCamp, and consults on deep learning performance.

View on Amazon

下载地址

PDF | 3 MB | 2026-11-14
下载地址 Download请完成验证以访问链接!
打赏
未经允许不得转载:finelybook » CUDA for LLMs

评论 抢沙发

觉得文章有用就打赏一下文章作者

您的打赏,我们将继续给力更多优质内容

支付宝扫一扫

微信扫一扫