How Distillation Makes AI Models Smaller and Cheaper

Why did Nvidia's CEO sell $12 million stock? How are Trump tariffs affecting global supply chains? What caused Japan's ruling coalition to lose majority? Why did the EPA cut 23% of workforce? What impact did Trump's stablecoin law have? How is AI disrupting the deathcare industry? Why is Nvidia leading AI diplomacy in China?

How Distillation Makes AI Models Smaller and Cheaper

quantamagazine.org/how-distillation-makes-ai-models-smaller-and-cheaper-20250718

Introduction
The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it focused on the fact that a relatively small and unknown company said it had built a chatbot that rivaled the performance of those from the…

This story appeared on quantamagazine.org, 2025-07-20 11:34:18.260000.