Zero to Singularity
The Compressed Mind: Can a Smaller AI Learn What a Larger One Knows?
38:21
Got something to say to this podcast? Send a voicemail, and you might hear yourself on the next episode!
he most capable AI models can be enormous, expensive, and difficult to run everywhere.
But what if a much smaller model could inherit part of what a larger model has learned?
In Episode 15 of Zero to Singularity, we investigate knowledge distillation the family of techniques used to…