Source: Dario Amodei, Danny Hernandez et al., "AI and Compute," avail. online (May 2018 & updated Nov. 2019)
The Main Idea.
In the modern era (post ~2012), demand for compute has been doubling every 3-4 mos (per 2019 evidence compliments of Sastry et al. at OpenAI) because of (a) hardware improvements and (b) economic investment fueling innovation
This continuation trend sets the stage for critically exploring decentralized solutions to compute, an essential resource for AI (mis)development.
There’s a lot of work to do. How can we do more and better?