It's no secret that we lack enough AI chips to fuel the AI revolution. This shortage is pushing...
Blockers to making your own AI
It's incredibly hard to get AI class hardware right now!
- https://www.pcmag.com/news/zuckerbergs-meta-is-spending-billions-to-buy-350000-nvidia-h100-gpus
- The best AI scientists won’t even work at companies without enough video cards/hardware access and there is a hardware shortage!
- The Desperate Hunt for the A.I. Boom’s Most Indispensable Prize
- h100 single gpu cost - 40k-50k usd
- a100 single gpu cost (old model) - 10k
- GPT-4 was trained on 25,000 Nvidia A100 GPUs for 90-100 days continuously
Good luck!
