As of today, we work with AI (neural network approaches) and especially the language models by...
Blockers to making your own AI
It's incredibly hard to get AI class hardware right now!
- https://www.pcmag.com/news/zuckerbergs-meta-is-spending-billions-to-buy-350000-nvidia-h100-gpus
- The best AI scientists won’t even work at companies without enough video cards/hardware access and there is a hardware shortage!
- The Desperate Hunt for the A.I. Boom’s Most Indispensable Prize
- h100 single gpu cost - 40k-50k usd
- a100 single gpu cost (old model) - 10k
- GPT-4 was trained on 25,000 Nvidia A100 GPUs for 90-100 days continuously
Good luck!
