It's incredibly hard to get AI class hardware right now!
Just how much is 1 million tokens?
When using the various AI APIs, you may get access to higher level token context windows, but what is that?
- Let try to put it into perspective:
- The Great Gatsby converts to about 60-70k tokens, so 1 million tokens is 15 GREAT GATSBYS!
- GPT-4's API was originally capped at 4k tokens, however now GPT4-o has a token context window of 128k tokens at half the price!
- https://openai.com/api/pricing/
-
input - $5.00 /1M tokens
- output - $15.00 /1M tokens
Things are moving extraordinary quickly, you should really think about how worked around context limits, whether the next update makes your work obsolete, and how much effort you want to spend on it!
