Just how much is 1 million tokens?

Written by Noel Victor | May 27, 2024 7:24:41 PM

When using the various AI APIs, you may get access to higher level token context windows, but what is that?

Things are moving extraordinary quickly, you should really think about how worked around context limits, whether the next update makes your work obsolete, and how much effort you want to spend on it!