Pricing & Cost

Tokens Per Minute (TPM)

TPM is a common rate limit unit. It's more relevant than request count for throughput-heavy applications. Managing TPM requires batching or queueing. Exceeding TPM limits requests. TPM limits enable fair-use and capacity planning. Different API tiers have different TPM limits. High-volume applications should plan around TPM limits.