As of October 20th, the rental price of NVIDIA B200 GPUs fell back to $6.14 per GPU per hour, still near historical highs, up 7% from a week ago. During the same period, the rental price of H100 GPUs was $2.85, remaining high and stable; A100 GPUs were $1.52, basically unchanged from the previous week. Data shows that rental prices for new-generation GPUs remain high, while older generation products are performing relatively weakly, reflecting the generational price differentiation in the AI computing power rental market.
-------- 1. The GPU rental price index mainly tracks the actual rental quotes for NVIDIA A100, H100, and B200 GPUs from cloud service providers, data centers, and the private rental market each day.
2. A100, H100, and B200 are NVIDIA's three generations of chip products (GPUs), from oldest to newest. Generally, newer generation GPUs have better performance and are better suited for large-scale, complex models, and their rental prices tend to be higher.
3. Due to the high price and rapid updates of GPUs, many companies choose to lease chips from cloud service providers and data centers to save on investment costs. A rise in related indices usually indicates a greater shortage of GPUs and stronger demand; a decline suggests increased supply or cooling demand.
