As of October 25th, the rental price of NVIDIA B200 GPUs rose to $6.60 per GPU per hour, a 5.4% increase from a week earlier, marking several consecutive days of increases. During the same period, the rental price of H100 GPUs was $2.89, a weekly increase of 2.1%; and A100 GPUs were $1.56, a weekly increase of 2.0%. While the rental prices of all three GPUs rose simultaneously, the B200's increase was significantly higher, indicating stronger demand for high-end computing power rentals and a generational divergence in market prices.
-------- 1. The GPU rental price index primarily tracks the actual rental quotes for NVIDIA A100, H100, and B200 GPUs from cloud service providers, data centers, and the private rental market each day.
2. A100, H100, and B200 are three generations of NVIDIA GPU chips, from oldest to newest. Generally, newer generations of GPUs offer better performance and are better suited for large-scale, complex models, and their rental prices tend to be higher. 3. Due to the high price and rapid updates of GPUs, many companies choose to lease chips from cloud service providers and data centers to save on investment costs. A rise in related indices usually indicates a greater shortage of GPUs and stronger demand; a decline suggests increased supply or cooling demand.
