After surging to a high of around $6 in July, the B200 GPU price retreated somewhat, but has recently rebounded slowly and remains significantly higher than its May-June levels. This indicates that demand for high-end GPUs remains strong, with the market willing to pay a premium for the B200. Meanwhile, the prices of the H100 and A100 GPUs are slowly declining, with older generation GPUs not following the B200's price increase. This suggests that demand is shifting from older generations to the latest generation, and AI computing power pricing is shifting from a "comprehensive shortage" to a "structural shortage of new-generation high-end GPUs."
-------- 1. The A100, H100, and B200 are NVIDIA's three generations of GPU chips, from oldest to newest. Newer versions of GPUs offer better performance and are better suited for large-scale, complex models, resulting in higher rental prices.
2. Due to the high price and rapid updates of GPUs, many companies choose to lease chips from cloud service providers and data centers to save on investment. Therefore, tracking GPU rental prices can indirectly reflect market demand and gauge the health of the AI computing power market.
3. The Silicon Data GPU Rental Price Index collects daily rental quotes for NVIDIA H100, B200, and A100 GPUs from cloud computing companies, data centers, and the private rental market. After filtering out regional differences and outliers, the price is uniformly converted into "how many US dollars per GPU per hour."
4. An increase in this index generally indicates a greater GPU shortage and stronger demand; a decrease suggests increased supply or cooling demand. By observing price trends and comparing the price difference between new and old GPUs, investors can understand the current state of AI computing power.
