Information Center

Analysis of the Training Cost of the World Mainstream AI Large Model

  

The training cost of the world's mainstream AI large models is increasing rapidly with the increase of model complexity and the development of technology. Taking GPT-4 and Google's Gemini Ultra as examples, their training costs are estimated to be US $78 million and US $191 million respectively, of which the training costs of Gemini Ultra are 2.5 times that of GPT-4. This rising trend of cost is mainly due to the expansion of model scale, the growth of training data and the increase of demand for computing resources.

However, it should be noted that although the training cost of large models is high, their performance improvement and commercial value are also huge. These models have shown strong capabilities in many fields, including complex reasoning, advanced coding, academic learning, and natural language understanding. Therefore, many companies and organizations are willing to invest a lot of resources to train and deploy these models.

In addition, from the perspective of investment, although the global investment in AI has declined on the whole, the investment in generative AI has shown a surge trend. This reflects the strong confidence and expectation of the market for AI big model and its application.

However, high training costs may also pose barriers to entry for small companies and research institutions, as they may not be able to bear such huge expenses. Therefore, with the further development and popularization of AI technology, it may be necessary to find more efficient and economical model training methods to reduce training and deployment costs, so that more organizations and institutions can benefit from the development of AI technology.

In general, the training costs of the world's mainstream AI models are increasing, but this has not hindered their wide application and commercialization in various fields. With the continuous progress of technology and the continuous maturity of the market, we have reason to believe that, The AI big model will bring us more surprises and values.