On May 23, IT Home reported that Amazon's cloud department announced that it had cooperated with artificial intelligence startup Hugging Face to run thousands of AI models on Amazon's customized computing chips at a lower cost.
The Hugging Face, with an estimated value of 4.5 billion US dollars (note from IT Home: currently about 32.625 billion yuan), has become the center for AI researchers and developers to share chat robots or other AI software, and has been awarded by Amazon Supported by Google, Nvidia and other companies under Alphabet, it is the main platform for developers to obtain and adjust open source AI models (such as Llama 3 of Meta Platforms).
When developers adjust the open source AI model, they usually want to use the model to drive software. Amazon and Hugging Face announced on Wednesday that they have cooperated to achieve this goal on a customized Amazon Web Services (AWS) chip called Inferentia2.
"For us, efficiency is very important - to ensure that as many people as possible can run the model and Run in the most cost-effective way , "said Jeff Boudier, head of product and growth at Hugging Face.
AWS hopes to attract more AI developers to use its cloud services to deliver AI. Although Nvidia dominates the market for training models, AWS believes that its chips can run those trained models at a lower cost.
Matt Wood, who is responsible for AWS AI products, said that you may train these models once a month, But they may be reasoned thousands of times every hour This is where Inferentia2 really shines.
Advertising statement: The external jump links (including but not limited to hyperlinks, QR codes, passwords, etc.) contained in the text are used to convey more information and save selection time. The results are for reference only. All articles of IT Home contain this statement.
