Baidu CTO Wang Haifeng interprets Wenxin's big model 4.0 Baidu will train another 5 million model talents

Beijing, China Economic Network, October 18 (reporter Li Fang) Wenxin Big Model 4.0 was officially released at Baidu World 2023 yesterday, and Baidu Chief Technology Officer Wang Haifeng interpreted the key technologies and the latest progress behind Wenxin Big Model 4.0. He said that the four abilities of understanding, generation, logic and memory of Wenxin Big Model 4.0 have been significantly improved. In September, the small traffic has been launched, and the effect has increased by nearly 30% in the past month. On August 31, Wenxin Yiyan opened up to the whole society so far, with 45 million users, 54000 developers, 4300 scenarios, 825 applications and more than 500 plug-ins.

On March 16 this year, Baidu released Wenxin Yiyan, a big language model for knowledge enhancement. Wenxin Yiyan integrates learning from trillions of data and hundreds of billions of knowledge to obtain a large model of pre training. On this basis, it uses technologies such as supervised fine tuning, human feedback enhanced learning, and prompts, and has technical advantages in knowledge enhancement, retrieval enhancement, and dialogue enhancement.

Wang Haifeng said that compared with version 3.5, the four abilities of understanding, generation, logic and memory of Wenxin Model 4.0 have been significantly improved. Among them, the improvement of understanding and generation ability is similar, while the improvement of logic and memory ability is even greater. The improvement of logic is nearly three times that of understanding, and the improvement of memory is more than two times that of understanding.

In addition, Wenxin Big Model 4.0 enhances knowledge points in both the input and output stages. On the one hand, understand the questions entered by users, and disassemble the knowledge points needed to answer the questions, then search for accurate knowledge in search engines, knowledge maps, and databases, and finally assemble these found knowledge into Prompt and send it to the large model, with good accuracy and high efficiency; On the other hand, reflect on the output of the big model, disassemble the knowledge points from the generated results, and then use the search engine, knowledge map, database, and the big model itself to confirm, and then correct the points with errors.

Wang Haifeng said that on the basis of a strong basic big model, Baidu has further developed an agent mechanism, including understanding, planning, reflection and evolution, which can achieve reliable execution and self evolution, and to a certain extent, the thinking process is white boxed, so that machines can think and act like people, independently complete complex tasks, and continuously learn in the environment to achieve self evolution.

At present, Wenxin has also been applied to more practical areas. The National Library of China has the largest ancient local chronicles in the world. Baidu has launched strategic cooperation with it to learn the ancient local chronicles and genealogy data by using the Wenxin model, so as to help the global Chinese obtain more clues to find their roots. In addition, the Chinese National Diving Team and Baidu have carried out in-depth technical cooperation since 2019. Based on Baidu's big model technologies such as Wenxin Yiyan, the Chinese National Diving Team AI auxiliary training system has been comprehensively upgraded, which provides real-time scoring and accurate quantitative analysis of movements, provides the most valuable guidance information, and helps the Chinese National Diving Team train efficiently.

In terms of artificial intelligence talent cultivation, Wang Haifeng announced that Baidu proposed to cultivate 5 million AI talents for the whole society in five years in 2020. Up to now, Baidu has cultivated 4.2 million AI talents.

On the 17th, Wang Haifeng released Baidu's talent cultivation star plan, "We will work closely with all sectors of industry, university and research to deepen the integration of industry and education, train another 5 million model talents for the society, let the" flower of innovation "of artificial intelligence technology, produce more" industrial fruits ", serve national strategies, serve social development and serve people's well-being."

key word: Interpretation of Wenxin Wenxin Large model Wang Haifeng Large model