OpenBuddy releases a new generation of cross language dialogue model based on Llama 2, which is open source and commercially available

Source: OSCHINA

2023-07-26 10:36:00

OpenBuddy LLaMA2-13B is a new cross language dialogue model based on Llama 2.

Llama 2 It is the latest model base released by Meta. Its data is more sufficient than the previous generation models, and it supports the commercial use of monthly live life of less than 700 million. This means that more companies and teams can use this model for commercial development and promote the popularization and innovation of various applications.

However, as in the previous version, Llama 2 still has some limitations: the LLaMA model base is mainly based on English training data, and cross language scenario applications are not considered. The model itself performs well in English, but in Chinese and other non English languages, the output of the model is not satisfactory.

In addition, the generalization ability and multi round dialogue ability of the LLaMA2 Chat model itself also have limitations.

In view of the limitations of LLaMA2, the OpenBuddy team designed and experimented with a variety of fine-tuning schemes based on their experience in fine-tuning models. Finally, 13B was selected as the model base of the first version, because it is the best model size that can be deployed by individual users and has emerging potential.

After several rounds of fine tuning and repeated experiments, the OpenBuddy team successfully completed the training of the first version of OpenBuddy LLaMA2-13B.

OpenBuddy-LLaMA2-13B

In the process of testing OpenBuddy LLaMA2-13B, the team found that models emerged Strong generalization ability and speculative ability This is the most satisfactory 13B model in their R&D process.

The model has certain critical thinking ability, will not blindly trust the information given by users, and can point out the user's errors or information deficiencies:

The model also has a certain degree of analysis and induction ability. In some scenarios, it can find the potential laws in the input information and give the analysis results:

In addition, the content creation ability and instruction compliance ability of the model have also been further improved, which can produce content that meets user needs:

It is reported that the OpenBuddy LLaMA2-13B model also participated in the HuggingFace's Open LLM Leader Board test list and achieved very high results. Model in English comprehensive ability scoring Exceeds Vicuna, WizardLM 1.0, Meta's official Llama2 chat And many other 13B models, and even can be close to large models with multiple scales such as MPT-30B.

-SORA- 2024-07-01 19:48

After dealing with function pointers in C language, I don't like type preposition.

crystalsis 2024-06-18 15:06

The comment area is very interesting. What's the difference between writing kernel panic in white on a black background and writing it in white on a blue background? It's also "epic retrogression"

osc_566335 2024-07-01 16:35

Judging from his jumping feet on the platform limit, it should not be. At most, it is cannon fodder. It is authentic and professional, and will not be rushed because of platform restrictions. It can also debate with rhythm, and then catch your braid and report your title.

Sprayer 2024-07-01 15:39

Compare with awtk

I'm afraid 2024-07-01 15:37

If that Pingbo is not a professional HW black, he is a digital person, one four five zero raised abroad

Francesca 2024-06-15 15:56

Isn't this still six fingers

-SORA- 2024-07-01 20:35

The parameter lists and semicolons of ts, kotlin, and scala are all separated. Go is the one who deliberately makes a difference.

nian8 2024-07-01 16:32

SQL still has to manage external folders by itself. I think it is ugly. It is formatted with vscode

GDWhisperer 2024-05-15 17:23

I transferred tens of thousands of yuan to my own account, which was under risk control. How did I do this? The bank should be responsible for this 😂

Nickname not defined 2024-07-01 17:09

Because of the openness of Android itself, manufacturers cannot fully control the system, and some money cannot be collected, so deep magic changes are needed

kangaroo 2024-06-22 19:13

The document is an excellent case of language integration practice from the perspective of specifications, but the designer still seems to be a bit pretentious and has made some "innovations", such as func/foreign/->/prop/mut/Run/<:/, Except for the assignment operator, any compound operator is unacceptable and should be avoided as far as possible; In some aspects, the consistency is not rigorous. For example, when functions are used as parameters and return types, they are inconsistent with the standard definitions, and for example, the definitions of anonymous functions (Lambda) are inconsistent, which increases the difficulty of code reading and understanding; It is a bad idea to use the C language address symbol (&) as a spacer for interface inheritance, because it is inconvenient to enter this symbol on the keyboard and requires double keys to enter it; Nothing/Option/Any seems to be taken from TypeScript, which is a kind of null like detection mechanism after all. How about combining one? The syntax style of type followed and separated by colon (:) belongs to Pascal/Go style. This style is more convenient to implement lexical analyzer and generate syntax tree, which is conducive to subsequent processing; I hope that a new language will emerge. It should be based on the style of C language, boldly absorb the excellent practice of the new generation language (grammar sugar), keep the language specification as simple and consistent as possible, but keep the semantics and extensibility open; Cangjie language has made great exploration and practice for the development of new languages, and the expectations after implementation are also very good, making a good start; With the power of example, I believe that the Chinese community is more likely to produce such a language;

Stephen 421 2024-06-12 10:37

If I write a script that allows AI to generate images according to various keywords 24 hours a day, I can sit at home and wait to collect money

-SORA- 2024-07-01 20:04

Other languages will not have similar problems later, which indicates that python's design in this respect is anti intuitive. There is no shame in admitting mistakes. Every language has its own mistakes.

wind

Wind like Man 2024-07-01 19:44

I thought it was written by Python

xmlspyspring 2024-07-01 19:07

Not used to it, it's better now

Xiao Xiaolian 2024-07-01 18:29

Hurry up. Sometimes it is really inconvenient to search on mobile phones.

Ruixin 2024-07-02 08:07

How can Internet Explorer be compatible with IE11 without support?

Whisper the wind over the horizon 2024-05-20 13:19

I also despise this kind of behavior, but what kind of brain circuit does it take to rise to the national level?

Yeah, for 2024-05-17 13:42

That's too right. Old Zhou can't control Google, but he can control 360. Do not do to others what you do not want. You should open source all 360 products first.

Mr Tianming 2024-07-01 16:58

It's finally here

kakai 2024-05-10 10:21

The world only knows that Android was created by Google. Several people know that Android is only a product acquired by Google. Similarly, what is the problem with Huawei's contribution to the collection of OGG open source work and integration into its own proprietary product line?

zoujiaqing 2024-07-01 21:37

Is rt thread supported?

szjay 2024-07-01 15:40

Do idle fish want to use Flutter as the WEB version? That's really fun

infoworld 2024-05-11 15:12

Universities should use open source free software instead of commercial ones. In this way, hands and feet will not be tied technically.

xmosnewone 2024-07-01 16:35

Thank you very much for your comments!!

osc_566335 2024-07-01 16:56

There are [Wen Sheng Tu] and [Tu Sheng Tu], but these liberal arts students have left the creativity of netizens. They are unable to come up with a three character name "video generation based on text description"? I am not only good at it, but also can offer the following suggestions: [Wensheng Shadow] is more written than Wensheng Video?

MirAlbert 2024-07-01 16:49

Yes, Navicat cannot climb high and has been abandoned! Dbeaver flies, open source, free and easy to use!

uncle_haiyang 2024-07-01 16:54

Big project, for the sake of a small number of users, I can only say that rich pdds don't make web versions

Leader of Open Source China Marking Team 2024-07-01 16:11

There was a 2 # taobao # com before

Happy LeapFrog 2024-05-18 09:18

But the question is: "What's the use of this for ordinary Android users?" Now the answer seems to be: "Almost nothing.".

Single structure 2024-05-11 10:09

Selected as Open Source China's disgrace pillar

Intermarch 2024-05-30 13:42

800 million yuan was used for the database industry base of Damon China, and 603 million yuan was used for the construction project of Damon Research Institute. It raised 2.351 billion yuan and 1.403 billion yuan for infrastructure construction. six hundred and sixty-six

Someone gmgn3 2024-07-01 17:08

I am still using Vue Language Features (Volar) v1.8.27

xiaoqibabby 2024-05-15 17:36

The bank is strongly required to be responsible for

osc_566335 2024-05-30 14:12

Sure enough, there are a lot of low-end farmers. In the era of localization, they haven't even played with the domestic ecosystem. Although things are not so good, you should spray on the idea. Don't show your ignorance and make people laugh.

yong230 2024-06-23 19:18

The comment area has started to be weird again. People say that they are compatible with Android, but they abandon incompatible Android, and they say that they cannot study it 100% by themselves. Alas, it's really difficult.

Chief taxi captain 2024-05-17 11:17

I suggest that 360 open source all its products, and then become the leading enterprise in the domestic open source industry through open source, leading everyone to compete with foreign enterprises

-SORA- 2024-07-01 20:09

Leisure Fish APP is just like a frame shredder. When we used Weex, it turned out to be rotten. Weex was complained about. Later, when we used Flutter, it turned out to be bad. I wonder if the webpage version will continue this myth? 🐶

bhzhu203 2024-06-18 15:36

This is very useful. After the graphical interface server core, Panic, the graphical interface is stuck and cannot be moved. If there is no valid information, you can output specific error information with a blue screen

networkexception 2024-07-01 17:41

Hurry to scrap Liu Haiping, just like the touch bar 😂

Qin Liming 2024-05-11 09:12

be devoid of any sense of shame

king

two thrones 2024-07-01 17:14

Similar to kt, but it depends on the platform and ecology supported by the language

You can also use coupons to buy a house 2024-06-24 09:45

Mac OS is parasitic on Unix, Android is parasitic on Linux, Windows copies Mac OS, Linux copies Unix Can't you stand it when your own people are engaged in Hongmeng?

Bright 2024-05-19 23:25

What a fool! I killed myself. How can people deal with me later.

zhy 2024-05-16 13:16

At the end of Shannon is Nong

gamedot 2024-05-17 11:14

Old Zhou is deeply concerned about Huawei's great cause of open source. He is not a Huawei person, but has Huawei's soul.

My name is Li Gue 2024-07-01 17:25

PDD users do not go to the web but only play mobile phones

Post List 2024-07-01 21:35

I didn't know who cut off the web page before

aahen 2024-07-01 16:17

There are many help documents in the installation directory doc

Yoona520 2024-05-17 16:34

Zhou Hongyi is now living more and more like a clown. If he stays behind the scenes, he has to become an online celebrity. Can you learn from Lei Jun?

Ma Nong Little Fatty Brother 2024-05-16 14:40

I give you six seconds. I give you six moves with the same effect in the martial arts contest, which shows the invincibility and confidence of the master

Monkeys think of apes 2024-05-31 18:31

You can cheat your brother. Just don't cheat yourself

sunday12345 2024-05-15 18:31

What does the bank do? It's blamed on the remote desktop. Persimmons really pick up soft pinches~?

Li Yinghui 2024-05-09 16:40

Buddhism has a good word, evil opinion. In dealing with the world, it is meaningless to draw conclusions from preset positions; It is also important to receive good logic training.

Brother Neijuan 2024-07-01 15:52

Https should be fixed on the stigma pole

Youyouzi with Tomatoes 2024-05-30 16:53

There are off the shelf open source products available. Do I need a garbage to keep the bottom?

LongCity 2024-07-01 22:32

In terms of Ali's urination, the logistics SMS does not contain the pickup code, forcing you to scan the code with the app... I don't like this company at all.

-SORA- 2024-07-01 20:11

You can use WeChat PC to open the PDD applet to save the country 😂

zhuzhua 2024-05-21 10:08

I'm laughing to death. Those who have been deeply kidnapped dare not pay? Who will use the domestic open source framework of small companies in the future will be 213!!! Wait for harvesting later

Francesca 2024-05-19 18:00

Wine runs the Android emulator of Windows. Chrome OS is installed in the Android emulator. Linux environment is installed in chrome OS. Linux environment is installed in the Linux environment. Wine is installed in the Android emulator

OpenBuddy releases a new generation of cross language dialogue model based on Llama 2, which is open source and commercially available

OpenBuddy-LLaMA2-13B

Hot content

Popular comments of the whole site

Hot News

Excellent column

How do programmers get started with AI application development?

Talk about Unity and Native Bridging

How to Use Excelize to Process Excel Office Documents Efficiently

Summary of VSCode plug-in development experience

Practice of AI native application architecture from the perspective of cloud native

Understand the basic principle of large model without any mathematical formula

Hot software

OSCHINA Community

Online tools

Introduction

QQ group

Public account

Video number

OpenBuddy releases a new generation of cross language dialogue model based on Llama 2, which is open source and commercially available

OpenBuddy-LLaMA2-13B

Related Links

Hot content

Popular comments of the whole site

Hot News

Excellent column

How do programmers get started with AI application development?

Talk about Unity and Native Bridging

How to Use Excelize to Process Excel Office Documents Efficiently

Summary of VSCode plug-in development experience

Practice of AI native application architecture from the perspective of cloud native

Understand the basic principle of large model without any mathematical formula

Recommended attention

Hot software

OSCHINA Community

Online tools

Introduction

QQ group

Public account

Video number