It was revealed that OpenAI will release a new open source large model. Netizens: GPT replacement?

OpenAI is finally "Open"!

The latest news is that they are preparing to release a new open source language model.

After GPT-2, this is the first time in four years.

Many netizens poked their hands to express their expectations: Are they going to release their own open source replacement?

After all, the best open source model currently is still far from GPT-4. In terms of parameters alone, the difference between the two is three orders of magnitude, one is 20 billion and the other is 1.3 trillion.

OpenAI is going to be Open

In this case, will OpenAI’s move “change the competitive landscape of the entire large model?”.

Many netizens said that the first one to bear the brunt may be the LLaMA large model, the alpaca family.

After all, since the birth of ChatGPT, various open source solutions have emerged in endlessly, but most of them are inspired by the large model of Meta.

For example, Stanford’s Alpaca, Berkeley’s Vicuna, Kaola, and ColossalChat, as well as the domestic Harbin Institute of Technology’s LLaMA fine-tuned model Huatuo based on Chinese medical knowledge... Some of these open source models have even been optimized to be used on mobile phones. equipment operation.

The latest ranking of the large model Chatbot Arena created by UC Berkeley shows that many open source models follow closely behind GPT-4 and Claude.

But whether it will be a "replacement" will not be known until the final release.

It is also unclear whether OpenAI will use this model to compete with other similar open source models.

According to The Information, citing people familiar with the matter, it is certain that this new open source model will be unlikely to compete with GPT.

At the same time, someone is naming Google: Now Google is under increasing pressure.

#Open source and moat have also triggered heated discussions.

Open source and moat

Open source or closed source? This is A question.

Some time ago, an internal Google document caused a stir on the Internet. The core point of it was very clear:

Open source large models are developing rapidly and are being Eroding the positions of OpenAI and Google.

And said, "Unless the stance on closed source changes, open source alternatives will eventually eclipse them (including ChatGPT)."

At this point, neither Google nor OpenAI has a moat in this big model arms race.

Many open source problems have been solved, such as running on lower-power devices, scalable personal AI, multi-modality, etc.

Even though OpenAI and Google now have a certain advantage in model quality, this gap is rapidly narrowing.

In the past few weeks, every team in the open source AI field has made continuous progress, whether in terms of models or applications.

For example, the AI ​​startup Together built an open source large model and cloud platform based on LLaMA last month and has now raised US$20 million in seed funding.

This trend has even continued offline, with many people reveling and celebrating the open source movement.

In addition to launching a series of large-scale model tools, "Open Source Center" HuggingFace even held an offline "Woodstock of AI" gathering, attracting more than 5,000 people.

Stability AI, the company behind Stable Diffusion, and Lightning AI, which developed PyTorch Lightning, also plan to hold an open source exchange meeting.

In the eyes of many people, OpenAI and Google have set a bad precedent: the dangers of unmonitored models are real.

While the models of these big tech companies may not be completely replicable, the open source community understands the basic ingredients in these “secret recipes.” But now no one can know its ingredients.

What do you think about this matter?

Reference link:
[1]https://www.reuters.com/technology/openai-readies-new-open-source-ai-model-information-2023-05-15/
[2]https://www.theinformation.com/articles/open-source-ai-is-gaining-on-google-and-chatgpt
[3]https://venturebeat.com/ai/ open-source-ai-continues-to-celebrate-as-big-tech-mulls-over-moats/

The above is the detailed content of It was revealed that OpenAI will release a new open source large model. Netizens: GPT replacement?. For more information, please follow other related articles on the PHP Chinese website!