Meta is Developing its Own LLM to Compete with OpenAI

Meta’s trying to make an even bigger push into generative AI, through a brand new LLM system that it hopes will make it the chief within the AI race.

In accordance with The Wall Street Journal, Meta’s at the moment constructing a brand new AI system, which it hopes will finally rival OpenAI’s GPT methods in compute energy and complexity. The system will construct on Meta’s present Llama models, and produce Meta up to the mark with others within the generative AI race.

As per WSJ:

“The planned system, details of which could still change, would help other companies to build services that produce sophisticated text, analysis and other output. It is the work of a group formed early this year by Meta Chief Executive Mark Zuckerberg to accelerate development of so-called generative AI tools that can produce humanlike expressions.”

Certainly, numerous studies have urged that Zuckerberg grew to become “obsessed” with AI after seeing the early hype round ChatGPT, which has modified the course of a lot of Meta’s tasks, and diminished its emphasis on the metaverse, its longer-term VR guess.

Although that additionally stays a key factor in Meta’s planning. However generative AI has opened up new alternatives, and Meta is uniquely positioned to faucet into such, based mostly on its unmatched databanks, and systematic assets.

On the latter, WSJ additionally studies that Meta’s at the moment within the means of buying extra Nvidia H100 chips to energy its AI ambitions. Nvidia chips are in high demand, and limited supply at present, which, at a base stage, signifies that the corporate with essentially the most chips stands the most effective probability to win out within the broader AI improvement race.

Earlier this yr, Elon Musk reportedly purchased 10,000 GPUs for his generative AI undertaking.

It’ll be attention-grabbing to see how Meta plans to deploy its personal AI and LLM instruments, and the way they’ll be built-in into its in-app experiences. Meta’s already experimenting with a variety of AI-powered parts, together with visual creation tools and an Instagram chatbot.

Perhaps, by means of a extra superior AI system, it’ll look to reinforce and enhance these experiences, whereas additionally using higher-end AI inside its advert concentrating on and creation course of.

Total, it’s little shock to see Meta trying to make an even bigger transfer within the AI area, given its long-term work on this space, and the potential it has to compete, based mostly on its trove of conversational information and interplay. With these concerns factored in, it does look like Meta ought to have the ability to create a greater AI mannequin, and it’ll be attention-grabbing to see how, precisely, it appears to deploy and make the most of such methods.

In accordance with WSJ, Meta expects to begin coaching its new AI system in early 2024. No phrase but on a public launch timeline.