Meta announced it’s open-sourcing its large language model LLaMA 2, (Large Language Model Meta AI) making it free for commercial and research use and going head-to-head with OpenAI’s free-to-use GPT-4, which powers tools like ChatGPT and Microsoft Bing.
Recent breakthroughs in AI, and generative AI in particular, have captured the public’s imagination and demonstrated what those developing these technologies have long known — they have the potential to help people do incredible things, create a new era of economic and social opportunities, and give individuals, creators, and businesses new ways to express themselves and connect with people.
meta
Meta announced the move as part of Microsoft’s Inspire event, noting its support for Azure and Windows and a “growing” partnership between the two companies. At the same time, Microsoft revealed more details about the AI tools built into its 360 platform and how much those will cost. Qualcomm also announced it is working with Meta to bring LLaMa to laptops, phones, and headsets starting from 2024 onward for AI-powered apps that work without relying on cloud services.
Meta’s press release explains the decision to open up LLaMA as a way to give businesses, startups, and researchers access to more AI tools, allowing for experimentation as a community. According to Meta, LLaMa 2 was trained on 40 percent more data when compared to LLaMa 1, which includes information from “publicly available online data sources.” It also says it “outperforms” other LLMs like Falcon and MPT when it comes to reasoning, coding, proficiency, and knowledge tests.
In opening up LLaMA, Meta said it wants to improve safety and transparency. The company said the LLaMA 2 model has been “red-teamed,” or tested for safety by “generating adversarial prompts to facilitate model fine-tuning,” both internally and externally. Meta also discloses how the models are evaluated and tweaked. The open-sourced LLaMa 2 will be available through Microsoft’s Azure platform. Meta said LLaMA will also be available through AWS, Hugging Face, and other providers.
“We believe an open approach is the right one for the development of today’s AI models, especially those in the generative space where the technology is rapidly advancing,” Meta said in a statement. “Opening access to today’s AI models means a generation of developers and researchers can stress test them, identifying and solving problems fast, as a community.”
While Meta first announced its LLaMA model in February, it leaked on 4chan just days later. Now that more people have access to LLaMA 2, we’re bound to see new AI-powered tools built upon the model. Meta says it received over 100,000 requests from researchers to use its first model, but the open-source LLaMA 2 will likely have a far bigger reach.
Demo
You can easily try the Big Llama 2 Model (70 billion parameters!) in this Space or in the playground embedded below:
