Facebook-owner Meta Platforms Inc is opening up access to its massive language model for artificial intelligence (AI) research.
'Large language models' are natural language processing systems that are trained on massive volumes of text, and are capable of both understanding and generating texts.
With 175 billion parameters, Meta’s Open Pretrained Transformer (OPT-175B) was designed to share both the groundbreaking abilities and potential flaws of OpenAI’s pioneering neural network GPT-3. By giving researchers free access to the model, as well as data about its training, Meta hopes to drive AI research forward, as well as reduce the ethical risks that come with these technologies.
“We strongly believe that the ability for others to scrutinise your work is an important part of research,” Joelle Pineau, managing director at Meta AI, told MIT Review. “We really invite that collaboration.”
Meta’s move is the first time that a fully trained large...