Now the AI language module Jurassic-1-Jumbo is also available27. August 2021
Now the AI language module Jurassic-1-Jumbo is also available
San Francisco, 8/27/2021
AI21 Labs has released the largest version of its AI language model, Jurassic-1 Jumbo. The model contains 178 billion parameters, 3 billion more than OpenAI’s GPT-3. The company is also launching a developer platform where people can build their own applications using Jurassic-1 language models.
Jurassic-1’s jumbo parameters are still behind those of PanGu-Alpha, HyperCLOVA and Wu Dao 2.0, the natural language processing (NLP) model from the Beijing Academy of Artificial Intelligence. More parameters equals a more sophisticated machine learning model.
According to AI21, Jurassic-1 can recognize 250,000 words, phrases and other lexical items and include “multi-word” items such as “The Empire State Building.” By comparison, GPT-3 has a vocabulary of about 50,000 entries.
Israel-based AI21 says it wants to attack OpenAI’s dominance in the NLP-as-a-service industry. It offers Jurassic-1 through its open beta API AI21 Studio and its website, where developers can create their own chatbots, virtual agents, content moderators and more. The company’s first product was Wordtune, an AI-based writing aid that makes suggestions for rewording text.