Amazon is developing a language model that would at this stage be twice as powerful as GPT-4, the one that powers the famous ChatGPT.
The battle for the world’s strongest extended language model (LLM) is on, and Amazon intends to win it. The e-commerce giant is investing heavily in the formation of Olympus, which aims to compete with OpenAI and its ChatGPT, but also Bard and Grok. Amazon already likes and uses generative AI: it now needs its own model.
A conversational model made in Amazon with 2000 billion parameters
The information, revealed by our American colleagues from The Information, reports a language model with particularly impressive characteristics. The conversational LLM currently called Olympus would include no less than two trillion parameters, or 2,000 billion.
At this stage, the figure may not mean much, but it demonstrates the ambition of the firm founded by Jeff Bezos: it wants to develop a conversational model with twice the capabilities of its main competitor. , GPT-4, to date the most advanced from the OpenAI company. The latter has 1,000 billion parameters.
A language model allows, remember, conversational robots (like Google Bard or ChatGPT) to respond to queries in natural language, taking into account a certain number of parameters.
Alexa teams at work
Amazon’s idea is to take advantage of the future Olympus to power new functionalities, whether for its Amazon Web Services solutions (the company’s cloud subsidiary), with professional customers who are also very demanding, or its e-commerce activities, without forgetting an improvement of its devices running Alexa, the firm’s intelligent personal assistant.
Imagine that the Olympus project is led by Rohit Prasad, who is none other than the former head of Alexa. His status as scientific boss of AI at Amazon allows him to surround himself with researchers who worked with him on Alexa’s artificial intelligence, and those already working on Amazon’s training models.
Amazon is increasing its initiatives in terms of artificial intelligence, as evidenced by its foray into the Californian gem Anthropic, on which Google has also set its sights. Faced with competition from other Tech giants, obviously not forgetting Microsoft, behind OpenAI, Amazon wants to stand out and become the owner of a landmark AI solution, and which will become a reference.
Source : The Information
5