GPT-4o, OpenAI’s newest AI model that makes ChatGPT smarter and free for all

Sub: Science and tech

Sec: Awareness in IT and computer

Tag: OpenAI, ChatGPT

Context:

OpenAI introduced its latest large language model (LLM) called GPT-4o on Monday (May 13), billing it as their fastest and most powerful AI model so far.

What is OpenAI?

OpenAI is an American artificial intelligence (AI) research organization founded in December 2015, researching artificial intelligence with the goal of developing safe and beneficial artificial general intelligence, which it defines as highly autonomous systems that outperform humans at most economically valuable work.
Its release of ChatGPT has been credited with starting the AI boom.

What is GPT 4O and what are its features?

GPT-4o is being seen as a revolutionary AI model, which has been developed to enhance human-computer interactions.
It lets users input any combination of text, audio, and image and receive responses in the same formats.
This makes GPT-4o a multimodal AI model – a significant leap from previous models.
GPT-4o seems like ChatGPT transformed into a digital personal assistant that can assist users with a variety of tasks
It can respond to audio inputs in as little as 232 milliseconds, with an average of 320 milliseconds, which is similar to human response time(opens in a new window) in a conversation.
It matches GPT-4 Turbo performance on text in English and code, with significant improvement on text in non-English languages, while also being much faster and 50% cheaper in the API.
GPT-4o is especially better at vision and audio understanding compared to existing models.
GPT-4o comes with an integration that allows it to process and understand inputs more holistically.
GPT-4o can understand tone, background noises, and emotional context in audio inputs at once. These abilities were a big challenge for earlier models.

What is the technology behind GPT-4o?

LLMs are the backbone of AI chatbots.
Large amounts of data are fed into these models to make them capable of learning things themselves.

A large language model (LLM) is a computational model notable for its ability to achieve general-purpose language generation and other natural language processing tasks such as classification.
Based on language models, LLMs acquire these abilities by learning statistical relationships from text documents during a computationally intensive self-supervised and semi-supervised training process.
LLMs are artificial neural networks.
The largest and most capable, as of March 2024, are built with a decoder-only transformer-based architecture.

Importance of GPT 4o:

GPT-4o could be beneficial for Microsoft, which has invested billions into OpenAI, as it can now embed the model in its existing services.
Similar to GPT-4o, Google’s Gemini is also expected to be multimodal.
Thus, GPT-4o will be made available to the public in stages.

What are GPT-4o’s limitations and safety concerns?

GPT-4o is still in the early stages of exploring the potential of unified multimodal interaction, meaning certain features like audio outputs are initially accessible in a limited form only, with preset voices.

Terms in news:

Gemini:

Gemini is a family of multimodal large language models developed by Google DeepMind, serving as the successor to LaMDA and PaLM 2.
Comprising Gemini Ultra, Gemini Pro, and Gemini Nano, it was announced on December 6, 2023, positioned as a competitor to OpenAI’s GPT-4.