OpenAI Unveils Tech That Can 'Think' With Images

IN SEPTEMBER, OPENAI introduced AI technology that could "reason" through tasks involving math, coding, and science.

- CADE METZ

Now, this technology can tackle similar tasks that involve images, including sketches, posters, diagrams, and graphs.

On Thursday, the company unveiled two new versions of its reasoning technology called OpenAI 03 and OpenAI 04-mini. Each can handle tasks that involve both images and text.

These systems can "manipulate, crop, and transform images in service of the task you want to do," said Mark Chen, head of research at OpenAI, in announcing the new system during an internet livestream.

OpenAI also said these systems could generate images, search the web, and use other digital tools.

Unlike early versions of its ChatGPT chatbot, these reasoning systems spend a significant amount of time "thinking" about a question before answering, rather than providing an instant response.