This is how OpenAI’s new AI model ‘Sora’ will create videos from text


New Delhi, Feb 16 (IANS): ChatGPT maker OpenAI has unveiled Sora, a new text-to-video model that can generate videos up to a minute long while maintaining visual quality and adherence to the user’s prompt.

New Delhi, Feb 16 (IANS) ChatGPT maker OpenAI has unveiled Sora, a new text-to-video model that can generate videos up to a minute long while maintaining visual quality and adherence to the user’s prompt.

Sora is a diffusion model, which generates a video by starting off with one that looks like static noise and gradually transforms it by removing the noise over many steps.

“Sora is capable of generating entire videos all at once or extending generated videos to make them longer,” the company said.

In addition to being able to generate a video solely from text instructions, the model is also able to take an existing still image and generate a video from it, “animating the image’s contents with accuracy and attention to small detail”.

Similar to GPT models, Sora uses a transformer architecture, unlocking superior scaling performance.

The company said it is making Sora available to “red teamers (domain experts) to assess critical areas for harms or risks”.

“We are also granting access to a number of visual artists, designers, and filmmakers to gain feedback on how to advance the model to be most helpful for creative professionals,” OpenAI said in a statement.

Sora will be able to generate complex scenes with multiple characters, specific types of motion, and accurate details of the subject and background.

“The model understands not only what the user has asked for in the prompt, but also how those things exist in the physical world,” according to OpenAI.

Sora can also create multiple shots within a single generated video that accurately persist characters and visual style.

The company, however, admitted that the current model has its own weaknesses.

“It may struggle with accurately simulating the physics of a complex scene, and may not understand specific instances of cause and effect. For example, a person might take a bite out of a cookie, but afterward, the cookie may not have a bite mark,” explained OpenAI.

The company further said that it will take important safety steps ahead of making Sora available in OpenAI’s products.

“We are working with red teamers — ?domain experts in areas like misinformation, hateful content, and bias ?— who will be adversarially testing the model. We’re also building tools to help detect misleading content such as a detection classifier that can tell when a video was generated by Sora,” the company explained.

 

  

Top Stories


Leave a Comment

Title: This is how OpenAI’s new AI model ‘Sora’ will create videos from text



You have 2000 characters left.

Disclaimer:

Please write your correct name and email address. Kindly do not post any personal, abusive, defamatory, infringing, obscene, indecent, discriminatory or unlawful or similar comments. Daijiworld.com will not be responsible for any defamatory message posted under this article.

Please note that sending false messages to insult, defame, intimidate, mislead or deceive people or to intentionally cause public disorder is punishable under law. It is obligatory on Daijiworld to provide the IP address and other details of senders of such comments, to the authority concerned upon request.

Hence, sending offensive comments using daijiworld will be purely at your own risk, and in no way will Daijiworld.com be held responsible.