It’s here, it’s there, it’s almost everywhere. We are talking about AI and the language models that are making their presence felt across platforms. The latest one on the AI block is a model by Meta that is capable of turning doodles into animations, and then some more.
The process started in 2021
Back in 2021, Meta invited people and gave them the option to “contribute to a dataset of in-the-wild amateur drawings to its Animated Drawings Demo.” Meta says that more than 3.2 million people from around the world visited the site, including those who posted on social media about their creations. Overall, 6.7 million images were uploaded. Explaining what the process was, Meta said that “The browser-based demo allowed people to upload images, verify or fix a few annotation predictions, and receive a short animation of their humanlike character within their drawing.”
Now, the AI model is trained enough to actually convert those “amateur drawings” into animations. “We structured the task of generating an animation from a single drawing of a figure as a series of subtasks: human figure detection, segmentation, pose estimation, and animation,” Meta said in a blog post.
The company also said that the idea behind it is to give people more tools. “Researchers and practitioners can build tools to more easily and accurately analyse the contents of amateur drawings. And this can unlock new digital-physical hybrid experiences, such as new forms of storytelling and greater accessibility in art,” said Meta.
Meta said that it is sharing the animation pipeline code and this dataset in hope “that it will be of interest to other practitioners – both AI researchers and members of the broader research community.” Furthermore, the company said that, it hopes the “work will make it easier for other researchers to explore tools and techniques specifically tailored to using AI to complement human creativity.”
The process started in 2021
Back in 2021, Meta invited people and gave them the option to “contribute to a dataset of in-the-wild amateur drawings to its Animated Drawings Demo.” Meta says that more than 3.2 million people from around the world visited the site, including those who posted on social media about their creations. Overall, 6.7 million images were uploaded. Explaining what the process was, Meta said that “The browser-based demo allowed people to upload images, verify or fix a few annotation predictions, and receive a short animation of their humanlike character within their drawing.”
Now, the AI model is trained enough to actually convert those “amateur drawings” into animations. “We structured the task of generating an animation from a single drawing of a figure as a series of subtasks: human figure detection, segmentation, pose estimation, and animation,” Meta said in a blog post.
The company also said that the idea behind it is to give people more tools. “Researchers and practitioners can build tools to more easily and accurately analyse the contents of amateur drawings. And this can unlock new digital-physical hybrid experiences, such as new forms of storytelling and greater accessibility in art,” said Meta.
Meta said that it is sharing the animation pipeline code and this dataset in hope “that it will be of interest to other practitioners – both AI researchers and members of the broader research community.” Furthermore, the company said that, it hopes the “work will make it easier for other researchers to explore tools and techniques specifically tailored to using AI to complement human creativity.”
Related Posts
Denial of responsibility! TechnoCodex is an automatic aggregator of the all world’s media. In each content, the hyperlink to the primary source is specified. All trademarks belong to their rightful owners, all materials to their authors. If you are the owner of the content and do not want us to publish your materials, please contact us by email – [email protected]. The content will be deleted within 24 hours.
