Monday, August 20, 2018

Stanford A.I. can realistically score computer animations just by watching them #MusicMonday

In the future AI will probably replace foley artists. Via Digital Trends:

“We’ve developed the first system for automatically synthesizing sounds to accompany physics-based computer animations,” Jui-Hsien Wang, a graduate student at Stanford’s Institute for Computational and Mathematical Engineering (ICME), told Digital Trends. “Our approach is general, [meaning that] it can compute realistic sound sources for a wide range of animated phenomena — such as solid bodies like a ceramic bowl or a flexible crash cymbal, as well as liquid being poured into a cup.”

The technology that makes the system work is pretty darn smart. It takes into account the varying position of the objects in the scene as assembled during the 3D modeling process. It identifies what these are, and then predicts how they will affect sounds being produced, whether it be to reflect, scatte,r or diffract them.

Learn more!

See the original project here

Head over to Wang Jui-Hsien on YouTube to see more videos.

No comments:

Post a Comment