NVIDIA 3D MoMa, a new AI based photogrammetry technique could empower architects, designers, concept artists and game developers to quickly import an object into a graphics engine.
NVIDIA Research showcased this technology in a video celebrating jazz and its birthplace, New Orleans. The paper behind 3D MoMa has been presented just this week at the Conference on Computer Vision and Pattern Recognition of 2022.
Extracting 3D Objects From 2D Images
Inverse rendering, a technique to reconstruct a series of still photos into a 3D model of an object or scene, “has long been a holy grail unifying computer vision and computer graphics,” said David Luebke, vice president of graphics research at NVIDIA.
“By formulating every piece of the inverse rendering problem as a GPU-accelerated differentiable component, the NVIDIA 3D MoMa rendering pipeline uses the machinery of modern AI and the raw computational horsepower of NVIDIA GPUs to quickly produce 3D objects that creators can import, edit and extend without limitation in existing tools,” he said.
To be most useful for an artist or engineer, a 3D object should be in a form that can be dropped into widely used tools such as game engines, 3D modelers and film renderers. That form is a triangle mesh with textured materials, the common language used by such 3D tools.
