Nvidia uses AI to clean up messy photos | Tech Industry
Researchers from Nvidia, MIT, and Aalto University are using artificial intelligence to reduce noise from photos. The team used 50,000 images from the ImageNet dataset to train its AI system for reconstructing photos, and is able to remove noise from an image even though it has never seen an image without noise.
Named Noise2Noise, the AI system was created using deep learning, drawing its intelligence from 50,000 images from the ImageNet database. Each of the images came as clean, high-quality images without noise but were manipulated to add randomized noise. Computer-generated images and MRI scans were also used to train Noise2Noise.
Denoising or noise reduction methods have been around for a long time now, but methods that utilize deep learning are a more recent phenomenon.
Noise can appear as grainy snow in a photo taken in low light, or be found in other forms of photos like medical imagery, computer-generated images, and pictures of space. Digital camera images taken in low light or using a digital zoom often contain noise.
By training Noise2Noise with only noise, researchers hope the method can be used on images known to contain high amounts of noise, such as astrophotography, that picture you took at dusk that got robbed of its definition, and MRI or brain scans.
Near 5,000 images from 50 human subjects in the IXI dataset were used to train Noise2Noise’s MRI intelligence, which can appear slightly more blurry than the original image without artificial noise but still appears to restore definition.
“This is a proof of concept that we trained on a public MRI database, but it might show promise some time in the future that this can be practically applied,” Nvidia researcher Jacob Munkberg told VentureBeat in a phone interview.
The work will be presented this week at the International Conference on Machine Learning, being held this week in Stockholm, Sweden.