APPROFONDIMENTO

GANs 5G Generative Adversarial Networks

GANs 5G Generative Adversarial Networks
 

GAN is a relatively new Machine Learning architecture for neural networks: it was first introduced in 2014 by University of Montreal (see this paper https://papers.nips.cc/paper/5423-generative-adversarial-nets.pdf).  In order to better capture the value of GANs, one has to consider the difference between Supervised and Unsupervised learning. Supervised neural machineries are trained and tested based on large quantities of “labeled” samples. For example, a supervised image classifier engine would require a set of images with correct labels (e.g. cats, dogs, birds,...). Unsupervised neural machineries learn on the job from mistakes and try avoiding errors in the future. One can view a GAN as a new architecture for an unsupervised neural network able to achieve far better performance compared to traditional ones.
Main idea of GAN is to let two neural networks competing in a zero-sum game framework. A first network takes noise as input and generates samples (generator). The second one (discriminator) receives samples from both the generator and the training data, and has to be able to distinguish between the two sources. The two networks play a game, where the generator is learning to produce more and more realistic samples, and the discriminator is learning to get better and better at distinguishing generated data from real data. These two networks are trained simultaneously, in order to drive the generated samples to be indistinguishable from real data.
GANs will allow training a discriminator as an unsupervised “density estimator”, i.e. a contrast function that gives us a low value for data and higher output for everything else: discriminator has to develop a good internal representation of the data to solve this problem properly. More details [https://ishmaelbelghazi.github.io/ALI/].
GANs were previously thought to be unstable. FAIR (Facebook AI Research) published a set of papers on stabilizing adversarial networks, starting with image generators using LAPGAN (Laplacian Adversarial Networks) and DCGAN (Deep Convolutional Generative Adversarial Networks), and continuing into the more complex endeavour of video generation using AGDL (Adversarial Gradient Difference Loss Predictors).
As claimed [https://www.linkedin.com/pulse/gans-one-hottest-topics-machine-learning-al-gharakhanian/], it seems that GANs can provide a strong algorithmic framework for building unsupervised learning models that incorporate properties such as common sense.

 

Architecture of the Generative Adversarial Networks

 

Torna all'articolo