Generative Adversarial Networks: An Overview
Generative Adversarial Networks (GANs) usually consists of a pair of deep neural networks - the Generator network and the Discriminator network. The Generator learns to simulate samples from the complex high dimensional distribution of the real-world data. Simultaneously, the Discriminator learns to distinguish the real samples from the simulated samples generated by the Generator. Thus, training GANs is a two-player game in which the Generator’s goal is to fool the Discriminator, by minimizing the difference between data distribution of the real-world data and the simulated data. During training, the Generator does not have any direct access to the real data, but the Discriminator has access to both real and simulated data. The training error from the Discriminator is passed to the Generator, which helps it to learn to generate fake or simulated data of better quality. The Generator wins when the Discriminator performs no better than random guess in distinguishing real from fake data. Error back propagation through these competing networks allows GANs to learn deep representations from limited amount of labeled training data. GANs are becoming an emerging technique for both unsupervised and semi-supervised learning tasks with many applications in computer vision, such as image synthesis, semantic image editing, style transfer, image super resolution, image classification, object detection and object recognition. In this presentation, I will provide a brief overview of different types (architectures) of GANs and their common applications in computer vision. These include fully connected GANs, Convolutional GANs, Conditional GANs, Bidirectional GANs, Adversarial Autoencoders, Global and Local Perception GANs, etc.
Reference
Antonia Creswell, Tom White, Vincent Dumoulin, Kai Arulkumaran, Biswa Sengupta, and Anil A. Bharath. Generative adversarial networks: An overview. In the Proceedings of IEEE Signal Processing Magazine Special Issue on Deep Learning for Visual Understanding, accepted paper, 2017.
Goodfellow, Ian J., Pouget-Abadie, Jean, Mirza, Mehdi, Xu, Bing, Warde-Farley, David, Ozair, Sherjil, Courville, Aaron C., and Bengio, Yoshua. Generative adversarial nets. NIPS, 2014.