Grace Hopper 2018 – Training generative adversarial networks: A challenge?

Our-text-conditional-convolutional-GAN-architecture-Text-encoding-pht-is-used-by-bothToday I had the pleasure of attending a very interesting workshop on generative adversarial networks. The goal of the workshop was to teach attendees about deep learning and Generative Adversarial Networks (GANS).  In the lab we used PyTorch, an open source deep learning framework, used to demonstrate and explore this type of neural network architecture. The lab was comprised of two major parts an introduction to both PyTorch and GANs followed by text-to-image generation.

The first part of the lab began by importing torch modules, creating a simple linear transformation model creating a loss function to understand the difference between our model and the ground truth.

Next we ran our model on a GPU! Earlier in the session we learned that GPUs work well for deep learning because they are inherently parallel.
With GPUs, trained neural networks can occur in minutes.

We then began to focus more on GANs. The facilitators of the workshop shared that GANs are getting widespread attention in the deep learning community for their image generation and style transfer capabilities.
This deep learning technique uses two neural networks in a adversarial way to complete its objective.

One network is called the generator and the other the discriminator. The discriminator network is trained with a dataset comprised of real data and output from the generator network, and its objective is to discriminate between the two. The generator network’s objective is to fool the discriminator into classifying its output as real data. While training the generator is updated to generate data that mimics the real data and fool the discriminator.

In this part of the lab attendees were tasked to :

  • Feed data into PyTorch using Numpy
  • Create a multi-layer network
  • Configure the generator and discriminator network
    • Learn how to update the generator network

The second part of the lab  we built upon the popular Deep Convolution Generative Adversarial Network (DCGAN)  to enable text to image generation. This part of the lab was based on the paper Generative Adversarial Text to Image Synthesis by Reed et, al.  Captions of images were encoded and concatenated with the input noise vector before being propagated to the generator. Then the encoded caption was concatenated again with a feature map in the discriminator network after the fourth leaky Rectified Linear Unit (ReLU) layer.The goal of the second half of the lab was to create a text to image model by using the GAN+CLS technique.

We demonstrated the capability of our model to generate plausible images of pizzas and broccoli from detailed text descriptions/captions. While this was just a case for learning purposes its clear that there are many powerful applications to this deep learning technique.


Don't Just Consume Technology.. Produce it.

Its important to not only be consumers of technology but producers as well.

“A new study released Friday sheds light on this issue. The State of Black America 2018, a report published annually by the National Urban League, compares how black and white people fare in a number of areas, including housing, economics, education, social justice, and civic engagement.

This year’s report pays particular attention to black Americans’ access to jobs in the tech industry and STEM (science, technology, engineering, and mathematics) fields. The study reveals that while black people are one of the racial groups most likely to use smartphones and have created thriving communities on platforms like Twitter, those high rates of usage haven’t translated into employment.”


30 and Under

Silicon Valley is home to some of the hottest venture capital firms worldwide. In the valley, the stakes are high. To be a successful investor, you need a keen business sense and attention to detail, a forward-thinking outlook, and a strategic eye for investment. 135 more words

via 30 AND UNDER: Rising stars in Silicon Valley tech who find hot startup deals and manage millions of dollars — Tech Insider