Raphael Gontijo Lopes
Research Scientist at Google Brain

Past leadership and background:
  • B.S. in Computer Science at Georgia Institute of Technology.
    GPA: 3.96 (3.93 CS) - Highest Honors
  • President, Internal Operations Officer of The Agency (see talks).
  • Team lead for buzzmobile, The Agency's autonomous vehicle.
  • Undergraduate Research in Machine Learning
    (vision, generative models, sequence models, adversarial methods)
  • Vice President of the Undergraduate Council at College of Computing.
  • Operations organizer at HackGT.


For a more up-to-date list, see Google Scholar.

* indicates first-author papers.

A Learned Representation for Scalable Vector Graphics *
Accepted to ICCV 2019 (to appear)
Presented at ICLR 2019 Deep-Gen-Struct workshop
Available on arxiv
Patch Gaussian: Improving Robustness w/o Sacrificing Accuracy *
Under review at ICLR 2020
Presented at ICML 2019 UDL workshop
Available on arxiv
A Fourier Perspective on Model Robustness in Computer Vision
Accepted to NeurIPS 2019 (to appear)
Presented at ICML 2019 UDL workshop
Available on arxiv
End-to-end audio visual scene-aware dialog using multimodal attention-based video features
Accepted at ICASSP 2019
Available on arxiv
Audio visual scene-aware dialog (avsd) challenge at dstc7
Challenge at NeurIPS 2019
Available on arxiv
Data-free Knowledge Distillation for Deep Neural Networks *
Presented at NIPS LLD Workshop!
Pre-print on arxiv. Source code and poster available.
Buzzmobile - A Reactive Control Autonomous Vehicle
Presented Buzzmobile as a poster at the Robotics Expo in the Microsoft MLADS 2017 Conference.
Towards End-to-End Pose Estimation and Transfer
Undergraduate research oral presentation at the GT UROP Undergraduate Research Spring 2017 Symposium.
Leveraging Linguistic Structure For Unsupervised Acoustic Modeling
Research poster presented at ML@GT Spring 2017 Symposium.



Google Brain Research Scientist - Dec 2020, Present
Led research projects in Machine Learning, Computer Vision, Robustness, and Generative Models. Authored numerous papers, submitted/accepted to major ML conferences, across various collaborations.
Google AI Residency - June 2018, Dec 2020
My residency at Google Brain in Mountain View and San Francisco, CA.
GT Eye Team Lab - Fall 2017, Spring 2018
Undergraduate Research under Dr. Essa, working on developing novel deep learning methods for motion assessment of olympic sports videos, as well as medical diagnosis predictions.
Microsoft Software Engineer Internship - Summer 2017
My internship at the Azure Service Fabric, team in Redmond, WA.
Implementing distributed Machine Learning systems using the Service Fabric architecture, and creating developer tools to simplify this task.
GT Ubicomp Lab - Fall 2016, Spring 2017
Undergraduate Research under Dr. Starner, working on developing novel machine learning architectures for fine-grained image classification, pose estimation and transfer, and image sequence generation.
Google Software Engineer SWE Internship - Summer 2016
My internship at the Google Adwords Reporting team in Mountain View, CA. I developed a piece of the next Adwords Reporting dashboard, using dart, angular, and java.
Google Software Engineer EP Internship - Summer 2015
My internship at the Google Analytics Engineering Productivity team in Mountain View, CA. I automated the bookkeeping, and visualization of test coverage information of Google Analytics’ jobs.
ADAM Lab - Fall 2015
Undergraduate Research assitmanship. I did web/backend development for the Drawing Apprentice team.



Team Lead for an autonomous replica of the ramblin' wreck, used as a parade float in Georgia Tech's Homecoming parade. Developed entirely in ROSpy at The Agency.
A (more) pythonic framework for writing ros tests using pytest.
I've contributed to the open source machine learning framework on github.
InTube - TreeHacks 2017
Use Vision and ML to search Youtube videos by the visual pictures and verbal content *within* them. Used google cloud vision API for tagging frames of youtube videos.
Same, Tbh
Vim-like macros for bash. Record, replace keywords, and play bash commands right from the command line.
Monte Carlo Tetris Bot
A tetris-battle bot that uses Monte Carlo Tree Search to make decisions. Made at The Agency at Georgia Tech (the AI Club) for theaigames.com.
140 M.D. - MHacks Refactor 2016
A byte-sized medical checkup on your sleep schedule, based on your twitter profile. We figure out when you go to bed and wake up, and how that is affecting your mood.
Highlight - MHacks VI
An iOS app that enables you to search real life documents by simply taking a picture of them. If the picture is of a page of a book, we also tell you other places within that book where your query matches!
A python framework for Neural Networks on-the-go. Makes it fast and easy to create a simple NN.
Pretty Graphs
A python library that uses simulated annealing and gradient descent to find the most visually appealing configuration of a given graph.
Inpho - HackATL
The best way to find location-based information. Just open the web app and you'll see the information (menu, specials, interactive features) for the business you're currently at. Winner of "Best Open Source Hack".
ConnWars - Ludum Dare 30
A strategy web game designed and built in under 72h as a part of the ludum dare Game Jam. Ranked #42 out of 1000 entries for "theme" and top 25% for "innovation". Playable online. Multiplayer in Beta.
ASL Leap - Hack Duke
A Versal gadget that teaches the American Sign Language with a Leap Motion. Given a letter from the ASL, it verifies for correct finger position. Winner of "Best Use of Leap Motion", and "Best Versal Gadget".
Presidential nGrams
A python script that uses markov chains and nGrams to generate texts (for example, presidential speeches), based on source examples.
Text Simplifier - MHacks V
A chrome extension that attempts to simplify text from the current web page, using python's nltk NLP library, for children to better understand it.
They Should Have This - HackGT
A wep app developed during HackGT 2014 for users to share ideas and find people interested in developing them.
2048 For Linux
Port of the famous web and iOS game to the Linux terminal using C and ncurses (library). Available as a ppa.
Social network for Brazilian teachers to share videos of their lectures and receive/provide feedback to each other.
Buzz Bot
Scripts and various API implementations for the creation of Hubot responses to commands such as "buzz image me < query >" and "buzz /r/dataisbeautiful".
Prototype of a fully-featured social network in which users shared opinions on certain topics (like/dislike/why).
My personal website, designed and scripted from scratch.