Yutong (Kelly) He 何雨桐

Contact: yutonghe [at] cs [dot] cmu [dot] edu

kelly.jpeg

PhD Student @ MLD, SCS, CMU

yutonghe [at] cs [dot] cmu [dot] edu

I am a first-year PhD student in the Machine Learning Department, School of Computer Science at Carnegie Mellon University, advised by Prof. Zico Kolter and Prof. Ruslan Salakhutdinov.

Before coming to CMU, I was a master’s student at Stanford Computer Science with distinction in research. I was advised by Prof. Stefano Ermon, and closely worked with Prof. Christopher Manning, Prof. David Lobell and Prof. Marshall Burke. I completed my B.S in Mathematics and B.S. in Data Science with highest distinction at University of Rochester, where I worked with Prof. Henry Kautz and Prof. Jiebo Luo.

I was selected as a Siebel Scholar and a Xerox Engineering Research Fellow. I was also awarded an Outstanding Paper Award at ICLR 2022 and Doris Ermine Smith Award for Achievement in Mathematics.

My research interests include generative models, representation learning, computational sustainability and broad deep learning topics in general.

News

Sep 14, 2022 Our paper SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery is accepted by NeurIPS 2022.
Aug 23, 2022 Our paper Understanding Economic Development in Rural Africa using Satellite Imagery, Building footprints and Deep Models is accepted by ACM SIGSPATIAL 2022.
Aug 15, 2022 I start my PhD in the Machine Learning Department, School of Computer Science at Carnegie Mellon University.
Jul 8, 2022 Our paper Neural Generation Meets Real People: Building a Social, Informative Open-Domain Dialogue Agent is accepted by SIGDial 2022.
Apr 15, 2022 Our paper Comparing Distributions by Measuring Differences that Affect Decision Making is awarded as an Outstanding Paper at ICLR 2022 (Top 7/4492).
Mar 31, 2022 I graduate from Stanford University with a Master of Science in Computer Science with distinction in reasearch.
Jan 20, 2022 Two of our papers Comparing Distributions by Measuring Differences that Affect Decision Making (oral presentation, top 1.6%) and SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations are accepted by ICLR 2022.
Jan 3, 2022 I am TAing CS 228 in Winter 2022. If you are in the class, please feel free to come to my office hours!
Oct 25, 2021 Our paper Tracking Urbanization in Developing Regions with Remote Sensing Spatial-Temporal Super-Resolution is accepted by NeurIPS 2021 ML4D workshop.
Sep 28, 2021 Our paper Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional Pixel Synthesis is accepted by NeurIPS 2021.
Sep 1, 2021 I am TAing CS 236 in Fall 2021. If you are in the class, please feel free to come to my office hours!
Aug 12, 2021 Our team Chirpy Cardinal stands 2nd place in Alexa Prize 2021.
Jun 23, 2021 I am an AI4ALL computer vision mentor in summer 2021 at Stanford.
Jan 11, 2021 I am TAing CS 228 in Winter 2021. If you are in the class, please feel free to come to my office hours!
Sep 23, 2020 I am awarded as a Siebel Scholar for Class of 2021.
Jun 22, 2020 I start my internship as a machine learning engineer at Adobe Inc. . I am featured in one of the Adobe Intern Insider videos, check it out here.
Apr 13, 2020 Our project Motion-Based Handwriting Recognition and Word Reconstruction is awarded as a Outstanding Project in Stanford CS 230 Winter 2020.
Mar 28, 2020 Our project Generative Pre-Training Language Models with Auxiliary Conditional Summaries is awarded as a Best Custom Project Report in Stanford CS 224N Winter 2020.
Feb 26, 2020 Our paper Fine-grained Image-to-Image Transformation towards Visual Recognition is accepted by CVPR 2020.
Dec 17, 2019 Our project Motion-Based Handwriting Recognition is awarded as a Best Poster Award Project in Stanford CS 229 Autumn 2019.
Sep 23, 2019 I start my Master of Science program in computer science at Stanford University.
May 19, 2019 I graduate from University of Rochester as a magna cum laude with double Bachelor of Science degrees in Data Science and Mathematics.

Publications

  1. NeurIPS
    SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery
    Yezhen Cong*, Samar Khanna*, Chenlin Meng, Patrick Liu, Erik Rozi, Yutong He, Marshall Burke, David B. Lobell, and Stefano Ermon
    In Neural Information Processing Systems (NeurIPS) 2022
  2. SIGSPATIAL
    Understanding Economic Development in Rural Africa using Satellite Imagery, Building footprints and Deep Models
    Amna Elmustafa, Erik Rozi, Yutong He, Gengchen Mai, Stefano Ermon, Marshall Burke, and David Lobell
    In International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL) 2022
  3. SIGDial
    Neural Generation Meets Real People: Building a Social, Informative Open-Domain Dialogue Agent
    Ethan A. Chi, Caleb Chiam, Trenton Chang, Swee Kiat Lim, Chetanya Rastogi, Alexander Iyabor, Yutong He, Hari Sowrirajan, Avanika Narayan, Jillian Tang, Haojun Li, Ashwin Paranjape, and Christopher D. Manning
    In The 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDial) 2022
  4. ICLR Oral Award
    Comparing Distributions by Measuring Differences that Affect Decision Making
    Shengjia Zhao*, Abhishek Sinha*, Yutong He*, Aidan Perreault, Jiaming Song, and Stefano Ermon
    In International Conference on Learning Representations (ICLR) 2022
    Outstanding Paper Award [Top 0.15%]
    Oral Presentation [Top 1.6%]
  5. ICLR
    SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations
    Chenlin Meng, Yutong He, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, and Stefano Ermon
    In International Conference on Learning Representations (ICLR) 2022
  6. NeurIPS
    Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional Pixel Synthesis
    Yutong He, Dingjie Wang, Nicholas Lai, William Zhang, Chenlin Meng, Marshall Burke, David B. Lobell, and Stefano Ermon
    In Neural Information Processing Systems (NeurIPS) 2021
  7. NeurIPS Workshop
    Tracking Urbanization in Developing Regions with Remote Sensing Spatial-Temporal Super-Resolution
    Yutong He*, William Zhang*, Chenlin Meng, Marshall Burke, David B. Lobell, and Stefano Ermon
    In Neural Information Processing Systems (NeurIPS) workshop on Machine Learning for the Developing World (ML4D) 2021
  8. Alexa Prize
    Neural Neural Everywhere: Controlled Generation Meets Scaffolded and Structured Dialogue
    Ethan A. Chi, Caleb Chiam, Trenton Chang, Swee Kiat Lim, Chetanya Rastogi, Alexander Iya-bor, Yutong He, Hari Sowrirajan, Avanika Narayan, Jillian Tang, Haojun Li, Ashwin Paranjape, and Christopher D. Manning
    In Alexa Prize Proceedings 2021
  9. CVPR
    Fine-grained Image-to-Image Transformation towards Visual Recognition
    Wei Xiong, Yutong He, Yixuan Zhang, Wenhan Luo, Lin Ma, and  Jiebo Luo
    In International Conference on Computer Vision and Pattern Recognition (CVPR) 2020
  10. arXiv
    Motion-Based Handwriting Recognition and Word Reconstruction
    Junshen Kevin Chen*, Wanze Xie*, and Yutong He*
    arXiv preprint 2020