Publications

2024

  1. arXiv
    Automated Black-box Prompt Engineering for Personalized Text-to-Image Generation
    Yutong He, Alexander Robey, Naoki Murata, Yiding Jiang, Joshua Williams, George J Pappas, Hamed Hassani, Yuki Mitsufuji, Ruslan Salakhutdinov, and J Zico Kolter
    2024
    Paper
  2. ICLR
    Manifold Preserving Guided Diffusion
    Yutong He*, Naoki Murata*, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Dongjun Kim, Wei-Hsiang Liao, Yuki Mitsufuji, J. Zico Kolter, Ruslan Salakhutdinov, and Stefano Ermon
    In International Conference on Learning Representations (ICLR) 2024
    Paper Code Website
  3. ICLR
    Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion
    Dongjun Kim*, Chieh-Hsin Lai*, Wei-Hsiang Liao, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Yutong He, Yuki Mitsufuji, and Stefano Ermon
    In International Conference on Learning Representations (ICLR) 2024
    Paper Code Website

2023

  1. arXiv
    Towards reporting bias in visual-language datasets: bimodal augmentation by decoupling object-attribute association
    Qiyu Wu, Mengjie Zhao, Yutong He, Lang Huang, Junya Ono, Hiromi Wakaki, and Yuki Mitsufuji
    arXiv preprint 2023
    Paper
  2. arXiv
    Localized Text-to-Image Generation for Free via Cross Attention Control
    Yutong He, Ruslan Salakhutdinov, and J. Zico Kolter
    arXiv preprint 2023
    Paper Website
  3. ISPRS
    Sphere2Vec: A general-purpose location representation learning over a spherical surface for large-scale geospatial predictions
    Gengchen Mai, Yao Xuan, Wenyun Zuo, Yutong He, Jiaming Song, Stefano Ermon, Krzysztof Janowicz, and Ni Lao
    ISPRS Journal of Photogrammetry and Remote Sensing 2023
    Paper Code Website
  4. ICML
    CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representations
    Gengchen Mai, Ni Lao, Yutong He, Jiaming Song, and Stefano Ermon
    In International Conference on Machine Learning (ICML) 2023
    Paper Code Website Dataset Checkpoint

2022

  1. NeurIPS
    SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery
    Yezhen Cong*, Samar Khanna*, Chenlin Meng, Patrick Liu, Erik Rozi, Yutong He, Marshall Burke, David B. Lobell, and Stefano Ermon
    In Neural Information Processing Systems (NeurIPS) 2022
    Paper Code Website Video Dataset
  2. SIGSPATIAL
    Understanding Economic Development in Rural Africa using Satellite Imagery, Building footprints and Deep Models
    Amna Elmustafa, Erik Rozi, Yutong He, Gengchen Mai, Stefano Ermon, Marshall Burke, and David Lobell
    In International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL) 2022
    Paper
  3. SIGDial
    Neural Generation Meets Real People: Building a Social, Informative Open-Domain Dialogue Agent
    Ethan A. Chi, Caleb Chiam, Trenton Chang, Swee Kiat Lim, Chetanya Rastogi, Alexander Iyabor, Yutong He, Hari Sowrirajan, Avanika Narayan, Jillian Tang, Haojun Li, Ashwin Paranjape, and Christopher D. Manning
    In The 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDial) 2022
    Paper Code
  4. ICLR Oral Award
    Comparing Distributions by Measuring Differences that Affect Decision Making
    Shengjia Zhao*, Abhishek Sinha*, Yutong He*, Aidan Perreault, Jiaming Song, and Stefano Ermon
    In International Conference on Learning Representations (ICLR) 2022
    Outstanding Paper Award [Top 0.15%]
    Oral Presentation [Top 1.6%]
    Paper Code Video
  5. ICLR
    SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations
    Chenlin Meng, Yutong He, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, and Stefano Ermon
    In International Conference on Learning Representations (ICLR) 2022
    Paper Code Website

2021

  1. NeurIPS
    Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional Pixel Synthesis
    Yutong He, Dingjie Wang, Nicholas Lai, William Zhang, Chenlin Meng, Marshall Burke, David B. Lobell, and Stefano Ermon
    In Neural Information Processing Systems (NeurIPS) 2021
    Paper Code Website Video
  2. NeurIPS Workshop
    Tracking Urbanization in Developing Regions with Remote Sensing Spatial-Temporal Super-Resolution
    Yutong He*, William Zhang*, Chenlin Meng, Marshall Burke, David B. Lobell, and Stefano Ermon
    In Neural Information Processing Systems (NeurIPS) workshop on Machine Learning for the Developing World (ML4D) 2021
    Paper
  3. Alexa Prize
    Neural Neural Everywhere: Controlled Generation Meets Scaffolded and Structured Dialogue
    Ethan A. Chi, Caleb Chiam, Trenton Chang, Swee Kiat Lim, Chetanya Rastogi, Alexander Iya-bor, Yutong He, Hari Sowrirajan, Avanika Narayan, Jillian Tang, Haojun Li, Ashwin Paranjape, and Christopher D. Manning
    In Alexa Prize Proceedings 2021
    Paper Code Website

2020

  1. CVPR
    Fine-grained Image-to-Image Transformation towards Visual Recognition
    Wei Xiong, Yutong He, Yixuan Zhang, Wenhan Luo, Lin Ma, and  Jiebo Luo
    In International Conference on Computer Vision and Pattern Recognition (CVPR) 2020
    Paper Website Video
  2. arXiv
    Motion-Based Handwriting Recognition and Word Reconstruction
    Junshen Kevin Chen*, Wanze Xie*, and Yutong He*
    arXiv preprint 2020
    Paper