Yunong Liu
MSCS Student at Stanford University
I am a Master's student in Computer Science at Stanford University, advised by Jiajun Wu.
I am working closely with Juan Carlos Niebles, Manling Li, Weiyu Liu and Cristobal Eyzaguirre on projects including grounding 4D assembly instructions in internet videos and tracking emergence in video generation models.
I received my BEng in Electronics and Computer Science from the University of Edinburgh (joint degree with Honors). During my time there, I was fortunate to work with Bonnie Webber and Xixian Liao on natural language processing research. Professor Webber is a role model for me, inspiring me with her unwavering passion and dedication to the field.
I also spent a wonderful semester and summer at the University of Texas at Austin for my exchange program and summer research internship, where I worked with Dhiraj Murthy on misinformation detection.
🎭 Fun fact: I have a twin sister who works in a completely different field - museology! It's fascinating how we've taken such divergent paths in our careers.
Research Interests
- Generative Models: Emergence and control in video generation models, temporal consistency in video generation
- Visual Prompting: Investigating emergent behaviors and controllability in generative models through visual prompting
- 4D Grounding: 4D grounding and spatial-temporal alignment between 3D models and real-world videos
- Self-Supervised Learning: Self-supervised representation learning for video understanding
Publications
IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet Videos
Yunong Liu, Cristobal Eyzaguirre, Manling Li, Shubh Khanna, Juan Carlos Niebles, Vineeth Ravi, Saumitra Mishra, Weiyu Liu*, Jiajun Wu*.
Created first dataset aligning real-world assembly videos with 3D models and instruction manuals. Developed methods for dense spatio-temporal correspondences in unconstrained videos.
COVID-19 Misinformation Detection: Machine-Learned Solutions to the Infodemic
Yunong Liu*, Nikhil Kolluri*, Dhiraj Murthy.
(*equal contribution)Developed hybrid framework combining machine learning with crowdsourced annotations to combat COVID-19 misinformation. Developed systematic comparison framework across classical models (SVM, LR, BNB) and pre-trained models (BERT, RoBERTa, XLNet) on 7 dataset combinations.
Selected Projects
Tracking Emergence in Video Generation Models
Discovered video diffusion models' emergent ability to track objects without explicit training. Developed novel intervention-based framework revealing models' implicit understanding of physical dynamics.
EMo-Mask: Emotional Controllable Motion Generation
Course Project on CS348I Computer Graphics in the Era of AI (2024 Winter) | Project Page
Just Dance Everywhere (Best Course Project Award)
EE379K Introduction to Computer Vision Course (2022 Spring) at UT Austin | Project Page
Gates Building 3rd Floor Render (A+ Grade & Course Showcase Feature)
CS 148: Introduction to Computer Graphics and Imaging (Autumn 2024)|Project Page | | Course Showcase
Reinforcement Learning in Marrakech Game
Course Project on AA 228/CS 238: Decision Making under Uncertainty (2024 Autumn)
Awards
- UT Austin Cockrell School of Engineering Fellowship (Declined), Apr 2023
- Turing Scheme Funding, January 2022
- Leadership in Student Opportunities Edinburgh Award, July 2021
- 1st Year Class Medal, awarded to the top overall student in 1st year Electronics and Electrical Engineering Discipline at University of Edinburgh, July 2020
Other Experience
Student Tech Intern, Semiconductor Manufacturing Anomaly Detection, NXP Semiconductors, Tianjin, China, May 2021 - Aug 2021
Deep Learning Intern, Wind Farm Performance AI Optimization, Zealen AI (Startup), Beijing, China, Aug 2021 - Sep 2021
Research Assistant - NLP Project, University of Edinburgh, Worked with Prof Bonnie Webber on discourse relation analysis, July 2022 - Jan 2023
Teaching Demonstrator, University of Edinburgh, InfBase, Sep 2022 - Jan 2023
Programme Representative, University of Edinburgh, Sep 2022 - June 2023
Global Buddies Program Mentor, University of Edinburgh, Sep 2021 - June 2022
Volunteer, Sri Lanka Wildlife Conservation Society (SLWCS), Jul 2019 - Aug 2019
