I’m a 5th year Ph.D. student in Computer Science at the University of Washington, Seattle, advised by Prof. Ranjay Krishna and Prof. Alex Ratner. Before that, I was an undergraduate student in Computer Science at the University of Illinois Urbana-Champaign, where I was fortunate to be advised by Prof. Jiawei Han.

Research Interests: My current research interests are in data-centric AI with applications across multimodal models, computer vision, natural language processing, science, and more. Currently, I’m working on three interconnected directions under data-centric AI:

• Dynamic Evaluation: Designing systems and algorithms for continuous and dynamic model evaluation beyond static benchmarks.
• Data Synthesis and Collection: Investigating best practices for synthesizing and collecting data for various applications, including the creation and enhancement of foundation models.
• Data Utilization and Representation: Developing methods and models that represent and utilize data efficiently and effectively.

My research is supported by the following fellowships:

• 2024 Apple AI/ML PhD fellowship (Data-centric AI track)
• OpenAI Superalignment Fellowship

I was selected as

• the 2025 ML and Systems Rising Stars

I’m passionate about mentoring and teaching. I was

• co-instructor of CSE 455: Computer Vision (undergrad)
• TA of CS 344: Introduction to Data Management (undergrad)
• TA of CS 599C: Training Data Management & Weak Supervision (grad)
• mentor of CSE 492 R: CSE Group Research (undergrad).
• mentor of UW CSE Pre-Application Mentorship Service (PAMS) program

I’m happy to mentor a few students on research and especially encourage students from underrepresented groups to reach out. If you are a junior student and want to discuss research and/or look for advice, feel free to schedule a chat via this link.

📝 Selected Research

(* denotes equal contribution)

Dynamic Evaluation

• Discovering Knowledge Deficiencies of Language Models on Massive Knowledge Base
  Linxin Song, Xuwei Ding, Jieyu Zhang, Taiwei Shi, Ryotaro Shimizu, Rahul Gupta, Yang Liu, Jian Kang, Jieyu Zhao.
• Task Me Anything
  Jieyu Zhang, Weikai Huang*, Zixian Ma*, Oscar Michel, Dong He, Tanmay Gupta, Wei-Chiu Ma, Ali Farhadi, Aniruddha Kembhavi, Ranjay Krishna.
  NeurIPS 2024 | Video-Language Models @ NeurIPS 2024 Oral Presentation
  Blog at Snorkel AI | Talk at Snorkel AI

Data Synthesis

• ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Models
  Jieyu Zhang, Le Xue, Linxin Song, Jun Wang, Weikai Huang, Manli Shu, An Yan, Zixian Ma, Juan Carlos Niebles, Silvio Savarese, Caiming Xiong, Zeyuan Chen, Ranjay Krishna, Ran Xu.
  Blog at Salesforce Research | VentureBeat | MarkTechPost
• Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias
  Yue Yu*, Yuchen Zhuang*, Jieyu Zhang*, Yu Meng, Alexander Ratner, Ranjay Krishna, Jiaming Shen, Chao Zhang.
  NeurIPS 2023

Data Collection

• SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionality
  Cheng-Yu Hsieh*, Jieyu Zhang*, Zixian Ma, Aniruddha Kembhavi, Ranjay Krishna
  NeurIPS 2023
• DataComp: In Search of the Next Generation of Multimodal Datasets
  DataComp Team.
  NeurIPS 2023 Oral Presentation
• On the Trade-off of Intra-/Inter-class Diversity for Supervised Pre-training
  Jieyu Zhang*, Bohan Wang*, Zhengyu Hu, Pang Wei Koh, Alexander Ratner.
  NeurIPS 2023

Data Labeling

• Language Model Preference Evaluation with Multiple Weak Evaluators
  Zhengyu Hu=, Jieyu Zhang, Zhihan Xiong, Alexander Ratner, Hui Xiong, Ranjay Krishna.
  DATA-FM@ICLR 2025
• Leveraging Instance Features for Label Aggregation in Programmatic Weak Supervision
  Jieyu Zhang*, Linxin Song*, Alexander Ratner.
  AISTATS 2023
• Understanding Programmatic Weak Supervision via Source-aware Influence Function
  Jieyu Zhang*, Haonan Wang*, Cheng-Yu Hsieh, Alexander Ratner.
  NeurIPS 2022
• Creating Training Sets via Weak Indirect Supervision
  Jieyu Zhang, Bohan Wang, Xiangchen Song, Yujing Wang, Yaming Yang, Jing Bai, Alexander Ratner.
  ICLR 2022
• WRENCH: A Comprehensive Benchmark for Weak Supervision
  Jieyu Zhang, Yue Yu, Yinghao Li, Yujing Wang, Yaming Yang, Mao Yang, Alexander Ratner.
  NeurIPS 2021 Oral Presentation

Agentic AI

• Offline Training of Language Model Agents with Functions as Learnable Weights
  Shaokun Zhang*, Jieyu Zhang*, Jiale Liu, Linxin Song, Chi Wang, Ranjay Krishna, Qingyun Wu.
  ICML 2024
• EcoAssistant: Using LLM Assistant More Affordably and Accurately
  Jieyu Zhang, Ranjay Krishna, Ahmed Awadallah, Chi Wang.
  LLM Agents @ ICLR 2024
• AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation Framework
  Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Jiale Liu, Ahmed Awadallah, Ryen White, Doug Burger, Chi Wang
  COLM 2024 | LLM Agents @ ICLR 2024 🏆 Best Paper
  The Economist article | The Forbes article

Before Ph.D.

• Taxonomy Completion via Triplet Matching Network
  Jieyu Zhang, Xiangchen Song, Ying Zeng, Jiaze Chen, Jiaming Shen, Yuning Mao, Lei Li.
  AAAI 2021
• Co-Embedding Network Nodes and Hierarchical Labels with Taxonomy Based Generative Adversarial Networks
  Carl Yang, Jieyu Zhang, Jiawei Han.
  ICDM 2020 🏆 Best Paper

🏅 Awards

• ML and Systems Rising Stars
• OpenAI Superalignment Fellowship
• Apple Scholar in AI/ML PhD Fellowship
• LLM Agents @ ICLR 2024 Best Paper Award
• ICDM’20 Best Paper Award
• CRA Outstanding Undergraduate Researcher Honorable Mention
• UIUC James Scholar Preble Research Award
• UIUC John R. Pasta Outstanding Undergraduate Award

📍 Professional Services

• Leading organizer of Synthetic Data for Computer Vision Workshop @ CVPR 2024/2025. [website]
• PC/AC: ARR, COLM
• Reviewer: NeurIPS, ICML, ICLR, AAAI, IJCAI, CVPR, ACL, EMNLP, ARR, AISTATS, KDD, LOG.

🎓 Education

• University of Washington - Ph.D. in Computer Science 2020 - 2026 (expected).
• University of Illinois Urbana-Champaign - B.S. in Statistics and Computer Science.

👨‍💻 Industrial Experience

• Salesforce Research - Research Intern
  2024.06-2024.9
• Microsoft Research (Redmond) - Research Intern
  2023.06-2023.9
• Microsoft Research (Asia) - Star Bridge Research Assistant
  2020.09-2021.12
• ByteDance AI Lab - Research Intern
  2020.04-2020.09

📫 Contact

Email: jieyuz2@cs.washington.edu