Publications

2026

• China's AI Heist
  Jared Dunnmon, Avanika Narayan, Jon Saad-Falcon
  Foreign Affairs 2026
  article
• TRACE: Capability-Targeted Agentic Training
  Hangoo Kang, Tarun Suresh, Jon Saad-Falcon, Azalia Mirhoseini
  Preprint 2026
  paper code
• OpenJarvis: Personal AI, On Personal Devices
  Jon Saad-Falcon, Avanika Narayan, Hakki Orhun Akengin, Herumb Shandilya, Robby Manihani, Gabriel Bo, John Hennessy, Azalia Mirhoseini, Christopher Ré
  Preprint 2026
  paper code

2025

• Intelligence per Watt: Measuring Intelligence Efficiency of Local AI
  Jon Saad-Falcon, Avanika Narayan, Hakki Orhun Akengin, J. Wes Griffin, Herumb Shandilya, Adrian Gamarra Lafuente, Medhya Goel, Rebecca Joseph, Shlok Natarajan, Etash Kumar Guha, Shang Zhu, Ben Athiwaratkun, John Hennessy, Azalia Mirhoseini, Christopher Ré
  Preprint 2025
  paper code
• Weaver: Shrinking the Generation-Verification Gap with Weak Verifiers
  Jon Saad-Falcon, E. Kelly Buchanan, Mayee F. Chen, Tzu-Heng Huang, Brendan McLaughlin, Tanvir Bhathal, Shang Zhu, Ben Athiwaratkun, Frederic Sala, Scott Linderman, Azalia Mirhoseini, Christopher Ré
  NeurIPS 2025
  paper code
• LMUnit: Fine-grained Evaluation with Natural Language Unit Tests
  Jon Saad-Falcon, Rajan Vivek, William Berrios, Nandita Shankar Naik, Matija Franklin, Bertie Vidgen, Amanpreet Singh, Douwe Kiela, Shikib Mehri
  EMNLP 2025
  paper
• Archon: An Architecture Search Framework for Inference-Time Techniques
  Jon Saad-Falcon, Adrian Lafuente Gamarra, Shlok Natarajan, Nahum Maru, Hristo Todorov, Etash Guha, E. Kelly Buchanan, Mayee Chen, Neel Guha, Christopher Ré, Azalia Mirhoseini
  ICML 2025
  ICLR 2025 Scaling Self-Improving Foundation Models without Human Supervision (SSI FM) Oral Presentation
  paper code

2024

• PDFTriage: Question Answering over Long, Structured Documents
  Jon Saad-Falcon, Joe Barrow, Alexa Siu, Ani Nenkova, Seunghyun Yoon, Ryan A. Rossi, Franck Dernoncourt
  EMNLP Industry 2024
  paper code
• Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERT
  Jon Saad-Falcon, Daniel Y. Fu, Simran Arora, Neel Guha, Christopher Ré
  ICML 2024
  paper code
• ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systems
  Jon Saad-Falcon, Omar Khattab, Christopher Potts, Matei Zaharia
  NAACL 2024 Oral Presentation
  paper code

2023

• UDAPDR: Unsupervised Domain Adaptation via LLM Prompting and Distillation of Rerankers
  Jon Saad-Falcon, Omar Khattab, Keshav Santhanam, Radu Florian, Martin Franz, Salim Roukos, Avirup Sil, Md Arafat Sultan, Christopher Potts
  EMNLP 2023
  paper code
• Moving Beyond Downstream Task Accuracy for Information Retrieval Benchmarking
  Keshav Santhanam*, Jon Saad-Falcon*, Martin Franz, Omar Khattab, Avirup Sil, Radu Florian, Md Arafat Sulton, Salim Roukos, Matei Zaharia, Christopher Potts
  ACL Findings 2023
  paper code
• Embedding Recycling for Language Models
  Jon Saad-Falcon, Amanpreet Singh, Luca Soldaini, Michael D'Arcy, Arman Cohan, Doug Downey
  EACL 2023
  paper code

2022

• ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction
  Keshav Santhanam*, Omar Khattab*, Jon Saad-Falcon, Christopher Potts, Matei Zaharia
  2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics 2022
  paper code
• A Search Engine for Discovery of Scientific Challenges and Directions
  Dan Lahav, Jon Saad-Falcon, Bailey Kuehl, Sophie Johnson, Sravanthi Parasa, Noam Shomron, Duen Horng Chau, Diyi Yang, Eric Horvitz, Daniel S. Weld, Tom Hope
  AAAI Conference on Artificial Intelligence 2022 Oral Presentation
  paper code demo

2021

• Argo Scholar: Interactive Visual Exploration of Literature in Browsers
  Kevin Li, Haoyang Yang, Anish Upadhayay, Zhiyan Zhou, Jon Saad-Falcon, Duen Horng (Polo) Chau
  IEEE Visualization Conference 2021 Best Poster, Honorable Mention
  paper video
• Large-Scale Analysis of Career Transitions: The Impact of Human Capital, Job History, and Language Factors
  Austin P Wright, Caleb Ziems, Haekyu Park, Jon Saad-Falcon, Duen Horng (Polo) Chau, Diyi Yang, Maria Tomprou
  Pre-print 2021
  paper
• EnergyVis: Interactively Tracking and Exploring Energy Consumption for ML Models
  Omar Shaikh, Jon Saad-Falcon, Austin P Wright, Nilaksh Das, Scott Freitas, Omar Isaac Asensio, Duen Horng (Polo) Chau
  CHI '21 Extended Abstracts 2021
  paper code video

2020

• Examining the Ordering of Rhetorical Strategies in Persuasive Requests
  Omar Shaikh, Jiaao Chen, Jon Saad-Falcon, Duen Horng (Polo) Chau, Diyi Yang
  Findings of the Association for Computational Linguistics: Empirical Methods in Natural Language Processing 2020
  paper code video
• Mapping Researchers with PeopleMap
  Jon Saad-Falcon, Omar Shaikh, Zijie J. Wang, Austin P. Wright, Sasha Richardson, Duen Horng (Polo) Chau
  IEEE Visualization Conference 2020 Best Poster, Honorable Mention
  paper code demo