Adam Stein

About

I'm a third year PhD student at the University of Pennsylvania advised by Professor Mayur Naik and Professor Eric Wong. Previously, I attended UCLA where I recieved my BS in CS in 2020. My research is supported by the NSF Graduate Research Fellowship Program.

I'm broadly interested in the fields of programming languages and machine learning, and I'm particularly interested in developing methods for interpreting and debugging machine learning models to improve their reliability and trustworthiness. In particular, I'm working on the following problems:

• What concepts has my model learned? Interpreting and evaluating the capabilities of deep learning models.
• How do I find and fix failures in my model? Building a language, TorchQL, for debugging deep learning models.
• What changed in my data distribution? Developing methods to find usable and robust explanations of distribution shift.

Pre-Prints

Rectifying Group Irregularities in Explanations for Distribution Shift .
Adam Stein, Yinjun Wu, Eric Wong, Mayur Naik. arXiv Pre-print. [code]

Papers

Towards Compositionality in Concept Learning .
Adam Stein, Aaditya Naik, Yinjun Wu, Mayur Naik, Eric Wong. ICML 2024. [blog] [code]

TorchQL: A Programming Framework for Integrity Constraints in Machine Learning .
Aaditya Naik, Adam Stein, Yinjun Wu, Eric Wong, Mayur Naik. Conditionally accepted to OOPSLA 2024. [code]

Relational Query Synthesis ⨝ Decision Tree Learning .
Aaditya Naik, Aalok Thakkar, Adam Stein, Mayur Naik, Rajeev Alur. VLDB 2024.

Faithful Chain-of-Thought Reasoning .
Qing Lyu*, Shreya Havaldar*, Adam Stein*, Li Zhang, Delip Rao, Eric Wong, Marianna Apidianaki, Chris Callison-Burch. AACL 2024. Area Chair Award [code]

TopEx: Topic-based Explanations for Model Comparison .
Shreya Havaldar, Adam Stein, Eric Wong, Lyle Ungar. ICLR (Tiny Papers Track) 2023.

Learning to Select Pivotal Samples for Meta Re-weighting .
Yinjun Wu, Adam Stein, Jacob Gardner, Mayur Naik. AAAI 2023. Oral Presentation. [code]

Some Problems with Properties: A Study on Property-Based Testing in Industry .
Harrison Goldstein, Joseph W. Cutler, Adam Stein, Benjamin C. Pierce, Andrew Head. HATRA @ SPLASH 2022.

Projects

Automatic Detection of Hybrid Human-Machine Text Boundaries .
Joseph W. Cutler*, Liam Dugan*, Shreya Havaldar*, Adam Stein*. CIS 520 Course Project.

Weighted Contrastive Learning for Scene Graph Generation. Joint work with Yinjun Wu and Mayur Naik. 2021 Manuscript.