Publications

Preprint

LLM-based Hierarchical Concept Decomposition for Interpretable Fine-Grained Image Classification

Renyi Qu, Mark Yatskar

arXiv preprint (2024)

paper bib

A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis

Yue Yang, Mona Gandhi, Yufei Wang, Yifan Wu, Michael Yao, Christopher Callison-Burch, James Gee, Mark Yatskar

arXiv preprint (2024)

paper code bib

DOLOMITES: Domain-Specific Long-Form Methodical Tasks

Chaitanya Malaviya, Priyanka Agrawal, Kuzman Ganchev, Pranesh Srinivasan, Fantine Huot, Jonathan Berant, Mark Yatskar, Dipanjan Das, Mirella Lapata, Chris Alberti

arXiv preprint (2024)

paper bib

Interpretable-by-Design Text Understanding with Iteratively Generated Concept Bottleneck

Josh Ludan, Qing Lyu, Yue Yang, Liam Dugan, Mark Yatskar, Chris Callison-Burch

arXiv preprint (2023)

paper bib

Dynamic Clue Bottlenecks: Towards Interpretable-by-Design Visual Question Answering

Xingyu Fu, Ben Zhou, Sihao Chen, Mark Yatskar, Dan Roth

arXiv preprint (2023)

paper bib


2024

CoMo: Controllable Motion Generation through Language Guided Pose Code Editing

Yiming Huang, Weilin Wan, Yue Yang, Chris Callison-Burch, Mark Yatskar, Lingjie Liu

ECCV (2024)

paper bib

Holodeck: Language Guided Generation of 3D Embodied AI Environments

Yue Yang, Fan-Yun Sun, Luca Weihs, Eli VanderBilt, Alvaro Herrasti, Winson Han, Jiajun Wu, Nick Haber, Ranjay Krishna, Lingjie Liu, Chris Callison-Burch, Mark Yatskar, Aniruddha Kembhavi, Christopher Clark

CVPR (2024)

paper bib

What if you said that differently?: How Explanation Formats Affect Human Feedback Efficacy and User Perception

Chaitanya Malaviya, Subin Lee, Dan Roth, Mark Yatskar

NAACL (2024)

paper bib

ExpertQA: Expert-Curated Questions and Attributed Answers

Chaitanya Malaviya, Subin Lee, Sihao Chen, Elizabeth Sieber, Mark Yatskar, Dan Roth

NAACL (2024)

paper bib


2023

AmbiCoref: Evaluating Human and Model Sensitivity to Ambiguous Coreference

Yuewei Yuan, Chaitanya Malaviya, Mark Yatskar

Findings of EACL (2023)

paper bib

Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification

Yue Yang, Artemis Panagopoulou, Shenghao Zhou, Daniel Jin, Chris Callison-Burch, Mark Yatskar

CVPR (2023)

paper bib


2022

Cascading Biases: Investigating the Effect of Heuristic Annotation Strategies on Data and Models

Chaitanya Malaviya, Sudeep Bhatia, Mark Yatskar

EMNLP (2022)

paper bib

Visualizing the Obvious: A Concreteness-based Ensemble Model for Noun Property Prediction

Yue Yang, Artemis Panagopoulou, Marianna Apidianaki, Mark Yatskar, Chris Callison-Burch

EMNLP (2022)

paper bib

Induce, Edit, Retrieve: Language Grounded Multimodal Schema for Instructional Video Retrieval

Yue Yang, Joongwon Kim, Artemis Panagopoulou, Mark Yatskar, Chris Callison-Burch

O-DRUM @ CVPR (2022)

paper bib


2021

Visual Goal-Step Inference using wikiHow

Yue Yang, Artemis Panagopoulou, Qing Lyu, Li Zhang, Mark Yatskar, Chris Callison-Burch

EMNLP (2021)

paper bib

Iconary: A Pictionary-Based Game for Testing Multimodal Communication with Drawings and Text

Christopher Clark, Jordi Salvador, Dustin Schwenk, Derrick Bonafilia, Mark Yatskar, Eric Kolve, Alvaro Herrasti, Jonghyun Choi, Sachin Mehta, Sam Skjonsberg, Carissa Schoenick, Aaron Sarnat, Hannaneh Hajishirzi, Aniruddha Kembhavi, Oren Etzioni, Ali Farhadi

EMNLP (2021)

paper bib