Swaroop Mishra

I am a Research Scientist at Google DeepMind (Ex-Google Brain), where I work on Bard and other AI products. My main research contributions are the first paper on instruction-tuning, various prompt-engineering methods e.g. reframing, question-decomposition, program representation to improve mathematical reasoning and instruction-bias. I am privileged to receive the ASU 2023 Dean's Dissertation Award and CEN CS PhD Outstanding Student Award.

The best way to reach out to me is via Twitter DM. Note that, I am not updating this webpage any more. Please see my Google Scholar and Semantic Scholar profile for latest papers.

Email  /  Google Scholar  /  Semantic Scholar  /  Linkedin  /  Twitter

profile photo
Research

My main focus area is Learning from Instructions/Prompting. I am also excited about related areas such as Quantitative Reasoning, Efficient ML & NLP, Robustness & Generalization, Selective Answering, Spurious Bias and ML & NLP Applications. My strength lies in generating new ideas and I am fortunate to collaborate with a diverse set of awesome researchers through my ideas.

Learning From Instructions/Prompting
Cross-Task Generalization via Natural Language Crowdsourcing Instructions.
Swaroop Mishra, Daniel Khashabi, Chitta Baral, Hannaneh Hajishirzi
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Reframing Instructional Prompts to GPTk's Language.
Swaroop Mishra, Daniel Khashabi, Chitta Baral, Yejin Choi, Hannaneh Hajishirzi
Annual Meeting of the Association for Computational Linguistics (ACL) Findings, 2022
HELP ME THINK: A Simple Prompting Strategy for Non-experts to Create Customized Content with Models.
Swaroop Mishra, Elnaz Nouri
Annual Meeting of the Association for Computational Linguistics (ACL) Findings, 2023
Don't Blame the Annotator: Bias Already Starts in the Annotation Instructions.
Swaroop Mishra*, Mihir Parmar*, Mor Geva, Chitta Baral
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Benchmarking Generalization via In-Context Instructions on 1,600+ Language Tasks.
Yizhong Wang*, Swaroop Mishra*, Pegah Alipoormolabashi, Yeganeh Kordi, ..., Chitta Baral, Yejin Choi, Noah A. Smith, Hannaneh Hajishirzi, Daniel Khashabi
Empirical Methods in Natural Language Processing (EMNLP), 2022
Self-Instruct: Aligning Language Model with Self Generated Instructions.
Yizhong Wang, Yeganeh Kordi, Swaroop Mishra, Alisa Liu, Noah A Smith, Daniel Khashabi, Hannaneh Hajishirzi
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering.
Pan Lu, Swaroop Mishra, Tony Xia, Liang Qiu, Kai-Wei Chang, Song-Chun Zhu, Oyvind Tafjord, Peter Clark, Ashwin Kalyan
Conference on Neural Information Processing Systems (NeurIPS), 2022
In-BoXBART: Get Instructions into Biomedical Multi-task Learning.
Mihir Parmar, Swaroop Mishra, Mirali Purohit, Man Luo, M. Hassan Murad, Chitta Baral,
North American Chapter of the Association for Computational Linguistics (NAACL), 2022
Is a Question Decomposition Unit All We Need?
Swaroop Mishra*, Pruthvi Patel*, Mihir Parmar, Chitta Baral
Empirical Methods in Natural Language Processing (EMNLP), 2022
How Many Data Samples is an Additional Instruction Worth?
Ravsehaj Singh Puri, Swaroop Mishra, Mihir Parmar, Chitta Baral
Conference of the European Chapter of the Association for Computational Linguistics (EACL) Findings, 2023
Less is More: Summary of Long Instructions is Better for Program Synthesis
Swaroop Mishra*, Kirby Kuznia*, Mihir Parmar, Chitta Baral
Empirical Methods in Natural Language Processing (EMNLP), 2022
LILA: A Unified Benchmark for Mathematical Reasoning
Swaroop Mishra*, Matthew Finlayson*, Pan Lu, Leonard Tang, Sean Welleck, Chitta Baral, Tanmay Rajpurohit, Oyvind Tafjord, Ashish Sabharwal, Peter Clark, Ashwin Kalyan
Empirical Methods in Natural Language Processing (EMNLP), 2022
Instruction Learning for Biomedical Table Question Answering
Man Luo, Sharad Saxena, Swaroop Mishra, Mihir Parmar, Chitta Baral
BioASQ Workshop 2022
InstructExcel: A Benchmark to Use Excel by Writing Instructions
Swaroop Mishra*, Justin Payan*, Carina Negreanu, Christian Poelitz, Chitta Baral, Andrew D. Gordon, Rasika Chakravarthy, Ben Van Durme, Matt Gardner, Elnaz Nouri
Preprint
Instruction-tuned Models are Quick Learners
Himanshu Gupta, Swaroop Mishra, Arindam Mitra, Saurabh Arjun Sawant, Mutsumi Nakamura, Chitta Baral
Preprint
Creating Data Automatically by Instructing GPT3
Kirby Kuznia*, Maitreya Patel*, Swaroop Mishra, Santosh Mashetty, Savan Doshi, Ravsehaj Singh Puri, Mihir Parmar, Chitta Baral
Preprint
Quantitative Reasoning
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models.
..., Swaroop Mishra, ...(442 authors),
Transactions on Machine Learning Research, 2023
NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Tasks
Swaroop Mishra, Arindam Mitra, Neeraj Varshney, Bhavdeep Sachdeva, Peter Clark, Chitta Baral, Ashwin Kalyan
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
John is 50 years old, can his son be 65? Evaluating Language Models' Understanding of Feasibility
Himanshu Gupta, Neeraj Varshney, Swaroop Mishra, Kuntal Kumar Pal, Saurabh Arjun Sawant, Kevin Joseph Scaria, Siddharth Goyal, Chitta Baral
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Investigating Generalization and Catastrophic Forgetting in Numerical Reasoning
Swaroop Mishra, Chandrahaas Chintalaboguda, Sabyasachi Bisoyi, Chitta Baral
Preprint
Efficient ML & NLP
ILDAE: Instance-Level Difficulty Analysis of Evaluation Data.
Neeraj Varshney, Swaroop Mishra, Chitta Baral
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Let the Model Decide its Curriculum for Multitask Learning
Neeraj Varshney, Swaroop Mishra, Chitta Baral
North American Chapter of the Association for Computational Linguistics (NAACL) Workshop, 2022
How Robust are Model Rankings : A Leaderboard Customization Approach for Equitable Evaluation
Swaroop Mishra, A Arunkumar
Conference on Artificial Intelligence (AAAI), 2021
`Hardness' of Samples Need to be Quantified for a Reliable Evaluation System: Exploring Potential Opportunities with a New Task
Swaroop Mishra, Anjana Arunkumar, Chris Bryan, Chitta Baral
Preprint
Commonsense Reasoning with Implicit Knowledge in Natural Language
Pratyay Banerjee*, Swaroop Mishra*, Kuntal Kumar Pal*, Arindam Mitra*, Chitta Baral
Conference on Automated Knowledge Base Construction (AKBC), 2021
A Visual Exploration of Fair Evaluation for ML - Bridging the Gap Between Research and the Real World
A Arunkumar, Swaroop Mishra, C Bryan
IEEE Visualization (IEEE VIS) Workshop, 2020
Front Contribution instead of Back Propagation
Swaroop Mishra, A Arunkumar
Conference on Neural Information Processing Systems (NeurIPS) Workshop, 2020
Robustness and Generalization
Generalized but not Robust? Understanding the Effects of Out-of-Domain Generalization Methods.
Tejas Gokhale*, Swaroop Mishra*, Man Luo*, Bhavdeep Sachdeva, Chitta Baral
Annual Meeting of the Association for Computational Linguistics (ACL) Findings, 2022
Pretrained Transformers May Not Provide More Robust Representation Than Traditional Models On Data with Noisy Labels
Swaroop Mishra, Bhavdeep Sachdeva, Chitta Baral
Preprint
Our Evaluation Metric Needs an Update to Encourage Generalization
Swaroop Mishra, A Arunkumar, C Bryan, C Baral
International Conference on Machine Learning (ICML) Workshop, 2020
Selective Answering
Investigating Selective Prediction Approaches Across Several Tasks in IID, OOD, and Adversarial Settings.
Neeraj Varshney, Swaroop Mishra, Chitta Baral
Annual Meeting of the Association for Computational Linguistics (ACL) Findings, 2022
Towards Improving Selective Prediction Ability of NLP Systems
Neeraj Varshney, Swaroop Mishra, Chitta Baral
Annual Meeting of the Association for Computational Linguistics (ACL) Workshop, 2022
Investigating Issues with the Area Under the Curve Metric and Proposing Solutions
Swaroop Mishra, Anjana Arunkumar, Chitta Baral
Preprint
Interviewer-Candidate Role Play: Towards Developing Real-World NLP Systems
Neeraj Varshney, Swaroop Mishra, Chitta Baral
Preprint
Spurious Bias
Do We Need to Create Big Datasets to Learn a Task?
Swaroop Mishra*, B Sachdeva*
Conference on Empirical Methods in Natural Language Processing (EMNLP) Workshop 2020
Identification and Curation of Parameters to Assess and Quantify the Quality of Benchmarks in NLP
Swaroop Mishra, Anjana Arunkumar, Chris Bryan, Chitta Baral
Preprint
Is High Quality Data All You Need?
Swaroop Mishra, A Arunkumar
Conference on Neural Information Processing Systems (NeurIPS) Workshop, 2020
Real-Time Visual Feedback for Educative Benchmark Creation : A Human-and-Metric-in-the-Loop Workflow
A Arunkumar, Swaroop Mishra, B Sachdeva, C Baral, C Bryan
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
DQI: A Guide to Benchmark Evaluation
Swaroop Mishra, A Arunkumar, B Sachdeva, C Bryan, C Baral
International Conference on Machine Learning (ICML) Workshop, 2020
ML & NLP Applications
Constructing Flow Graphs from Procedural Cyber Security Text
Kuntal Kumar Pal*, Kazuaki Kashihara*, Pratyay Banerjee*, Swaroop Mishra, Ruoyu Wang, Chitta Baral
Annual Meeting of the Association for Computational Linguistics (ACL) Findings, 2021
Towards the Development of Disaster Management Tailored Machine Learning Systems
Swaroop Mishra, Manas Kumar Jena, Ashok Kumar Tripathy
IEEE International Conference (INDISCON), 2022
Enabling cyber-physical demand response in smart grids via conjoint communication and controller design.
Swaroop Mishra, MP Korukonda, L Behera, A Shukla
IET Cyber-Physical Systems: Theory & Applications, 2019
Hybrid adaptive framework for coordinated control of distributed generators in cyber-physical energy systems
MP Korukonda, Swaroop Mishra, K Rajawat, L Behera
IET Cyber-Physical Systems: Theory & Applications, 2018
Handling multi-parametric variations in distributed control of cyber-physical systems through optimal communication design
MP Korukonda, Swaroop Mishra, A Shukla, L Behera
IET Cyber-Physical Systems: Theory & Applications, 2017
Improving microgrid voltage stability through cyber-physical control
MP Korukonda, Swaroop Mishra, A Shukla, L Behera
National Power System Conference (NPSC), 2016
A generalized novel framework for optimal sensor-controller connection design to guarantee a stable cyber physical smart grid
Swaroop Mishra, NV Srinath, MP Korukonda, L Behera
IEEE International Conference on Industrial Informatics (INDIN), 2015

Template from the awesome Jon