Minhwa Lee
Generative AI Engineer @ CitiusTech
minhwalee [AT] umass.edu
Welcome!
I am a Generative AI Engineer at CitiusTech, specialized in healthcare AI. I am currently based in a Minneapolis-St.Paul area, Minnesota. I am interested in designing and building AI solutions to provide better healthcare services using large language models (LLMs). In my previous life, I was a full-time research staff member at University of Massachusetts Lowell (2024-2025) and University of Minnesota (2023-2024). Before that, I earned my Master's in Computer Science from University of Massachusetts Amherst in 2023 and Bachelor's in CS/Math from from The College of Wooster in 2021.
Open to full-time AI engineer opportunities in the U.S., with NLP specializations in healthcare areas!
[Updated Feb 2025] Here is my full CV.
Announcements
- [Apr. 2025] Starting a new position as an AI software engineer at CitiusTech, a healthcare AI company in the U.S. I will be working on automating LLM evaluation framework.
- [Feb. 2025] A new preprint is out! We study the cognitive process of scholarly writing as a basis of future AI writing assistant development!
- [Sep. 2024] Our preprint about diversity extraction from LLMs is accepted to EMNLP 2024!
- [Aug. 2024] I accepted an offer as a full-time research staff at University of Massachusetts Lowell!
- [May. 2024] Our preprint about benchmarking LLM evaluations on cognitive biases is accepted to ACL 2024!
- [Mar. 2024] My first NLP + HCI paper about human-AI collaboration is accepted to In2Writing Workshop @ CHI 2024!
- [Feb. 2024] Our paper about public health surveillance using social media and machine learning is accepted to LREC-COLING 2024!
- [Jan. 2024] A new preprint is out! My first 1st-authored paper in NLP domain! Check out how various types of LLM-generated data still lacks "humanness" through several stress testing!
- [Nov. 2023] A new preprint is out! Check out how much our novel method of criteria-based prompting can promote diversity and inclusion in LLMs!
- [Sep. 2023] A new preprint about LLM evaluation is out! Check out how much LLM evaluation are affected by cognitive biases and compare it with human alignment as well!
- [June. 2023] Elated to announce that I will be working as a full-time visiting researcher at Minnesota NLP!
Publications
Most recent publications on Google Scholar.
‡ indicates equal contribution.
How Far Can We Extract Diverse Perspectives from Large Language Models? Paper
Shirley Anugrah Hayati, Minhwa Lee, Dheeraj Rajagopal, Dongyeop Kang
EMNLP 2024
Benchmarking Cognitive Biases in Large Language Models as Evaluators Paper Data
Ryan Koo, Minhwa Lee, Vipul Raheja, Jong Inn Park, Zae Myung Kim, Dongyeop Kang
Findings of ACL 2024
Human-AI Collaborative Taxonomy Construction: A Case Study of Profession-specific Writing Assistants Paper Code
Minhwa Lee, Zae Myung Kim, Vivek A. Khetan, Dongyeop Kang
The Third In2Writing Workshop at CHI 2024
LocalTweets to LocalHealth: A Mental Health Surveillance Framework Based on Twitter Data Paper
Vijeta Deshpande, Minhwa Lee, Zonghai Yao, Zihao Zhang, Jason B. Gibbons, Hong Yu
LREC-COLING 2024
Under the Surface: Tracking the Artifactuality of LLM-Generated Data Paper Code Data
Debarati Das‡, Karin De Langis‡, Anna Martin‡, Jaehyung Kim‡, Minhwa Lee‡, Zae Myung Kim‡, Shirley Hayati, Risako Owan, Bin Hu, Ritik Parkar, Ryan Koo, Jonginn Park, Aahan Tyagi, Libby Ferland, Sanjali Roy, Vincent Liu, Dongyeop Kang
Preprint (arXiv), 2024
Socioeconomic and Geographic Disparities... [Full Title to be disclosed after acceptance]
Minhwa Lee‡, Yifan Zhang‡, Jason B. Gibbons, Huan-Yuan Chen, Zonghai Yao, Yan Wang, Feiyun Ouyang, David Levy, Katherine L. Tucker, Hong Yu
Under Review by Nature Scientific Reports
ScholaWrite: A Dataset of End-to-End Scholarly Writing Process PDF Code
Linghe Wang‡, Minhwa Lee‡, Ross Volkov, Luan Tuyen Chau, Dongyeop Kang
Preprint (arXiv), 2025.
How Far Can We Extract Diverse Perspectives from Large Language Models? PDF
Shirley Anugrah Hayati, Minhwa Lee, Dheeraj Rajagopal, Dongyeop Kang
EMNLP 2024
Benchmarking Cognitive Biases in Large Language Models as Evaluators PDF
Ryan Koo, Minhwa Lee, Vipul Raheja, Jong Inn Park, Zae Myung Kim, Dongyeop Kang
Findings of ACL 2024
Human-AI Collaborative Taxonomy Construction: A Case Study of Profession-specific Writing Assistants PDF Code
Minhwa Lee, Zae Myung Kim, Vivek A. Khetan, Dongyeop Kang
The Third In2Writing Workshop at CHI 2024
LocalTweets to LocalHealth: A Mental Health Surveillance Framework Based on Twitter Data PDF
Vijeta Deshpande, Minhwa Lee, Zonghai Yao, Zihao Zhang, Jason B. Gibbons, Hong Yu
LREC-COLING 2024
Under the Surface: Tracking the Artifactuality of LLM-Generated Data PDF Code
Debarati Das‡, Karin De Langis‡, Anna Martin‡, Jaehyung Kim‡, Minhwa Lee‡, Zae Myung Kim‡, Shirley Hayati, Risako Owan, Bin Hu, Ritik Parkar, Ryan Koo, Jonginn Park, Aahan Tyagi, Libby Ferland, Sanjali Roy, Vincent Liu, Dongyeop Kang
Preprint (arXiv), 2024
Socioeconomic and Geographic Disparities... [Full Title to be disclosed after acceptance]
Minhwa Lee‡, Yifan Zhang‡, Jason B. Gibbons, Huan-Yuan Chen, Zonghai Yao, Yan Wang, Feiyun Ouyang, David Levy, Katherine L. Tucker, Hong Yu
Under Review by Nature Scientific Reports