publications

2025

1. R²-CoD: Understanding Text-Graph Complementarity in Relational Reasoning via Knowledge Co-Distillation

   Zhen Wu, Ritam Dutt, Armineh Nourbakhsh , and 3 more authors

   2025

   Under submission to the Conference on Language Modeling (COLM)

   Abs HTML

   Relational reasoning lies at the core of many NLP tasks, often drawing on complementary signals from text and graphs. While this complementarity has been leveraged for many research objectives, the field lacks a detailed and systematic understanding of text-graph interplay and its effect on hybrid models. In this work, we take an analysis-driven approach to investigate text–graph representation complementarity via a unified architecture that supports knowledge co-distillation (CoD). We study five tasks involving relational reasoning that each differs in how text and graph structures encode and support the respective task objectives. By tracking how text and graph-based representations evolve over training epochs, we uncover interpretable patterns of alignment and divergence, and provide insights into when and why their integration through CoD is most beneficial.

2. Can KBQA Models Predict Their Reasoning Paths? Isomorphism Prediction Task as a Proxy

   Zhen Wu, Ritam Dutt, Dhruv Gupta , and 1 more author

   2025

   Under submission to ACL

   Abs HTML

   Despite achieving correct answers, we find that existing Knowledge Base Question Answering (KBQA) models struggle to follow the expected reasoning structures. We introduce the task of isomorphism prediction to enhance reasoning fidelity beyond answer generation, with a focus on generalization. We propose a contrastive knowledge co-distillation framework that unifies textual and graphical KBQA paradigms, improving overall isomorphism prediction and model generalization. Furthermore, incorporating isomorphism prediction as an auxiliary task also improves KBQA performance.

3. CSCL

   LLM Bazaar: A Service Design for Supporting Collaborative Learning with an LLM-Powered Multi-Party Collaboration Infrastructure

   Zhen Wu, Jiaxin Shi, R. Charles Murray , and 2 more authors

   In Proceedings of the International Conference on Computer-Supported Collaborative Learning (CSCL) , 2025

   Abs

   For nearly two decades, conversational agents have played a critical role in structuring interactions in collaborative learning, shaping group dynamics, and supporting student engagement. The recent integration of large language models (LLMs) into these agents offers new possibilities for fostering critical thinking and collaborative problem solving. In this work, we begin with an open source collaboration support architecture called Bazaar and integrate an LLM-agent shell that enables introduction of LLM-empowered, real time, context sensitive collaborative support for group learning. This design and infrastructure paves the way for exploring how tailored LLM-empowered environments can reshape collaborative learning outcomes and interaction patterns.

2024

1. ACL

   Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in Conversations

   Ritam Dutt, Zhen Wu, Kelly Shi , and 3 more authors

   In , 2024

   Abs Bib HTML

   We present a generalizable classification approach that leverages Large Language Models (LLMs) to facilitate the detection of implicitly encoded social meaning in conversations. We design a multi-faceted prompt to extract a textual explanation of the reasoning that connects visible cues to underlying social meanings. These extracted explanations or rationales serve as augmentations to the conversational text to facilitate dialogue understanding and transfer. Our empirical results over 2,340 experimental settings demonstrate the significant positive impact of adding these rationales. Our findings hold true for in-domain classification, zero-shot, and few-shot domain transfer for two different social meaning detection tasks, each spanning two different corpora.

   @inproceedings{dutt2024leveragingmachinegeneratedrationalesfacilitate,
     title = {Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in Conversations},
     author = {Dutt, Ritam and Wu, Zhen and Shi, Kelly and Sheth, Divyanshu and Gupta, Prakhar and Rose, Carolyn Penstein},
     year = {2024},
     eprint = {2406.19545},
     archiveprefix = {arXiv},
     primaryclass = {cs.CL},
   }

2. HuCLLM, ACL

   Evaluating Large Language Models on Social Signal Sensitivity: An Appraisal Theory Approach

   Zhen Wu, Ritam Dutt, and Carolyn Rosé

   In Proc. of the 1st Human-Centered Large Language Modeling Workshop at ACL , 2024

   Abs Bib HTML

   We present a framework to assess the sensitivity of Large Language Models (LLMs) to textually embedded social signals using an Appraisal Theory perspective. We report on an experiment that uses prompts encoding three dimensions of social signals: Affect, Judgment, and Appreciation. In response to the prompt, an LLM generates both an analysis (Insight) and a conversational Response, which are analyzed in terms of sensitivity to the signals. We quantitatively evaluate the output text through topical analysis of the Insight and predicted social intelligence scores of the Response in terms of empathy and emotional polarity. Key findings show that LLMs are more sensitive to positive signals. The personas impact Responses but not the Insight. We discuss how our framework can be extended to a broader set of social signals, personas, and scenarios to evaluate LLM behaviors under various conditions.

   @inproceedings{wuhucllm,
     title = {Evaluating Large Language Models on Social Signal Sensitivity: An Appraisal Theory Approach},
     author = {Wu, Zhen and Dutt, Ritam and Rosé, Carolyn},
     booktitle = {Proc. of the 1st Human-Centered Large Language Modeling Workshop at ACL},
     year = {2024},
   }