Selected Publications by topics
You can also find the full list of my publicaiton at Google Scholar Profile.
LLM Pre-Training
Clear: Contrastive learning for sentence representation
Zhuofeng Wu, Sinong Wang, Jiatao Gu, Madian Khabsa, Fei Sun, Hao Ma
arXiv preprint arXiv:2012.15466
[Preprint]
LLM Post-Trainig
Parameter-Efficient Fine-Tuning:
IDPG: An instance-dependent prompt generation method
Zhuofeng Wu, Sinong Wang, Jiatao Gu, Rui Hou, Yuxiao Dong, VG Vydiswaran, Hao Ma
In Proceedings of NAACL 2022 (Oral Presentation)
[Paper] [Github] [Video]
Contrastive Learning:
HiCL: Hierarchical Contrastive Learning of Unsupervised Sentence Embeddings
Zhuofeng Wu, Chaowei Xiao, V. G. Vydiswaran
In Proceedings of Findings of EMNLP 2023
[Paper] [Video]
RAG:
UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversations
Fengran Mo, Yifan Gao, Chuan Meng, Xin Liu, Zhuofeng Wu, Kelong Mao, Zhengyang Wang, Pei Chen, Zheng Li, Xian Li, Bing Yin, Meng Jiang
In Proceedings of ACL 2025
[Paper]
LLM Reasoning & Planning
Divide-or-Conquer? Which Part Should You Distill Your LLM?
Zhuofeng Wu, He Bai, Aonan Zhang, Jiatao Gu, VG Vydiswaran, Navdeep Jaitly, Yizhe Zhang
In Proceedings of Findings of EMNLP 2024
[Paper] [Github]
Historical Language Change
Identify Shifts of Word Semantics through Bayesian Surprise
Zhuofeng Wu, Cheng Li, Zhe Zhao, Fei Wu, Qiaozhu Mei
In Proceedings of SIGIR 2018 (Oral Presentation)
[Paper] [Github]
Robustness of ML Models
Defending against Insertion-based Textual Backdoor Attacks via Attribution.
Jiazhao Li, Zhuofeng Wu, Wei Ping, Chaowei Xiao, V. G. Vydiswaran.
In Proceedings of Findings of ACL 2023
[Paper] [Github]
Chatgpt as an attack tool: Stealthy textual backdoor attack via blackbox generative model trigger
Jiazhao Li, Yijin Yang, Zhuofeng Wu, V. G. Vydiswaran, Chaowei Xiao
In Proceedings of NAACL 2024
Spotlight Paper in 4th TrustNLP workshop
[Paper]
Diffusion Models
PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Model
Yizhe Zhang, Jiatao Gu, Zhuofeng Wu, Shuangfei Zhai, Josh Susskind, Navdeep Jaitly
In Proceedings of NeurIPS 2023
[Paper]