Ji Qi

Ji Qi 齐济

I am a fourth-year Ph.D. student at Tsinghua University, advised by Prof. Bin Xu and Prof. Juanzi Li. Currently, I'm a visiting student at NExT++ Lab in National University of Singapore, advised by Prof. Tat-Seng Chua.

Email / Google Scholar / Github / Selected Publications / Experience / Honors & Awards

Selected Publications

My research interests lies in Multimodal Large Language Models. I am currently focused on Training Multimodal Language Models involving Long Context and Videos. Here are some of my lead works:

	CogCoM: Train Large Vision-Language Models Diving into Details through Chain of Manipulations. Ji Qi, Ming Ding, Weihan Wang, Yushi Bai, Qingsong Lv, Wenyi Hong, Bin Xu, Lei Hou, Juanzi Li, Yuxiao Dong, Jie Tang arXiv [paper] [code]
	CogVLM: Visual Expert for Large Language Models Weihan Wang, Qingsong Lv, Wenmeng Yu, Wenyi Hong, Ji Qi, Yan Wang, Junhui Ji, Zhuoyi Yang, Lei Zhao, Xixuan Song, Jiazheng Xu, Xu Bin, Juanzi Li, Jie Tang, Ming Ding arXiv [paper] [code]
	VidCoM: Fast Video Comprehension through Large Language Models with Multimodal Tools Ji Qi, Kaixuan Ji, Jifan Yu, Duokang Wang, Bin Xu, Lei Hou, Juanzi Li arXiv [paper]
	GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generation Ji Qi, Jifan Yu, Teng Tu, Kunyu Gao, Yifan Xu, Xinyu Guan, Xiaozhi Wang, Bin Xu, Lei Hou, Juanzi Li, Jie Tang CIKM 2023 [paper] [code]
	Preserving Knowledge Invariance: Rethinking Robustness Evaluation of Open Information Extraction Ji Qi, Chuchun Zhang, Xiaozhi Wang, Kaisheng Zeng, Jifan Yu, Jinxin Liu, Jiuding Sun, Yuxiang Chen, Lei How, Juanzi Li, Bin Xu EMNLP 2023 (Outstanding Paper Award) [paper] [code]
	Syntactically Robust Training on Partially-Observed Data for Open Information Extraction Ji Qi, Yuxiang Chen, Lei Hou, Juanzi Li, Bin Xu EMNLP 2022 [paper] [code]

Experience

	Tsinghua University 2020.09 - Present Ph.D student in Computer Science and Technology Advisor: Prof. Bin Xu and Prof. Juanzi Li
	National University of Singapore 2024.04-2024.10 Visiting Research Student Advisor: Prof. Tat-Seng Chua

Honors & Awards

Outstanding Paper Award from EMNLP 2023, 2023
Dengfeng Scholarship from Tsinghua University, 2023

Template adapted from Jon Barron.