Jinjie Ni

Jinjie Ni

a.k.a. Oliver

profile photo

"Before Sunset". Oia, Santorini, 2023.

I'm currently a Research Fellow at National University of Singapore with Prof. Yang You. I completed my Ph.D. in Computer Science at Nanyang Technological University, Singapore (2020-2023), with Prof. Erik Cambria. Throughout my academic journey, I had the privilege of collaborating with esteemed scientists from DAMO Alibaba SG, Harvard University, and the Chinese Academy of Sciences.

I am interested in

When I'm not deeply engrossed in research, you can find me indulging in powerlifting, capturing moments through photography, playing ball games, or strategizing over a game of poker.

Google Scholar  /  Github  /  Twitter  /  LinkedIn  /  Zhi Hu  /  Email  /  CV

I will be on the job market shortly, looking out for new career opportunities as a Research Scientist working on Large Language Models or Artificial General Intelligence. If you know some companies or individuals who may be looking for someone with my expertise and experience, please do not hesitate to reach out to me directly.

Also, I am open to research collaborations, please feel free to drop me an email if you have any interesting ideas.

⚡ Updates
2024.01 📰 🔥🔥🔥The OpenMoE technical report is available on arXiv, check it out!
2023.12 🏄🏻‍♀️ I will be in Singapore for EMNLP'23 🇸🇬! Drop me a message if you are interested in having a talk with me!
2023.12 🗣️ Gave a talk at DAI'23, with the topic "Learning Lighter Transformer Archtectures".
2023.07 🎓 Thrilled to be conferred with the Ph.D. degree! Thank everyone that offered valuable support and help in my academic journey. And cheers, Dr. Ni 🎊!
2023.07 🧗🏻‍♂️ New journey! I'm joining HPC-AI, SoC, NUS as a Research Fellow, working with Prof. Yang You!
2023.05 🏄🏻‍♀️ Got one paper (GHA) on optimizing transformer architecture accepted to ACL'23! Congrats to me and all co-authors! See you in Toronto!
2023.03 📰 Our paper reviewing Natural Language Reasoning is available on arXiv, check it out!
2023.02 🏄🏻‍♀️ Got three papers (PAD, APLY, and de'HuBERT) accepted to ICASSP'23! Congrats to Yukun, Dianwen, me, and all co-authors! See you in Greece!
2022.09 📰 Our paper on Graph Representation Learning is available on arXiv, check it out!
2022.06 📰 The 80-page review on conversational agents is accepted to Artificial Intelligence Review. Congrats to me and all co-authors!
2022.04 🧗🏻‍♀️ Glad to start my internship at DAMO, Alibaba SG!
2022.01 🏄🏻‍♀️ Got one paper on Dialogue Relation Extraction accepted by ICASSP'22. Congrats to Fuzhao!
2021.12 🏄🏻‍♀️ Got two papers (HITKG, FusedChat) accepted to AAAI'22! Congrats to Tom, me, and all co-authors! See you in Vancouver!
2020.08 🧗🏻‍♂️ New journey! I'm joining SCSE, NTU as a Ph.D., working with Prof. Erik Cambria!



National University of Singapore NUS logo 2023 - now
Research Fellow
Working on Large Language Models and Artificial General Intelligence.
Nanyang Technological University NTU logo 2020 - 2023
Ph.D. in Computer Science
Thesis: Attention Mechanism Optimization for Sub-Symbolic-Based and Neural-Symbolic-Based Natural Language Processing
Northwestern Polytechnical University NWPU logo 2016 - 2020
B.Eng. in Electrical Engineering
Thesis: Multi-modal Predictor for Video Affective Computing


DAMO Academy, Alibaba Group, Singapore Alibaba logo 2022.04 - 2022.10
Research Intern
Researched modality alignment for efficient knowledge distillation. Worked with Dr. Yukun Ma.
Continental-NTU Corp Lab Continental logo 2020.09 - 2022.08
Research Intern
Researched fusing task-oriented and open-domain dialogue systems. Worked with Dr. Rui Mao.
Institute of Automation, Chinese Academy of Sciences CAS logo 2020.02 - 2020.06
Research Intern
Researched anchor-free position estimation based on ExtremeNet and GCN. Worked with Dr. Sen Xin.
Institute for Applied Computational Science, Harvard University Harvard logo 2019.01 - 2019.03
Research Assistant
Developed VAE-GAN variants. Worked with Dr. Pavlos Protopapas.
Institute of Computing Technology, Chinese Academy of Sciences CAS logo 2018.10 - 2018.11
Research Intern
Researched abstractive summarization. Worked with Dr. Shuai Jiao.

Papers (recent)

2024 [arXiv] OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models
Fuzhao Xue, Zian Zheng, Yao Fu, Jinjie Ni, Zangwei Zheng, Wangchunshu Zhou, Yang You
2023 [ACL'23] Finding the Pillars of Strength for Multi-head Attention.
Jinjie Ni, Rui Mao, Zonglin Yang, Han Lei, Erik Cambria
[arXiv] Adaptive Knowledge Distillation between Text and Speech Pre-trained Models.
Jinjie Ni, Yukun Ma, Wen Wang, Qian Chen, Dianwen Ng, Han Lei, Trung Hieu Nguyen, Chong Zhang, Bin Ma, Erik Cambria
[arXiv] Auxiliary Pooling Layer For Spoken Language Understanding.
Yukun Ma, Trung Hieu Nguyen, Jinjie Ni, Wen Wang, Qian Chen, Chong Zhang, Bin Ma
[arXiv] de'HuBERT: Disentangling noise in a self-supervised model.
Dianwen Ng, Ruixi Zhang, Jia Qi Yip, Zhao Yang, Jinjie Ni, Chong Zhang, Yukun Ma, Chongjia Ni, Eng Siong Chng, Bin Ma
[arXiv] Logical Reasoning over Natural Language as Knowledge Representation.
Zonglin Yang, Xinya Du, Rui Mao, Jinjie Ni, Erik Cambria
[arXiv] A Survey on Semantic Processing Techniques.
Rui Mao*, Kai He*, Xulang Zhang*, Guanyi Chen*, Jinjie Ni*, Zonglin Yang*, Erik Cambria.
2022 [AAAI'22] HiTKG: Towards Goal-guided Conversations.
Jinjie Ni, Vlad Pandelea, Tom Young, Haicang Zhou, Erik Cambria
[AAAI'22] FusedChat: towards fusing task-oriented dialogues and chitchat in multi-turn conversational agents.
Tom Young, Frank Xing, Vlad Pandelea, Jinjie Ni, Erik Cambria
[arXiv] An embarrassingly simple model for dialogue relation extraction.
Fuzhao Xue, Aixin Sun, Hao Zhang, Jinjie Ni, Eng Siong Chng.
[arXiv] A Class-Aware Representation Refinement Framework for Graph Classification.
Jiaxing Xu, Jinjie Ni, Sophi Shilpa Gururajapathy, Yiping Ke
2021 [AIRE] Recent Advances in Deep Learning Based Dialogue Systems.
Jinjie Ni, Tom Young, Vlad Pandelea, Fuzhao Xue, Erik Cambria



2021 NTU-SC1003: Introduction to Computational Thinking and Programming
Teaching Assistant
NTU-CE2100: Probability and Statistics for Computing
2020 NTU-CE1113: Physics for Computing
Teaching Assistant
NTU-CZ2007: Introduction To Databases
Teaching Assistant
NTU-CZ2004: Human Computer Interaction
Teaching Assistant


Journal Reviewer Knowledge-Based Systems, Information Fusion, Artificial Intelligence Review, Cognitive Computation
Co-organizer MLNLP community
Co-Editor Lena’s NLP Course (Chinese Edition)
Lecturer GC & CAO Seminar
Host 3rd MLNLP Seminar - Towards Generating Deep Questions from Text