Jinjie Ni
a.k.a. Oliver
"Before Sunset". Oia, Santorini, 2023.
I'm currently a Research Fellow at National University of Singapore with Prof. Yang You. I completed my Ph.D. in Computer Science at Nanyang Technological University, Singapore (2020-2023), with Prof. Erik Cambria. Throughout my academic journey, I had the privilege of collaborating with esteemed scientists from DAMO Alibaba SG, Harvard University, and the Chinese Academy of Sciences.
I am particularly interested in
- Pushing the frontier of (multi-modal) language models’ capabilities, which involves reasoning, in context learning, and long-range understanding.
- Compute-optimal learning, which involves sample efficient learning, model compression, and knowledge distillation.
- Language models as agents, which involves building (multi-modal) language models to learn from the interaction with complicated environments.
When I'm not deeply engrossed in research, you can find me indulging in powerlifting, capturing moments through photography, playing ball games, or strategizing over a game of poker.
Google Scholar / Github / Twitter / LinkedIn / Zhi Hu / Email / CV
I will be on the job market shortly, looking out for new career opportunities as a Research Scientist working on Large Language Models or Artificial General Intelligence. If you know some companies or individuals who may be looking for someone with my expertise and experience, please do not hesitate to reach out to me directly.
Also, I am open to research collaborations, please feel free to drop me an email if you have any interesting ideas.
⚡ Updates
| 2023.12 | 🏄🏻♀️ I will be in Singapore for EMNLP'23 🇸🇬! Drop me a message if you are interested in having a talk with me! |
| 2023.12 | 🗣️ Gave a talk at DAI'23, with the topic "Learning Lighter Transformer Archtectures". |
| 2023.07 | 🎓 Thrilled to be conferred with the Ph.D. degree! Thank everyone that offered valuable support and help in my academic journey. And cheers, Dr. Ni 🎊! |
| 2023.07 | 🧗🏻♂️ New journey! I'm joining HPC-AI, SoC, NUS as a Research Fellow, working with Prof. Yang You! |
| 2023.05 | 🏄🏻♀️ Got one paper (GHA) on optimizing transformer architecture accepted to ACL'23! Congrats to me and all co-authors! See you in Toronto! |
| 2023.03 | 📰 Our paper reviewing Natural Language Reasoning is available on arXiv, check it out! |
| 2023.02 | 🏄🏻♀️ Got three papers (PAD, APLY, and de'HuBERT) accepted to ICASSP'23! Congrats to Yukun, Dianwen, me, and all co-authors! See you in Greece! |
| 2022.09 | 📰 Our paper on Graph Representation Learning is available on arXiv, check it out! |
| 2022.06 | 📰 The 80-page review on conversational agents is accepted to Artificial Intelligence Review. Congrats to me and all co-authors! |
| 2022.04 | 🧗🏻♀️ Glad to start my internship at DAMO, Alibaba SG! |
| 2022.01 | 🏄🏻♀️ Got one paper on Dialogue Relation Extraction accepted by ICASSP'22. Congrats to Fuzhao! |
| 2021.12 | 🏄🏻♀️ Got two papers (HITKG, FusedChat) accepted to AAAI'22! Congrats to Tom, me, and all co-authors! See you in Vancouver! |
| 2020.08 | 🧗🏻♂️ New journey! I'm joining SCSE, NTU as a Ph.D., working with Prof. Erik Cambria! |
Experiences |
|
Academia |
|
| 2023 |
National University of Singapore
2023 - now
|
| Research Fellow | |
| Working on Large Language Models and Artificial General Intelligence. | |
| 2020 |
Nanyang Technological University
2020 - 2023
|
| Ph.D. in Computer Science | |
| Thesis: Attention Mechanism Optimization for Sub-Symbolic-Based and Neural-Symbolic-Based Natural Language Processing | |
| 2016 |
Northwestern Polytechnical University
2016 - 2020
|
| B.Eng. in Electrical Engineering | |
| Thesis: Multi-channel Estimator for Video-based Affective Computing | |
Industry |
|
| 2022 |
DAMO Academy, Alibaba Group, Singapore
2022.04 - 2022.10
|
| Research Intern | |
| Researched modality alignment for efficient knowledge distillation. Worked with Dr. Yukun Ma. | |
| 2020 |
Continental-NTU Corp Lab
2020.09 - 2022.08
|
| Research Intern | |
| Researched fusing task-oriented and open-domain dialogue systems. Worked with Dr. Rui Mao. | |
|
Institute of Automation, Chinese Academy of Sciences
2020.02 - 2020.06
|
|
| Research Intern | |
| Researched anchor-free position estimation based on ExtremeNet and GCN. Worked with Dr. Sen Xin. | |
| 2019 |
Institute for Applied Computational Science, Harvard University
2019.01 - 2019.03
|
| Research Assistant | |
| Developed VAE-GAN variants. Worked with Dr. Pavlos Protopapas. | |
| 2018 |
Institute of Computing Technology, Chinese Academy of Sciences
2018.10 - 2018.11
|
| Research Intern | |
| Researched abstractive summarization. Worked with Dr. Shuai Jiao. | |
Papers (recent) |
|
| 2023 | [ACL'23] Finding the Pillars of Strength for Multi-head Attention. |
| Jinjie Ni, Rui Mao, Zonglin Yang, Han Lei, Erik Cambria | |
| [ICASSP'23] Adaptive Knowledge Distillation between Text and Speech Pre-trained Models. | |
| Jinjie Ni, Yukun Ma, Wen Wang, Qian Chen, Dianwen Ng, Han Lei, Trung Hieu Nguyen, Chong Zhang, Bin Ma, Erik Cambria | |
| [ICASSP'23] Auxiliary Pooling Layer For Spoken Language Understanding. | |
| Yukun Ma, Trung Hieu Nguyen, Jinjie Ni, Wen Wang, Qian Chen, Chong Zhang, Bin Ma | |
| [ICASSP'23] de'HuBERT: Disentangling noise in a self-supervised model. | |
| Dianwen Ng, Ruixi Zhang, Jia Qi Yip, Zhao Yang, Jinjie Ni, Chong Zhang, Yukun Ma, Chongjia Ni, Eng Siong Chng, Bin Ma | |
| [arXiv] Logical Reasoning over Natural Language as Knowledge Representation. | |
| Zonglin Yang, Xinya Du, Rui Mao, Jinjie Ni, Erik Cambria | |
| [arXiv] A Survey on Semantic Processing Techniques. | |
| Rui Mao*, Kai He*, Xulang Zhang*, Guanyi Chen*, Jinjie Ni*, Zonglin Yang*, Erik Cambria. | |
| 2022 | [AAAI'22] HiTKG: Towards Goal-guided Conversations. |
| Jinjie Ni, Vlad Pandelea, Tom Young, Haicang Zhou, Erik Cambria | |
| [AAAI'22] FusedChat: towards fusing task-oriented dialogues and chitchat in multi-turn conversational agents. | |
| Tom Young, Frank Xing, Vlad Pandelea, Jinjie Ni, Erik Cambria | |
| [ICASSP'22] An embarrassingly simple model for dialogue relation extraction. | |
| Fuzhao Xue, Aixin Sun, Hao Zhang, Jinjie Ni, Eng Siong Chng. | |
| [arXiv] A Class-Aware Representation Refinement Framework for Graph Classification. | |
| Jiaxing Xu, Jinjie Ni, Sophi Shilpa Gururajapathy, Yiping Ke | |
| 2021 | [AIRE] Recent Advances in Deep Learning Based Dialogue Systems. |
| Jinjie Ni, Tom Young, Vlad Pandelea, Fuzhao Xue, Erik Cambria | |
Activities |
|
Teaching |
|
| 2021 | NTU-SC1003: Introduction to Computational Thinking and Programming |
| Teaching Assistant | |
| NTU-CE2100: Probability and Statistics for Computing | |
| Lecturer | |
| 2020 | NTU-CE1113: Physics for Computing |
| Teaching Assistant | |
| NTU-CZ2007: Introduction To Databases | |
| Teaching Assistant | |
| NTU-CZ2004: Human Computer Interaction | |
| Teaching Assistant | |
Services |
||
| PC Member | ACL, EMNLP, AAAI, ICASSP | |
| Journal Reviewer | Knowledge-Based Systems, Information Fusion, Artificial Intelligence Review, Cognitive Computation | |
| Co-organizer | MLNLP community | |
| Co-Editor | Lena’s NLP Course (Chinese Edition) | |
| Lecturer | GC & CAO Seminar | |
| Host | 3rd MLNLP Seminar - Towards Generating Deep Questions from Text |