A Survey of Surveys (NLP & ML)

In this document, we survey hundreds of survey papers on Natural Language Processing (NLP) and Machine Learning (ML). We categorize these papers into popular topics and do simple counting for some interesting problems. In addition, we show the list of the papers with urls (563 papers).

Categorization

We follow the ACL and ICML submission guideline of recent years, covering a broad range of areas in NLP and ML. The categorization is as follows:

• Natural Language Processing
  • Computational Social Science and Social Media
  • Dialogue and Interactive Systems
  • Generation
  • Information Extraction
  • Information Retrieval and Text Mining
  • Interpretability and Analysis of Models for NLP
  • Knowledge Graph
  • Language Grounding to Vision, Robotics and Beyond
  • Linguistic Theories, Cognitive Modeling and Psycholinguistics
  • Machine Learning for NLP
  • Machine Translation
  • Natural Language Processing (General)
  • Named Entity Recognition (NER)
  • NLP Applications
  • Question Answering
  • Reading Comprehension
  • Recommender Systems
  • Resources and Evaluation
  • Semantics
  • Sentiment Analysis, Stylistic Analysis, and Argument Mining
  • Speech and Multimodality
  • Summarization
  • Syntax: Tagging, Chunking, Syntax and Parsing
  • Text Classification
• Machine Learning
  • Architectures
  • AutoML
  • Bayesian Methods
  • Classification,Clustering,Regression
  • Curriculum Learning
  • Data Augmentation
  • Deep Learning - General Methods
  • Deep Reinforcement Learning
  • Federated Learning
  • Few-Shot and Zero-Shot Learning
  • General Machine Learning
  • Generative Adversarial Networks
  • Graph Neural Networks
  • Interpretability and Analysis
  • Meta Learning
  • Metric Learning
  • ML Applications
  • Model Compression and Acceleration
  • Multi-Task and Multi-View Learning
  • NLP inspired Visual Models
  • Online Learning
  • Optimization
  • Semi-Supervised and Unsupervised Learning
  • Transfer Learning
  • Trustworthy Machine Learning

To reduce class imbalance, we separate some of the hot sub-topics from the original categorization of ACL and ICML submissions. E.g., NER is a first-level area in our categorization because it is the focus of several surveys.

Statistics

We show the number of paper in each area in Figures 1-2.

Figure 1: # of papers in each NLP area.

Figure 2: # of papers in each ML area..

Also, we plot paper number as a function of publication year (see Figure 3).

Figure 3: # of papers vs publication year.

In addition, we generate word clouds to show hot topics in these surveys (see Figures 4-5).

Figure 4: The word cloud for NLP.

Figure 5: The word cloud for ML.

The NLP Paper List

Computational Social Science and Social Media

1. Computational Sociolinguistics: A Survey. Computational Linguistics 2015 paper bib

   Dong Nguyen, A Seza Dogruoz, Carolyn Penstein Rose, Franciska De Jong

Dialogue and Interactive Systems

1. A Comparative Survey of Recent Natural Language Interfaces for Databases. VLDB Journal 2019 paper bib

   Katrin Affolter, Kurt Stockinger, Abraham Bernstein

2. A Survey of Arabic Dialogues Understanding for Spontaneous Dialogues and Instant Message. International Journal on Natural Language Computing 2015 paper bib

   AbdelRahim A. Elmadany, Sherif M. Abdou, Mervat Gheith

3. A Survey of Available Corpora for Building Data-Driven Dialogue Systems. Computer ence 2017 paper bib

   Iulian Vlad Serban, Ryan Lowe, Peter Henderson, Laurent Charlin, Joelle Pineau

4. A Survey of Document Grounded Dialogue Systems. arXiv 2020 paper bib

   Longxuan Ma, Wei-Nan Zhang, Mingda Li, Ting Liu

5. A Survey of Natural Language Generation Techniques with a Focus on Dialogue Systems - Past, Present and Future Directions. arXiv 2019 paper bib

   Sashank Santhanam, Samira Shaikh

6. A Survey on Dialog Management: Recent Advances and Challenges. arXiv 2020 paper bib

   Yinpei Dai, Huihua Yu, Yixuan Jiang, Chengguang Tang, Yongbin Li, Jian Sun

7. A Survey on Dialogue Systems: Recent Advances and New Frontiers. ACM Sigkdd Explorations Newsletter 2017 paper bib

   Hongshen Chen, Xiaorui Liu, Dawei Yin, Jiliang Tang

8. Advances in Multi-turn Dialogue Comprehension: A Survey. arXiv 2021 paper bib

   Zhuosheng Zhang, Hai Zhao

9. Challenges in Building Intelligent Open-domain Dialog Systems. ACM Transactions on Information Systems 2020 paper bib

   Minlie Huang, Xiaoyan Zhu, Jianfeng Gao

10. Conversational Machine Comprehension: a Literature Review. COLING 2020 paper bib

    Somil Gupta, Bhanu Pratap Singh Rawat, Hong Yu

11. Neural Approaches to Conversational AI. ACL 2018 paper bib

    Jianfeng Gao, Michel Galley, Lihong Li

12. POMDP-based Statistical Spoken Dialogue Systems: a Review. IEEE 2013 paper bib

    Steve Young, Milica Gasic, Blaise Thomson, Jason Williams

13. Recent Advances and Challenges in Task-oriented Dialog System. Under review of SCIENCE CHINA Technological Science (SCTS) 2020 paper bib

    Zheng Zhang, Ryuichi Takanobu, Minlie Huang, Xiaoyan Zhu

14. Utterance-level Dialogue Understanding: An Empirical Study. arXiv 2020 paper bib

    Deepanway Ghosal, Navonil Majumder, Rada Mihalcea, Soujanya Poria

Generation

1. A bit of progress in language modeling. Computer Speech & Language 2001 paper bib

   Joshua T. Goodman

2. A Survey of Knowledge-Enhanced Text Generation. arXiv 2020 paper bib

   Wenhao Yu, Chenguang Zhu, Zaitang Li, Zhiting Hu, Qingyun Wang, Heng Ji, Meng Jiang

3. A Survey of Paraphrasing and Textual Entailment Methods. Journal of Artificial Intelligence Research 2010 paper bib

   Ion Androutsopoulos, Prodromos Malakasiotis

4. A Survey on Neural Network Language Models. arXiv 2019 paper bib

   Kun Jing, Jungang Xu

5. Automatic Story Generation: Challenges and Attempts. arXiv 2021 paper bib

   Amal Alabdulkarim, Siyan Li, Xiangyu Peng

6. Evaluation of Text Generation: A Survey. arXiv 2020 paper bib

   Asli Celikyilmaz, Elizabeth Clark, Jianfeng Gao

7. Neural Text Generation: Past, Present and Beyond. arXiv 2018 paper bib

   Sidi Lu, Yaoming Zhu, Weinan Zhang, Jun Wang, Yong Yu

8. Quiz-Style Question Generation for News Stories. arXiv 2021 paper bib

   Adam D. Lelkes, Vinh Q. Tran, Cong Yu

9. Recent Advances in Neural Question Generation. arXiv 2019 paper bib

   Liangming Pan, Wenqiang Lei, Tat-Seng Chua, Min-Yen Kan

10. Recent Advances in SQL Query Generation: A Survey. International Conference on Informatics and Information Technologies 2020 paper bib

    Jovan Kalajdjieski, Martina Toshevska, Frosina Stojanovska

11. Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation. Journal of Artificial Intelligence Research 2018 paper bib

    Albert Gatt,Emiel Krahmer

Information Extraction

1. A Survey of Deep Learning Methods for Relation Extraction. arXiv 2017 paper bib

   Shantanu Kumar

2. A Survey of Event Extraction From Text. IEEE 2019 paper bib

   Wei Xiang, Bang Wang

3. A Survey of event extraction methods from text for decision support systems. Decision Support Systems 2016 paper bib

   Frederik Hogenboom, Flavius Frasincar, Uzay Kaymak, Franciska de Jong, Emiel Caron

4. A Survey of Neural Network Techniques for Feature Extraction from Text. arXiv 2017 paper bib

   Vineet John

5. A Survey of Textual Event Extraction from Social Networks. LPKM 2017 paper bib

   Mohamed Mejri, Jalel Akaichi

6. A Survey on Open Information Extraction. COLING 2018 paper bib

   Christina Niklaus, Matthias Cetto, André Freitas, Siegfried Handschuh

7. A Survey on Temporal Reasoning for Temporal Information Extraction from Text (Extended Abstract). Journal of Artificial Intelligence Research 2019 paper bib

   Artuur Leeuwenberg, Marie-Francine Moens

8. An Overview of Event Extraction from Text. ISWC 2011 paper bib

   Frederik Hogenboom, Flavius Frasincar, Uzay Kaymak, and Franciska de Jong

9. Automatic Extraction of Causal Relations from Natural Language Texts: A Comprehensive Survey. arXiv 2016 paper bib

   Nabiha Asghar

10. Complex Relation Extraction: Challenges and Opportunities. arXiv 2020 paper bib

    Haiyun Jiang ,Qiaoben Bao ,Qiao Cheng

11. Content Selection in Data-to-Text Systems: A Survey. arXiv 2016 paper bib

    Dimitra Gkatzia

12. Keyphrase Generation: A Multi-Aspect Survey. FRUCT 2019 paper bib

    Erion Cano, Ondrej Bojar

13. More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction. arXiv 2020 paper bib

    Xu Han, Tianyu Gao, Yankai Lin, Hao Peng, Yaoliang Yang, Chaojun Xiao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

14. Neural relation extraction: a survey. arXiv 2020 paper bib

    Mehmet Aydar, Ozge Bozal, Furkan Ozbay

15. Relation Extraction : A Survey. arXiv 2017 paper bib

    Sachin Pawar, Girish K. Palshikar, Pushpak Bhattacharyya

16. Short Text Topic Modeling Techniques, Applications, and Performance: A Survey. arXiv 2019 paper bib

    Jipeng Qiang, Zhenyu Qian, Yun Li, Yunhao Yuan, Xindong Wu

17. Techniques for Jointly Extracting Entities and Relations: A Survey. arXiv 2021 paper bib

    Sachin Pawar, Pushpak Bhattacharyya, Girish K. Palshikar

Information Retrieval and Text Mining

1. A Brief Survey of Text Mining: Classification, Clustering and Extraction Techniques. arXiv 2017 paper bib

   Mehdi Allahyari, Seyed Amin Pouriyeh, Mehdi Assefi, Saied Safaei, Elizabeth D. Trippe, Juan B. Gutierrez, Krys Kochut

2. A survey of methods to ease the development of highly multilingual text mining applications. Language Resources and Evaluation 2012 paper bib

   Ralf Steinberger

3. Opinion Mining and Analysis: A survey. IJNLC 2013 paper bib

   Arti Buche, M. B. Chandak, Akshay Zadgaonkar

Interpretability and Analysis of Models for NLP

1. A Brief Survey and Comparative Study of Recent Development of Pronoun Coreference Resolution. arxiv 2020 paper bib

   Hongming Zhang, Xinran Zhao, Yangqiu Song

2. A Survey of the State of Explainable AI for Natural Language Processing. AACL-IJCNLP 2020 paper bib

   Marina Danilevsky, Kun Qian, Ranit Aharonov, Yannis Katsis, Ban Kawas, Prithviraj Sen

3. A Survey on Deep Learning and Explainability for Automatic Image-based Medical Report Generation. arXiv 2020 paper bib

   Pablo Messina, Pablo Pino, Denis Parra, Alvaro Soto, Cecilia Besa, Sergio Uribe, Marcelo andía, Cristian Tejos, Claudia Prieto, Daniel Capurro

4. Analysis Methods in Neural Language Processing: A Survey. NACCL 2018 paper bib

   Yonatan Belinkov, James R. Glass

5. Analyzing and Interpreting Neural Networks for NLP:A Report on the First BlackboxNLP Workshop. EMNLP 2019 paper bib

   Afra Alishahi, Grzegorz Chrupala, Tal Linzen

6. Beyond Leaderboards: A survey of methods for revealing weaknesses in Natural Language Inference data and models. arXiv 2020 paper bib

   Viktor Schlegel, Goran Nenadic, Riza Batista-Navarro

7. Visualizing Natural Language Descriptions: A Survey. ACM Computing Surveys 2016 paper bib

   Kaveh Hassani, Won-Sook Lee

8. When do Word Embeddings Accurately Reflect Surveys on our Beliefs About People?. ACL 2020 paper bib

   Kenneth Joseph, Jonathan H. Morgan

9. Which BERT? A Survey Organizing Contextualized Encoders. EMNLP 2020 paper bib

   Patrick Xia, Shijie Wu, Benjamin Van Durme

Knowledge Graph

1. A survey of embedding models of entities and relationships for knowledge graph completion. arXiv 2017 paper bib

   Dat Quoc Nguyen

2. A survey of techniques for constructing chinese knowledge graphs and their applications. Sustainability 2018 paper bib

   Tianxing Wu, Guilin Qi, Cheng Li, Meng Wang

3. A Survey on Graph Neural Networks for Knowledge Graph Completion. arXiv 2020 paper bib

   Siddhant Arora

4. A Survey on Knowledge Graphs: Representation, Acquisition and Applications. arXiv 2020 paper bib

   Shaoxiong Ji, Shirui Pan, Erik Cambria, Pekka Marttinen, Philip S. Yu

5. Knowledge Graph Embedding for Link Prediction: A Comparative Analysis. arXiv 2016 paper bib

   Andrea Rossi, Donatella Firmani, Antonio Matinata, Paolo Merialdo, Denilson Barbosa

6. Knowledge Graph Embedding: A Survey of Approaches and Applications. IEEE 2017 paper bib

   Quan Wang, Zhendong Mao, Bin Wang, Li Guo

7. Knowledge Graphs. arXiv 2020 paper bib

   Aidan Hogan, Eva Blomqvist, Michael Cochez, Claudia d'Amato, Gerard de Melo, Claudio Gutierrez, José Emilio Labra Gayo, Sabrina Kirrane, Sebastian Neumaier, Axel Polleres, Roberto Navigli, Axel-Cyrille Ngonga Ngomo, Sabbir M. Rashid, Anisa Rula, Lukas Schmelzeisen, Juan F. Sequeda, Steffen Staab, Antoine Zimmermann

8. Knowledge Graphs: An Information Retrieval Perspective. Foundations and Trends in Information Retrieval 2020 paper bib

   Ridho Reinanda, Edgar Meij, Maarten de

9. Survey and Open Problems in Privacy Preserving Knowledge Graph: Merging, Query, Representation, Completion and Applications. arXiv 2020 paper bib

   Chaochao Chen, Jamie Cui, Guanfeng Liu, Jia Wu, Li Wang

10. Survey on Domain Knowledge Graph Research. 计算机系统应用 2020 paper bib

    刘烨宸, 李华昱

Language Grounding to Vision and Robotics and Beyond

1. Emotionally-Aware Chatbots: A Survey. arXiv 2018 paper bib

   Endang Wahyu Pamungkas

2. Trends in Integration of Vision and Language Research: A Survey of Tasks, Datasets, and Methods. arXiv 2019 paper bib

   Aditya Mogadala, Marimuthu Kalimuthu, Dietrich Klakow

Linguistic Theories and Cognitive Modeling and Psycholinguistics

1. Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processing. Computational Linguistics 2019 paper bib

   Edoardo Maria Ponti, Helen O'Horan, Yevgeni Berzak, Ivan Vulic, Roi Reichart, Thierry Poibeau, Ekaterina Shutova, Anna Korhonen

2. Survey on the Use of Typological Information in Natural Language Processing. COLING 2016 paper bib

   Helen O'Horan, Yevgeni Berzak, Ivan Vulic, Roi Reichart, Anna Korhonen

Machine Learning for NLP

1. A comprehensive survey of mostly textual document segmentation algorithms since 2008. Pattern Recognition 2017 paper bib

   Sebastien Eskenazi, Petra Gomez-Krämer, Jean-Marc Ogier

2. A Primer on Neural Network Models for Natural Language Processing. Computer ence 2015 paper bib

   Yoav Goldberg

3. A Reproducible Survey on Word Embeddings and Ontology-based Methods for Word Similarity. Engineering Applications of Artificial Intelligence 2019 paper bib

   Juan J.Lastra-Díaz, Josu Goikoetxea, Mohamed Ali Hadj Taieb, Ana García-Serrano, Mohamed Ben Aouicha, Eneko Agirre

4. A Survey Of Cross-lingual Word Embedding Models. Journal of Artificial Intelligence Research 2019 paper bib

   Sebastian Ruder, Ivan Vulic, Anders Sogaard

5. A Survey of Neural Networks and Formal Languages. arXiv 2020 paper bib

   Joshua Ackerman, George Cybenko

6. A Survey of the Usages of Deep Learning in Natural Language Processing. IEEE 2018 paper bib

   Daniel W. Otter, Julian R. Medina, Jugal K. Kalita

7. A Survey on Contextual Embeddings. arXiv 2020 paper bib

   Qi Liu, Matt J. Kusner, Phil Blunsom

8. A Survey on Transfer Learning in Natural Language Processing. arXiv 2020 paper bib

   Alyafeai, Zaid and Alshaibani, Maged Saeed and Ahmad, Irfan

9. Adversarial Attacks and Defense on Texts: A Survey. arXiv 2020 paper bib

   Aminul Huq, Mst. Tasnim Pervin

10. Adversarial Attacks on Deep Learning Models in Natural Language Processing: A Survey. ACM Transactions on Information Systems 2019 paper bib

    Wei Emma Zhang, Quan Z Sheng, Ahoud Alhazmi, Chenliang Li

11. An Introductory Survey on Attention Mechanisms in NLP Problems. IntelliSys 2019 paper bib

    Dichao Hu

12. Analysis Methods in Neural Language Processing: A Survey. Transactions of the Association for Computational Linguistics 7 2019 paper bib

    Yonatan Belinkov, James Glass

13. Attention in Natural Language Processing. arXiv 2019 paper bib

    Andrea Galassi, Marco Lippi, Paolo Torroni

14. From static to dynamic word representations: a survey. International Journal of Machine Learning and Cybernetics 2020 paper bib

    Yuxuan Wang, Yutai Hou, Wanxiang Che, Ting Liu

15. From Word to Sense Embeddings: A Survey on Vector Representations of Meaning. Journal of Artificial Intelligence Research 2018 paper bib

    Jose Camachocollados, Mohammad Taher Pilehvar

16. Natural Language Processing Advancements By Deep Learning: A Survey. arXiv 2020 paper bib

    Amirsina Torfi, Rouzbeh A. Shirvani, Yaser Keneshloo, Nader Tavvaf, Edward A. Fox

17. Neural Network Models for Paraphrase Identification, Semantic Textual Similarity, Natural Language Inference, and Question Answering. COLING 2018 paper bib

    Wuwei Lan,Wei Xu

18. Recent Trends in Deep Learning Based Natural Language Processing. IEEE 2018 paper bib

    Tom Young, Devamanyu Hazarika, Soujanya Poria, Erik Cambria

19. Symbolic, Distributed and Distributional Representations for Natural Language Processing in the Era of Deep Learning: a Survey. Frontiers Robotics AI 2017 paper bib

    Lorenzo Ferrone, Fabio Massimo Zanzotto

20. Syntax Representation in Word Embeddings and Neural Networks -- A Survey. ITAT 2020 paper bib

    Tomasz Limisiewicz and David Marecek

21. Token-Modification Adversarial Attacks for Natural Language Processing: A Survey. arXiv 2021 paper bib

    Tom Roth, Yansong Gao, Alsharif Abuadbba, Surya Nepal, Wei Liu

22. Towards a Robust Deep Neural Network in Texts: A Survey. arXiv 2020 paper bib

    Wenqi Wang, Lina Wang, Run Wang, Zhibo Wang, Aoshuang Ye

23. Word Embeddings: A Survey. arXiv 2019 paper bib

    Felipe Almeida, Geraldo Xexeo

Machine Translation

1. A Brief Survey of Multilingual Neural Machine Translation. Computing surveys 2019 paper bib

   Raj Dabre, Chenhui Chu, Anoop Kunchukuttan

2. A Comprehensive Survey of Multilingual Neural Machine Translation. Under review at the computing surveys journal 2020 paper bib

   Raj Dabre, Chenhui Chu, Anoop Kunchukuttan

3. A Survey of Deep Learning Techniques for Neural Machine Translation. arXiv 2020 paper bib

   Shuoheng Yang, Yuxin Wang, Xiaowen Chu

4. A Survey of Domain Adaptation for Neural Machine Translation. COLING 2018 paper bib

   Chenhui Chu, Rui Wang

5. A Survey of Methods to Leverage Monolingual Data in Low-resource Neural Machine Translation. ICATHS 2019 paper bib

   Ilshat Gibadullin, Aidar Valeev, Albina Khusainova, Adil Mehmood Khan

6. A Survey of Multilingual Neural Machine Translation. Computing Surveys 2020 paper bib

   Raj Dabre, Chenhui Chu, Anoop Kunchukuttan

7. A Survey of Orthographic Information in Machine Translation. arXiv 2020 paper bib

   Bharathi Raja Chakravarthi, Priya Rani, Mihael Arcan, John P. McCrae

8. A Survey of Word Reordering in Statistical Machine Translation: Computational Models and Language Phenomena. Computational Linguistics 2016 paper bib

   Arianna Bisazza, Marcello Federico

9. A Survey on Document-level Machine Translation: Methods and Evaluation. under review at an international journal 2019 paper bib

   Sameen Maruf, Fahimeh Saleh, Gholamreza Haffari

10. Machine Translation Approaches and Survey for Indian Languages. Computational Linguistics 2017 paper bib

    Nadeem Jadoon Khan, Waqas Anwar, Nadir Durrani

11. Machine Translation Evaluation Resources and Methods: A Survey. arXiv 2016 paper bib

    Lifeng Han

12. Machine Translation using Semantic Web Technologies: A Survey. Journal of Web Semantics 2018 paper bib

    Diego Moussallem, Matthias Wauer, Axelcyrille Ngonga Ngomo

13. Machine-Translation History and Evolution: Survey for Arabic-English Translations. Current Journal of Applied Science & Technology 2017 paper bib

    Nabeel T. Alsohybe, Neama Abdulaziz Dahan, Fadl Mutaher Baalwi

14. Multimodal Machine Translation through Visuals and Speech. Springer 2019 paper bib

    Umut Sulubacak, Ozan Caglayan, Stig-Arne Gronroos, Aku Rouhe, Desmond Elliott, Lucia Specia, Jörg Tiedemann

15. Neural Machine Translation and Sequence-to-Sequence Models: A Tutorial. arXiv 2017 paper bib

    Graham Neubig

16. Neural Machine Translation: A Review. arXiv 2019 paper bib

    Felix Stahlberg

17. Neural Machine Translation: Challenges, Progress and Future. Science China Technological Sciences 2020 paper bib

    Jiajun Zhang, Chengqing Zong

18. The Query Translation Landscape: a Survey. arXiv 2019 paper bib

    Mohamed Nadjib Mami, Damien Graux, Harsh Thakkar, Simon Scerri, Soren Auer, Jens Lehmann

19. 神经机器翻译前沿综述. 中文信息学报 2020 paper bib

    冯洋， 邵晨泽

Natural Language Processing

1. A Survey and Classification of Controlled Natural Languages. Computational Linguistics 2014 paper bib

   Tobias Kuhn

2. A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios. arXiv 2020 paper bib

   Michael A. Hedderich, Lukas Lange, Heike Adel, Jannik Strötgen, Dietrich Klakow

3. Automatic Arabic Dialect Identification Systems for Written Texts: A Survey. arXiv 2020 paper bib

   Maha J. Althobaiti

4. Experience Grounds Language. arxiv 2020 paper bib

   Yonatan Bisk, Ari Holtzman, Jesse Thomason, Jacob Andreas, Yoshua Bengio, Joyce Chai, Mirella Lapata, Angeliki Lazaridou, Jonathan May, Aleksandr Nisnevich, Nicolas Pinto, Joseph Turian

5. Jumping NLP curves: A review of natural language processing research. IEEE 2014 paper bib

   Erik Cambria, Bebo White

6. Natural Language Processing - A Survey. arXiv 2012 paper bib

   Kevin Mote

7. Natural Language Processing: State of The Art, Current Trends and Challenges. arXiv 2017 paper bib

   Diksha Khurana, Aditya Koli, Kiran Khatter, Sukhdev Singh

8. Pre-trained Models for Natural Language Processing : A Survey. Science China Technological Sciences 2020 paper bib

   Xipeng Qiu, Tianxiang Sun, Yige Xu, Yunfan Shao, Ning Dai, Xuanjing Huang

9. Progress in Neural NLP: Modeling, Learning, and Reasoning. Engineering 2020 paper bib

   Ming Zhou, Nan Duan, Shujie Liu, Heung-Yeung Shum

10. Survey of Network Representation Learning. Computer Science 2020 paper bib

    Ding Yu, Wei Hao, Pan Zhi-Song, Liu Xin

NER

1. A survey of named entity recognition and classification. Computational Linguistics 2007 paper bib

   David Nadeau, Satoshi Sekine

2. A Survey of Named Entity Recognition in Assamese and other Indian Languages. arXiv 2014 paper bib

   Gitimoni Talukdar, Pranjal Protim Borah, Arup Baruah

3. A Survey on Deep Learning for Named Entity Recognition. arXiv 2018 paper bib

   Jing Li, Aixin Sun, Jianglei Han, Chenliang Li

4. A Survey on Recent Advances in Named Entity Recognition from Deep Learning models. COLING 2019 paper bib

   Vikas Yadav, Steven Bethard

5. Design Challenges and Misconceptions in Neural Sequence Labeling. COLING 2018 paper bib

   Jie Yang, Shuailong Liang, Yue Zhang

6. Neural Entity Linking: A Survey of Models based on Deep Learning. arXiv 2020 paper bib

   Ozge Sevgili, Artem Shelmanov, Mikhail Arkhipov, Alexander Panchenko, Chris Biemann

NLP Applications

1. A Comprehensive Survey of Grammar Error Correction. arXiv 2020 paper bib

   Yu Wang, Yuelin Wang, Jie Liu, Zhuo Liu

2. A Short Survey of Biomedical Relation Extraction Techniques. arXiv 2017 paper bib

   Elham Shahab

3. A survey of joint intent detection and slot-filling models in natural language understanding. arxiv 2021 paper bib

   H. Weld, X. Huang, S. Long, J. Poon, S. C. Han

4. A Survey on Assessing the Generalization Envelope of Deep Neural Networks at Inference Time for Image Classification. arXiv 2020 paper bib

   Julia Lust, Alexandru Paul Condurache

5. A survey on natural language processing (nlp) and applications in insurance. arxiv 2020 paper bib

   Antoine Ly, Benno Uthayasooriyar, Tingting Wang

6. A Survey on Natural Language Processing for Fake News Detection. LREC 2020 paper bib

   Ray Oshikawa, Jing Qian, William Yang Wang

7. A Survey on Stance Detection for Mis- and Disinformation Identification. arXiv 2021 paper bib

   Momchil Hardalov, Arnav Arora, Preslav Nakov, Isabelle Augenstein

8. A Survey on Text Simplification. arXiv 2020 paper bib

   Punardeep Sikka, Manmeet Singh, Allen Pink, Vijay Mago

9. Automatic Language Identification in Texts: A Survey. Journal of Artificial Intelligence Research 2019 paper bib

   Tommi Jauhiainen

10. Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspective. arxiv 2020 paper bib

    Svetlana Kiritchenko, Isar Nejadgholi, Kathleen C. Fraser

11. Data-Driven Sentence Simplification: Survey and Benchmark. Computational Lingus 2020 paper bib

    Fernando Alva-Manchego, Carolina Scarton, Lucia Specia

12. Disinformation Detection: A review of linguistic feature selection and classification models in news veracity assessments. arXiv 2019 paper bib

    Jillian Tompkins

13. Extraction and Analysis of Fictional Character Networks: A Survey. ACM Computing Surveys 2019 paper bib

    Xavier Bost (LIA), Vincent Labatut (LIA)

14. Fake News Detection using Stance Classification: A Survey. arXiv 2019 paper bib

    Anders Edelbo Lillie, Emil Refsgaard Middelboe

15. Fake News: A Survey of Research, Detection Methods, and Opportunities. ACM 2018 paper bib

    Xinyi Zhou, Reza Zafarani

16. Image Captioning based on Deep Learning Methods: A Survey. arXiv 2019 paper bib

    Yiyu Wang, Jungang Xu, Yingfei Sun, Ben He

17. Pretrained Transformers for Text Ranking: BERT and Beyond. arXiv 2020 paper bib

    Jimmy Lin, Rodrigo Nogueira, Andrew Yates

18. Putting Humans in the Natural Language Processing Loop: A Survey. arXiv 2021 paper bib

    Zijie J. Wang, Dongjin Choi, Shenyu Xu, Diyi Yang

19. Recent Neural Methods on Slot Filling and Intent Classification. arXiv 2020 paper bib

    Samuel Louvan, Bernardo Magnini

20. Referring Expression Comprehension: A Survey of Methods and Datasets. arXiv 2020 paper bib

    Yanyuan Qiao, Chaorui Deng, Qi Wu

21. SECNLP: A Survey of Embeddings in Clinical Natural Language Processing. Journal of Biomedical Informatics 2019 paper bib

    Kalyan KS, S Sangeetha

22. Survey of Text-based Epidemic Intelligence: A Computational Linguistic Perspective. ACM Computing Surveys 2019 paper bib

    Aditya Joshi, Sarvnaz Karimi, Ross Sparks, Cecile Paris, C Raina MacIntyre

23. Text Detection and Recognition in the Wild: A Review. arXiv 2020 paper bib

    Zobeir Raisi, Mohamed A. Naiel, Paul Fieguth, Steven Wardell, John Zelek

24. Text Recognition in the Wild: A Survey. arXiv 2020 paper bib

    Xiaoxue Chen, Lianwen Jin, Yuanzhi Zhu, Canjie Luo, Tianwei Wang

25. The Potential of Machine Learning and NLP for Handling Students' Feedback (A Short Survey). arxiv 2020 paper bib

    Maryam Edalati

26. Topic Modelling Meets Deep Neural Networks: A Survey. arXiv 2021 paper bib

    He Zhao, Dinh Phung, Viet Huynh, Yuan Jin, Lan Du, Wray Buntine

27. Towards Improved Model Design for Authorship Identification: A Survey on Writing Style Understanding. arxiv 2020 paper bib

    Weicheng Ma, Ruibo Liu, Lili Wang, Soroush Vosoughi

Question Answering

1. A Survey on Complex Question Answering over Knowledge Base: Recent Advances and Challenges. arXiv 2020 paper bib

   Bin Fu, Yunqi Qiu, Chengguang Tang, Yang Li, Haiyang Yu, Jian Sun

2. A survey on question answering technology from an information retrieval perspective. Information ences 2011 paper bib

   Oleksandr Kolomiyets, Marie-Francine Moens

3. A Survey on Why-Type Question Answering Systems. arXiv 2019 paper bib

   Manvi Breja, Sanjay Kumar Jain

4. Core techniques of question answering systems over knowledge bases: a survey. Knowledge and Information Systems 2017 paper bib

   Dennis Diefenbach, Vanessa Lopez, Kamal Singh & Pierre Maret

5. Introduction to Neural Network based Approaches for Question Answering over Knowledge Graphs. arXiv 2019 paper bib

   Nilesh Chakraborty,Denis Lukovnikov,Gaurav Maheshwari,Priyansh Trivedi,Jens Lehmann,Asja Fischer

6. Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering. arxiv 2021 paper bib

   Fengbin Zhu, Wenqiang Lei, Chao Wang, Jianming Zheng, Soujanya Poria, Tat-Seng Chua

7. Survey of Visual Question Answering: Datasets and Techniques. arXiv 2017 paper bib

   Akshay Kumar Gupta

8. Text-based Question Answering from Information Retrieval and Deep Neural Network Perspectives: A Survey. arXiv 2020 paper bib

   Zahra Abbasiyantaeb, Saeedeh Momtazi

9. Tutorial on Answering Questions about Images with Deep Learning. Summer School on Integrating Vision and Language: Deep Learning 2016 paper bib

   Mateusz Malinowski, Mario Fritz

10. Visual Question Answering using Deep Learning: A Survey and Performance Analysis. arXiv 2019 paper bib

    Yash Srivastava, Vaishnav Murali, Shiv Ram Dubey, Snehasis Mukherjee

Reading Comprehension

1. A Survey on Explainability in Machine Reading Comprehension. arxiv 2020 paper bib

   Mokanarangan Thayaparan, Marco Valentino, André Freitas

2. A Survey on Machine Reading Comprehension Systems. arXiv 2020 paper bib

   Razieh Baradaran, Razieh Ghiasi, Hossein Amirkhani

3. A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics, and Benchmark Datasets. arXiv 2020 paper bib

   Chengchang Zeng, Shaobo Li, Qin Li, Jie Hu, Jianjun Hu

4. A Survey on Neural Machine Reading Comprehension. arXiv 2019 paper bib

   Boyu Qiu, Xu Chen, Jungang Xu, Yingfei Sun

5. English Machine Reading Comprehension Datasets: A Survey. arXiv 2021 paper bib

   Daria Dzendzik, Carl Vogel, Jennifer Foster

6. Machine Reading Comprehension: a Literature Review. arXiv 2019 paper bib

   Xin Zhang, An Yang, Sujian Li, Yizhong Wang

7. Machine Reading Comprehension: The Role of Contextualized Language Models and Beyond. Computational Linguistics 2020 paper bib

   Zhuosheng Zhang, Hai Zhao, Rui Wang

8. Neural Machine Reading Comprehension: Methods and Trends. Applied ences 2019 paper bib

   Shanshan Liu, Xin Zhang, Sheng Zhang, Hui Wang, Weiming Zhang

Recommender Systems

1. A review on deep learning for recommender systems: challenges and remedies. Artificial Intelligence Review 2019 paper bib

   Zeynep Batmaz, Ali Yurekli, Alper Bilge, Cihan Kaleli

2. A Survey on Knowledge Graph-Based Recommender Systems. arXiv 2020 paper bib

   Qingyu Guo, Fuzhen Zhuang, Chuan Qin, Hengshu Zhu, Xing Xie, Hui Xiong, Qing He

3. A Survey on Personality-Aware Recommendation Systems Recommender Systems. arxiv 2021 paper bib

   Sahraoui Dhelim, Nyothiri Aung, Mohammed Amine Bouras, Huansheng Ning, Erik Cambria

4. Advances and Challenges in Conversational Recommender Systems: A Survey. arxiv 2021 paper bib

   Chongming Gao, Wenqiang Lei, Xiangnan He, Maarten de Rijke, Tat-Seng Chua

5. Adversarial Machine Learning in Recommender Systems:State of the art and Challenges. arXiv 2020 paper bib

   Yashar Deldjoo, Tommaso Di Noia, Felice Antonio Merra

6. Are We Really Making Progress? A Worrying Analysis of Neural Recommendation Approaches. Proceedings of the 13th ACM Conference on Recommender Systems 2019 paper bib

   Dacrema Maurizio Ferrari, Paolo Cremonesi, Dietmar Jannach

7. Bias and Debias in Recommender System: A Survey and Future Directions. TKDE journal 2020 paper bib

   Jiawei Chen, Hande Dong, Xiang Wang, Fuli Feng, Meng Wang, Xiangnan He

8. Content-based Recommender Systems：State of the Art and Trends. Recommender systems handbook 2011 paper bib

   Pasquale Lops, Marco de GemmisGiovanni Semeraro

9. Cross Domain Recommender Systems: A Systematic Literature Review. ACM Computing Surveys 2017 paper bib

   Muhammad Murad Khan,Roliana Ibrahim,Imran Ghani

10. Deep Learning based Recommender System: A Survey and New Perspectives. ACM Computing Surveys 2019 paper bib

    Shuai Zhang, Lina Yao, Aixin Sun, Yi Tay

11. Deep Learning on Knowledge Graph for Recommender System: A Survey. arXiv 2020 paper bib

    Yang Gao, Yi-Fan Li, Yu Lin, Hang Gao, Latifur Khan

12. Diversity in Recommender Systems – A survey. Knowledge-based systems 2017 paper bib

    Matevž Kunavera, Tomaž Požrl

13. Explainable Recommendation: A Survey and New Perspectives. Foundations and Trends in Information Retrieval 2020 paper bib

    Yongfeng Zhang, Xu Chen

14. Graph Neural Networks in Recommender Systems: A Survey. arXiv 2020 paper bib

    Shiwen Wu, Wentao Zhan, Fei Su, Bin Cui

15. Hybrid Recommender Systems：Survey and Experiments. User modeling and user-adapted interaction 2002 paper bib

    Robin Burke

16. Recommender systems survey. Knowledge-based systems 2013 paper bib

    Bobadilla J., Ortega F., Hernando A., Gutiérrez A.

17. Sequence-Aware Recommender Systems. ACM Computing Surveys 2018 paper bib

    Massimo Quadrana,Paolo Cremonesi,Dietmar Jannach

18. Toward the next generation of recommender systems：a survey of the state-of-the-art and possible extensions. IEEE transactions on knowledge and data engineering 2005 paper bib

    G. Adomavicius, A. Tuzhilin

19. Transfer Learning in Deep Reinforcement Learning: A Survey. arXiv 2020 paper bib

    Zhuangdi Zhu, Kaixiang Lin, Jiayu Zhou

20. Trust in Recommender Systems: A Deep Learning Perspective. arXiv 2020 paper bib

    Manqing Dong, Feng Yuan, Lina Yao, Xianzhi Wang, Xiwei Xu, Liming Zhu

21. Use of Deep Learning in Modern Recommendation System: A Summary of Recent Works. International Journal of Computer Applications 2017 paper bib

    Ayush Singhal, Pradeep Sinha, Rakesh Pant

Resources and Evaluation

1. A Short Survey on Sense-Annotated Corpora. International Conference on Language Resources and Evaluation 2020 paper bib

   Tommaso Pasini, José Camacho-Collados

2. A Survey of Current Datasets for Vision and Language Research. EMNLP 2015 paper bib

   Francis Ferraro, Nasrin Mostafazadeh, Ting-Hao (Kenneth) Huang, Lucy Vanderwende, Jacob Devlin, Michel Galley, Margaret Mitchell

3. A Survey of Evaluation Metrics Used for NLG Systems. arXiv 2020 paper bib

   Ananya B. Sai, Akash Kumar Mohankumar, Mitesh M. Khapra

4. A Survey of Word Embeddings Evaluation Methods. arXiv 2018 paper bib

   Amir Bakarov

5. A Survey on Recognizing Textual Entailment as an NLP Evaluation. EMNLP 2020 paper bib

   Adam Poliak

6. Corpora Annotated with Negation: An Overview. Computational Lingus 2020 paper bib

   Salud María Jiménez-Zafra，Roser Morante，María Teresa Martín-Valdivia，L. Alfonso Ureña-López

7. Critical Survey of the Freely Available Arabic Corpora. International Conference on Language Resources and Evaluation 2017 paper bib

   Wajdi Zaghouani

8. Distributional Measures of Semantic Distance: A Survey. arXiv 2012 paper bib

   Saif Mohammad, Graeme Hirst

9. Measuring Sentences Similarity: A Survey. Indian Journal of Science and Technology 2019 paper bib

   Mamdouh Farouk

10. Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approaches. JAIR 2020 paper bib

    Shane Storks, Qiaozi Gao, Joyce Y. Chai

11. Survey on Evaluation Methods for Dialogue Systems. Artificial Intelligence Review 2019 paper bib

    Jan Deriu, Alvaro Rodrigo, Arantxa Otegi, Guillermo Echegoyen, Sophie Rosset, Eneko Agirre, Mark Cieliebak

12. Survey on Publicly Available Sinhala Natural Language Processing Tools and Research. arXiv 2019 paper bib

    Nisansa de Silva

Semantics

1. A survey of loss functions for semantic segmentation. arXiv 2020 paper bib

   Shruti Jadon

2. A Survey of Syntactic-Semantic Parsing Based on Constituent and Dependency Structures. arxiv 2020 paper bib

   Meishan Zhang

3. Diachronic word embeddings and semantic shifts: a survey. COLING 2018 paper bib

   Andrey Kutuzov, Lilja Ovrelid, Terrence Szymanski, Erik Velldal

4. Evolution of Semantic Similarity -- A Survey. ACM Computing Surveys 2020 paper bib

   Dhivya Chandrasekaran, Vijay Mago

5. Semantic search on text and knowledge bases. Foundations and trends in information retrieval 2016 paper bib

   Hannah Bast , Bjorn Buchhold, Elmar Haussmann

6. Semantics, Modelling, and the Problem of Representation of Meaning -- a Brief Survey of Recent Literature. arXiv 2014 paper bib

   Yarin Gal

7. Survey of Computational Approaches to Lexical Semantic Change. arXiv 2019 paper bib

   Nina Tahmasebi, Lars Borin, Adam Jatowt

8. The Knowledge Acquisition Bottleneck Problem in Multilingual Word Sense Disambiguation. IJCAI 2020 paper bib

   Tommaso Pasini

9. Word sense disambiguation: a survey. International Journal of Control Theory and Computer Modeling 2015 paper bib

   Alok Ranjan Pal, Diganta Saha

Sentiment Analysis and Stylistic Analysis and Argument Mining

1. A Comprehensive Survey on Aspect Based Sentiment Analysis. arXiv 2020 paper bib

   Kaustubh Yadav

2. A Survey on Sentiment and Emotion Analysis for Computational Literary Studies. ZFDG 2018 paper bib

   Evgeny Kim, Roman Klinger

3. An Empirical Survey of Unsupervised Text Representation Methods on Twitter Data. EMNLP 2020 paper bib

   Lili Wang, Chongyang Gao, Jason Wei, Weicheng Ma, Ruibo Liu, Soroush Vosoughi

4. Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research. arXiv 2020 paper bib

   Soujanya Poria, Devamanyu Hazarika, Navonil Majumder, Rada Mihalcea

5. Deep Learning for Aspect-Level Sentiment Classification: Survey, Vision, and Challenges. IEEE 2019 paper bib

   Jie Zhou, Jimmy Xiangji Huang, Qin Chen, Qinmin Vivian Hu, Tingting Wang, Liang He

6. Deep Learning for Sentiment Analysis : A Survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge 2018 paper bib

   Lei Zhang, Shuai Wang, Bing Liu

7. Sentiment analysis for Arabic language: A brief survey of approaches and techniques. arXiv 2018 paper bib

   Mo'ath Alrefai, Hossam Faris, Ibrahim Aljarah

8. Sentiment Analysis of Czech Texts: An Algorithmic Survey. International Conference on Agents and Artificial Intelligence 2019 paper bib

   Erion Cano, Ondřej Bojar

9. Sentiment Analysis of Twitter Data: A Survey of Techniques. International Journal of Computer Applications 2016 paper bib

   Vishal.A.Kharde, Prof. Sheetal.Sonawane

10. Sentiment Analysis on YouTube: A Brief Survey. MAGNT Research Report 2015 paper bib

    Muhammad Zubair Asghar, Shakeel Ahmad, Afsana Marwat, Fazal Masud Kundi

11. Sentiment/Subjectivity Analysis Survey for Languages other than English. Social Network Analysis & Mining 2016 paper bib

    Mohammed Korayem, Khalifeh Aljadda, David Crandall

12. Word Embeddings for Sentiment Analysis: A Comprehensive Empirical Survey. arXiv 2019 paper bib

    Erion Cano, Maurizio Morisio

Sentiment Analysis, Stylistic Analysis, and Argument Mining

1. Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advances. IEEE Access 2019 paper bib

   Soujanya Poria, Navonil Majumder, Rada Mihalcea, Eduard Hovy

Speech and Multimodality

1. A Comprehensive Survey on Cross-modal Retrieval. arXiv 2016 paper bib

   Kaiye Wang

2. A Multimodal Memes Classification: A Survey and Open Research Issues. arXiv 2020 paper bib

   Tariq Habib Afridi, Aftab Alam, Muhammad Numan Khan, Jawad Khan, Young-Koo Lee

3. A Survey and Taxonomy of Adversarial Neural Networks for Text-to-Image Synthesis. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 2019 paper bib

   Jorge Agnese, Jonathan Herrera, Haicheng Tao, Xingquan Zhu

4. A Survey of Code-switched Speech and Language Processing. Elsevier 2019 paper bib

   Sunayana Sitaram, Khyathi Raghavi Chandu, Sai Krishna Rallabandi, Alan W. Black

5. A Survey of Deep Learning Approaches for OCR and Document Understanding. arXiv 2020 paper bib

   Nishant Subramani, Alexandre Matton, Malcolm Greaves, Adrian Lam

6. A Survey of Recent DNN Architectures on the TIMIT Phone Recognition Task. TSD 2018 paper bib

   Josef Michalek, Jan Vanek

7. A Survey of Voice Translation Methodologies - Acoustic Dialect Decoder. International Conference on Information 2016 paper bib

   Hans Krupakar, Keerthika Rajvel, Bharathi B, Angel Deborah S, Vallidevi Krishnamurthy

8. A Survey on Spoken Language Understanding: Recent Advances and New Frontiers. arXiv 2021 paper bib

   Libo Qin, Tianbao Xie, Wanxiang Che, Ting Liu

9. Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures. IJCAI 2017 paper bib

   Raffaella Bernardi, Ruket Cakici, Desmond Elliott, Aykut Erdem, Erkut Erdem, Nazli Ikizler-Cinbis, Frank Keller, Adrian Muscat, Barbara Plank

10. Informed Machine Learning -- A Taxonomy and Survey of Integrating Knowledge into Learning Systems. arXiv 2019 paper bib

    Laura von Rueden, Sebastian Mayer, Katharina Beckh, Bogdan Georgiev, Sven Giesselbach, Raoul Heese, Birgit Kirsch, Julius Pfrommer, Annika Pick, Rajkumar Ramamurthy, Michal Walczak, Jochen Garcke, Christian Bauckhage, Jannis Schuecker

11. Multimodal Intelligence: Representation Learning, Information Fusion, and Applications. arXiv 2020 paper bib

    Chao Zhang,Zichao Yang,Xiaodong He,Li Deng

12. Multimodal Machine Learning: A Survey and Taxonomy. IEEE 2019 paper bib

    Tadas Baltrusaitis, Chaitanya Ahuja, Louis-Philippe Morency

13. Perspectives and Prospects on Transformer Architecture for Cross-Modal Tasks with Language and Vision. arXiv 2021 paper bib

    Andrew Shin, Masato Ishii, Takuya Narihira

14. Speech and Language Processing. Speech and language processing 2019 paper bib

    Dan Jurafsky and James H. Martin

15. Thank you for Attention: A survey on Attention-based Artificial Neural Networks for Automatic Speech Recognition. arXiv 2021 paper bib

    Priyabrata Karmakar, Shyh Wei Teng,Guojun Lu

Summarization

1. A Survey of the State-of-the-Art Models in Neural Abstractive Text Summarization. IEEE Access 2021 paper bib

   Ayesha Ayub Syed, Ford Lumban Gaol, Tokuro Matsuo

2. A Survey on Neural Network-Based Summarization Methods. arXiv 2018 paper bib

   Yue Dong

3. Abstractive Summarization: A Survey of the State of the Art. AAAI 2019 paper bib

   Hui Lin, Vincent Ng

4. Automated text summarisation and evidence-based medicine: A survey of two domains. arXiv 2017 paper bib

   Abeed Sarker, Diego Molla Aliod, Cecile Paris

5. Automatic Keyword Extraction for Text Summarization: A Survey. arXiv 2017 paper bib

   Santosh Kumar Bharti, Korra Sathya Babu

6. Automatic summarization of scientific articles: A survey. Journal of King Saud University-Computer and Information Sciences 2020 paper bib

   Nouf Ibrahim Altmami, Mohamed El Bachir Menai

7. Deep Learning Based Abstractive Text Summarization: Approaches, Datasets, Evaluation Measures, and Challenges. Mathematical Problems in Engineering 2020 paper bib

   Dima Suleiman, Arafat Awajan

8. From Standard Summarization to New Tasks and Beyond: Summarization with Manifold Information. IJCAI 2020 paper bib

   Shen Gao, Xiuying Chen, Zhaochun Ren, Dongyan Zhao, Rui Yan

9. How to Evaluate a Summarizer: Study Design and Statistical Analysis for Manual Linguistic Quality Evaluation. EACL 2021 paper bib

   Julius Steen,.Katja Markert

10. Neural Abstractive Text Summarization with Sequence-to-Sequence Models: A Survey. arXiv 2018 paper bib

    Tian Shi, Yaser Keneshloo, Naren Ramakrishnan, Chandan K. Reddy

11. Recent automatic text summarization techniques: a survey. Artificial Intelligence Review 2016 paper bib

    Mahak Gambhir, Vishal Gupta

12. Text Summarization Techniques: A Brief Survey. IJCAI 2017 paper bib

    Mehdi Allahyari, Seyedamin Pouriyeh, Mehdi Assefi, Saeid Safaei, Elizabeth D. Trippe, Juan B. Gutierrez, Krys Kochut

13. Multi-document Summarization via Deep Learning Techniques: A Survey. arxiv 2020 paper bib

    Congbo Ma, Wei Emma Zhang, Mingyu Guo, Hu Wang, Quan Z. Sheng

Syntax: Tagging, Chunking, Syntax and Parsing

1. A Neural Entity Coreference Resolution Review. arXiv 2019 paper bib

   Nikolaos Stylianou, Ioannis Vlahavas

2. A survey of cross-lingual features for zero-shot cross-lingual semantic parsing. arXiv 2019 paper bib

   Jingfeng Yang, Federico Fancellu, Bonnie L. Webber

3. A Survey on Recent Advances in Sequence Labeling from Deep Learning Models. arXiv 2020 paper bib

   Zhiyong He, Zanbo Wang, Wei Wei, Shanshan Feng, Xianling Mao, Sheng Jiang

4. A Survey on Semantic Parsing. AKBC 2019 paper bib

   Aishwarya Kamath, Rajarshi Das

5. Syntax Representation in Word Embeddings and Neural Networks -- A Survey. arxiv 2020 paper bib

   Tomasz Limisiewicz, David Mareček

6. The Gap of Semantic Parsing: A Survey on Automatic Math Word Problem Solvers. IEEE 2018 paper bib

   Dongxiang Zhang, Lei Wang, Nuo Xu, Bing Tian Dai, Heng Tao Shen

Text Classification

1. A Survey of Active Learning for Text Classification using Deep Neural Networks. arXiv 2020 paper bib

   Christopher Schroder, Andreas Niekler

2. A Survey of Naïve Bayes Machine Learning approach in Text Document Classification. International Journal of Computer ence and Information Security 2010 paper bib

   K. A. Vidhya, G. Aghila

3. A survey on phrase structure learning methods for text classification. International Journal on Natural Language Computing 2014 paper bib

   Reshma Prasad, Mary Priya Sebastian

4. A Survey on Text Classification: From Shallow to Deep Learning. arXiv 2020 paper bib

   Qian Li, Hao Peng, Jianxin Li, Congyin Xia, Renyu Yang

5. Deep Learning Based Text Classification: A Comprehensive Review. arXiv 2020 paper bib

   Shervin Minaee, Nal Kalchbrenner, Erik Cambria, Narjes Nikzad, Meysam Chenaghlu, Jianfeng Gao

6. Text Classification Algorithms: A Survey. Information 2019 paper bib

   Kamran Kowsari, Kiana Jafari Meimandi, Mojtaba Heidarysafa, Sanjana Mendu, Laura E. Barnes, Donald E. Brown

The MT Paper List

Architectures

1. A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects. arXiv 2020 paper bib

   Zewen Li, Wenjie Yang, Shouheng Peng, Fan Liu

2. A Survey of End-to-End Driving: Architectures and Training Methods. arXiv 2020 paper bib

   Ardi Tampuu, Maksym Semikin, Naveed Muhammad, Dmytro Fishman, Tambet Matiisen

3. A Survey on Latent Tree Models and Applications. Journal of Artificial Intelligence Research 2013 paper bib

   Raphaël Mourad, Christine Sinoquet, Nevin L. Zhang, Tengfei Liu, Philippe Leray

4. A Survey on Visual Transformer. arXiv 2020 paper bib

   Kai Han, Yunhe Wang, Hanting Chen

5. An Attentive Survey of Attention Models. IJCAI 2019 paper bib

   Sneha Chaudhari, Gungor Polatkan, Rohan Ramanath, Varun Mithal

6. Binary Neural Networks: A Survey. Pattern Recognition 2020 paper bib

   Haotong Qin, Ruihao Gong, Xianglong Liu, Xiao Bai, Jingkuan Song, Nicu Sebe

7. Deep Echo State Network (DeepESN): A Brief Survey. arXiv 2017 paper bib

   Claudio Gallicchio, Alessio Micheli

8. Efficient Transformers: A Survey. arXiv 2020 paper bib

   Yi Tay, Mostafa Dehghani, Dara Bahri, Donald Metzler

9. Recent Advances in Convolutional Neural Networks. Computer ence 2018 paper bib

   Jiuxiang Gu, Zhenhua Wang, Jason Kuen, Lianyang Ma, Amir Shahroudy, Bing Shuai, Ting Liu, Xingxing Wang, Gang Wang, Jianfei Cai, Tsuhan Chen

10. Sum-product networks: A survey. IEEE 2020 paper bib

    Iago Paris, Raquel Sanchez-Cauce, Francisco Javier Díez

11. Survey on the attention based RNN model and its applications in computer vision. arXiv 2016 paper bib

    Feng Wang, David M. J. Tax

12. Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks. arXiv 2019 paper bib

    Ralf C. Staudemeyer, Eric Rothstein Morris

AutoML

1. A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions. arXiv 2020 paper bib

   Pengzhen Ren, Yun Xiao, Xiaojun Chang, Po-Yao Huang, Zhihui Li, Xiaojiang Chen, Xin Wang

2. A Comprehensive Survey on Hardware-Aware Neural Architecture Search. arXiv 2021 paper bib

   Hadjer Benmeziane, Kaoutar El Maghraoui, Hamza Ouarnoughi, Smail Niar, Martin Wistuba, Naigang Wang

3. A Survey on Neural Architecture Search. arXiv 2019 paper bib

   Martin Wistuba, Ambrish Rawat, Tejaswini Pedapati

4. AutoML: A Survey of the State-of-the-Art. Knowledge Based Systems 2019 paper bib

   Xin He, Kaiyong Zhao, Xiaowen Chu

5. Benchmark and Survey of Automated Machine Learning Frameworks. Journal of Artificial Intelligence Research 2020 paper bib

   Marc-Andre Zoller, Marco F. Huber

6. Neural Architecture Search: A Survey. Journal of Machine Learning Research 2019 paper bib

   Thomas Elsken, Jan Hendrik Metzen, Frank Hutter

Bayesian Methods

1. A survey of non-exchangeable priors for Bayesian nonparametric models. IEEE 2015 paper bib

   Nicholas J. Foti, Sinead Williamson

2. A Survey on Bayesian Deep Learning. ACM Computing Surveys 2020 paper bib

   Hao Wang, Dit-Yan Yeung

3. Bayesian Neural Networks: An Introduction and Survey. arXiv 2020 paper bib

   Ethan Goan, Clinton Fookes

4. Bayesian Nonparametric Space Partitions: A Survey. arXiv 2020 paper bib

   Xuhui Fan, Bin Li, Ling Luo, Scott A. Sisson

5. Deep Bayesian Active Learning, A Brief Survey on Recent Advances. arxiv 2020 paper bib

   Salman Mohamadi, Hamidreza Amindavar

6. Taking the Human Out of the Loop：A Review of Bayesian Optimization. Proceedings of the IEEE 2015 paper bib

   Bobak Shahriari, Kevin Swersky, Ziyu Wang, Ryan P. Adams, Nando de Freitas

7. Towards Bayesian Deep Learning: A Survey. arXiv 2016 paper bib

   Hao Wang, Dityan Yeung

Classification Clustering and Regression

1. A continual learning survey: Defying forgetting in classification tasks. arXiv 2019 paper bib

   M De Lange，R Aljundi，M Masana，S Parisot，X Jia，A Leonardis，G Slabaugh，T Tuytelaars

2. A Survey of Classification Techniques in the Area of Big Data. arXiv 2015 paper bib

   Praful Koturwar, Sheetal Girase, Debajyoti Mukhopadhyay

3. A Survey of Constrained Gaussian Process Regression: Approaches and Implementation Challenges. arXiv 2020 paper bib

   Laura P. Swiler, Mamikon Gulian, Ari Frankel, Cosmin Safta, John D. Jakeman

4. A Survey on Multi-View Clustering. arXiv 2017 paper bib

   Guoqing Chao, Shiliang Sun, Jinbo Bi

5. Adversarial Machine Learning in Image Classification: A Survey Towards the Defender's Perspective. arXiv 2020 paper bib

   Gabriel Resende Machado, Eugênio Silva, Ronaldo Ribeiro Goldschmidt

6. Comprehensive Comparative Study of Multi-Label Classification Methods. arXiv 2021 paper bib

   Jasmin Bogatinovski, Ljupčo Todorovski, Sašo Džeroski, Dragi Kocev

7. Deep learning for time series classification: a review. Data Mining & Knowledge Discovery 2019 paper bib

   Hassan Ismail Fawaz, Germain Forestier, Jonathan Weber, Lhassane Idoumghar, Pierre-Alain Muller

8. How Complex is your classification problem? A survey on measuring classification complexity. ACM 2019 paper bib

   Ana Carolina Lorena, Luis P F Garcia, Jens Lehmann, Marcilio C P Souto, Tin K Ho

Curriculum Learning

1. A Comprehensive Survey on Curriculum Learning. arXiv 2020 paper bib

   Xin Wang，Yudong Chen，Wenwu Zhu

2. Automatic Curriculum Learning For Deep RL: A Short Survey. IJCAI 2020 paper bib

   Remy Portelas, Cedric Colas, Lilian Weng, Katja Hofmann, Pierre-Yves Oudeyer

3. Curriculum Learning for Reinforcement Learning Domains: A Framework and Survey. arXiv 2020 paper bib

   Sanmit Narvekar, Bei Peng, Matteo Leonetti, Jivko Sinapov, Matthew E. Taylor, Peter Stone

4. Curriculum Learning: A Survey. arxiv 2021 paper bib

   Petru Soviany, Radu Tudor Ionescu, Paolo Rota, Nicu Sebe

Data Augmentation

1. A survey on Image Data Augmentation for Deep Learning. Journal of Big Data 2019 paper bib

   Connor Shorten

2. An Empirical Survey of Data Augmentation for Time Series Classification with Neural Networks. arXiv 2020 paper bib

   Brian Kenji Iwana, Seiichi Uchida

3. Time Series Data Augmentation for Deep Learning: A Survey. arXiv 2020 paper bib

   Qingsong Wen, Liang Sun, Xiaomin Song, Jingkun Gao, Xue Wang, Huan Xu

Deep Learning

1. A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives. arXiv 2021 paper bib

   Nils Rethmeier, Isabelle Augenstein

2. A Review of Binarized Neural Networks. Electronics 2019 paper bib

   Taylor Simons，Dah-Jye Lee

3. A State-of-the-Art Survey on Deep Learning Theory and Architectures. mdpi 2019 paper bib

   Alom, Md Zahangir and Taha, Tarek M and Yakopcic, Chris and Westberg, Stefan and Sidike, Paheding and Nasrin, Mst Shamima and Hasan, Mahmudul and Van Essen, Brian C and Awwal, Abdul AS and Asari, Vijayan K

4. A Survey of Deep Active Learning. arXiv 2020 paper bib

   Pengzhen Ren, Yun Xiao, Xiaojun Chang, Po-Yao Huang, Zhihui Li, Xiaojiang Chen, Xin Wang

5. A Survey of Deep Learning for Data Caching in Edge Network. arXiv 2020 paper bib

   Yantong Wang, Vasilis Friderikos

6. A Survey of Deep Learning for Scientific Discovery. arXiv 2020 paper bib

   Raghu M, Schmidt E

7. A Survey of Label-noise Representation Learning: Past, Present and Future. arXiv 2020 paper bib

   Bo Han, Quanming Yao, Tongliang Liu, Gang Niu, Ivor W. Tsang, James T. Kwok, Masashi Sugiyama

8. A Survey of Learning Causality with Data: Problems and Methods. ACM 2020 paper bib

   Ruocheng Guo, Lu Cheng, Jundong Li, P. Richard Hahn, Huan Liu

9. A survey of loss functions for semantic segmentation. IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology 2020 paper bib

   Shruti Jadon

10. A Survey of Neuromorphic Computing and Neural Networks in Hardware. arXiv 2017 paper bib

    Catherine D. Schuman, Thomas E. Potok, Robert M. Patton, J. Douglas Birdwell, Mark E. Dean, Garrett S. Rose, James S. Plank

11. A Survey On (Stochastic Fractal Search) Algorithm. arXiv 2021 paper bib

    Mohammed ElKomy

12. A Survey on Concept Factorization: From Shallow to Deep Representation Learning. arXiv 2020 paper bib

    Zhao Zhang, Yan Zhang, Li Zhang, Shuicheng Yan

13. A Survey on Contrastive Self-supervised Learning. arXiv 2020 paper bib

    Ashish Jaiswal, Ashwin Ramesh Babu, Mohammad Zaki Zadeh, Debapriya Banerjee, Fillia Makedon

14. A Survey on Deep Hashing Methods. arXiv 2020 paper bib

    Xiao Luo, Chong Chen, Huasong Zhong, Hao Zhang, Minghua Deng, Jianqiang Huang, Xiansheng Hua

15. A Survey on Dynamic Network Embedding. IEEE Conference on Computer Vision and Pattern Recognition 2020 paper bib

    Yu Xie, Chunyi Li, Bin Yu, Chen Zhang, Zhouhua Tang

16. A survey on modern trainable activation functions. arXiv 2020 paper bib

    Andrea Apicella, Francesco Donnarumma, Francesco Isgrò, Roberto Prevete

17. A Survey on Understanding, Visualizations, and Explanation of Deep Neural Networks. arXiv 2021 paper bib

    Atefeh Shahroudnejad

18. Aesthetics, Personalization and Recommendation: A survey on Deep Learning in Fashion. arXiv 2021 paper bib

    Wei Gong, Laila Khalid

19. Are deep learning models superior for missing data imputation in large surveys? Evidence from an empirical comparison. arXiv 2021 paper bib

    Zhenhua Wang, Olanrewaju Akande, Jason Poulos, Fan Li

20. Big Networks: A Survey. arXiv 2020 paper bib

    Hayat Dino Bedru, Shuo Yu, Xinru Xiao, Da Zhang, Liangtian Wan, He Guo, Feng Xia

21. Class-incremental learning: survey and performance evaluation. arXiv 2020 paper bib

    M Masana, X Liu, B Twardowski, M Menta, JVD Weijer

22. Continual Lifelong Learning in Natural Language Processing: A Survey. COLING 2020 paper bib

    Magdalena Biesialska, Katarzyna Biesialska, Marta R. Costa-jussà

23. Continual Lifelong Learning with Neural Networks: A Review. arXiv 2018 paper bib

    German Ignacio Parisi, Ronald Kemker, Jose L. Part, Christopher Kanan, Stefan Wermter

24. Contrastive Representation Learning: A Framework and Review. IEEE 2020 paper bib

    Phuc H. Le-Khac, Graham Healy, Alan F. Smeaton

25. Convergence of Edge Computing and Deep Learning: A Comprehensive Survey. IEEE 2020 paper bib

    Xiaofei Wang, Yiwen Han, Victor C.M. Leung, Dusit Niyato, Xueqiang Yan, Xu Chen

26. Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models. arXiv 2021 paper bib

    Sam Bond-Taylor, Adam Leach, Yang Long, Chris G. Willcocks

27. Deep learning. Nature 2015 paper bib

    Yann LeCun

28. Deep Learning for 3D Point Cloud Understanding: A Survey. arXiv 2020 paper bib

    Haoming Lu, Humphrey Shi

29. Deep Learning for Image Super-resolution: A Survey. IEEE 2019 paper bib

    Zhihao Wang, Jian Chen, Steven C.H. Hoi

30. Deep Learning on Graphs: A Survey. IEEE 2020 paper bib

    Ziwei Zhang, Peng Cui, Wenwu Zhu

31. Deep Learning Theory Review: An Optimal Control and Dynamical Systems Perspective. arXiv 2019 paper bib

    Guan-Horng Liu, Evangelos A. Theodorou

32. Dynamic Neural Networks: A Survey. arXiv 2021 paper bib

    Yizeng Han, Gao Huang, Shiji Song, Le Yang, Honghui Wang, Yulin Wang

33. Embracing Change: Continual Learning in Deep Neural Networks. Trends inCognitive Science 2020 paper bib

    Raia Hadsell，Dushyant Rao，Andrei A. Rusu，Razvan Pascanu

34. From Model-driven to Data-driven: A Survey on Active Deep Learning. arXiv 2021 paper bib

    Peng Liu, Guojin He, Lei Zhao

35. Geometric Deep Learning: Going beyond Euclidean data. IEEE 2017 paper bib

    Michael M. Bronstein, Joan Bruna, Yann LeCun, Arthur Szlam, Pierre Vandergheynst

36. Hands-on Bayesian Neural Networks - a Tutorial for DeepLearning Users. arXiv 2020 paper bib

    Laurent Valentin Jospin, et al

37. Improving Deep Learning Models via Constraint-Based Domain Knowledge: a Brief Survey. arXiv 2020 paper bib

    Andrea Borghesi, Federico Baldo, Michela Milano

38. Learning Deep Models for Face Anti-Spoofing Binary or Auxiliary Supervision. CVPR 2018 paper bib

    Liu Y, Jourabloo A, Liu X

39. Learning from Noisy Labels with Deep Neural Networks: A Survey. arXiv 2020 paper bib

    Hwanjun Song, Minseok Kim, Dongmin Park, Jae-Gil Lee

40. Model Complexity of Deep Learning: A Survey. arXiv 2021 paper bib

    Xia Hu, Lingyang Chu, Jian Pei, Weiqing Liu, Jiang Bian

41. Multimodal Intelligence: Representation Learning, Information Fusion, and Applications. IEEE Journal of Selected Topics in Signal Processing 2020 paper bib

    Chao Zhang, Zichao Yang, Xiaodong He, Li Deng

42. Opportunities and Challenges in Deep Learning Adversarial Robustness: A Survey. arXiv 2020 paper bib

    Samuel Henrique Silva, Peyman Najafirad

43. Pooling Methods in Deep Neural Networks, a Review. arXiv 2020 paper bib

    Hossein Gholamalinezhad, Hossein Khosravi

44. Position Information in Transformers: An Overview. arXIv 2021 paper bib

    Philipp Dufter, Martin Schmitt, Hinrich Schütze

45. Privacy in Deep Learning: A Survey. arXiv 2020 paper bib

    Fatemehsadat Mireshghallah, Mohammadkazem Taram, Praneeth Vepakomma, Abhishek Singh, Ramesh Raskar, Hadi Esmaeilzadeh

46. Recent Advances in Deep Learning Theory. arXiv 2020 paper bib

    Fengxiang He, Dacheng Tao

47. Review: Ordinary Differential Equations For Deep Learning. arXiv 2019 paper bib

    Xinshi Chen

48. Short-term Traffic Prediction with Deep Neural Networks: A Survey. arXiv 2020 paper bib

    Kyungeun Lee, Moonjung Eo, Euna Jung, Yoonjin Yoon, Wonjong Rhee

49. Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks. arXiv 2021 paper bib

    Torsten Hoefler, Dan Alistarh, Tal Ben-Nun, Nikoli Dryden, Alexandra Peste

50. Survey of Dropout Methods for Deep Neural Networks. arXiv 2019 paper bib

    Alex Labach, Hojjat Salehinejad, Shahrokh Valaee

51. Survey of Expressivity in Deep Neural Networks. NIPS 2016 paper bib

    Maithra Raghu, Ben Poole, Jon Kleinberg, Surya Ganguli, Jascha Sohldickstein

52. Survey of Network Representation Learning. 计算机科学 2020 paper bib

    Ding Yu, Wei Hao, Pan Zhi-Song, Liu Xin

53. Survey of reasoning using Neural networks. arXiv 2017 paper bib

    Amit Sahu

54. The Deep Learning Compiler: A Comprehensive Survey. arXiv 2020 paper bib

    Mingzhen Li, Yi Liu, Xiaoyan Liu, Qingxiao Sun, Xin You, Hailong Yang, Zhongzhi Luan, Depei Qian

55. The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches. arXiv 2018 paper bib

    Zahangir Alom, Tarek M Taha, Christopher Yakopcic, Stefan Westberg, Paheding Sidike, Mst Shamima Nasrin, Brian C Van Esesn, Abdul A S Awwal, Vijayan K Asari

56. Time Series Forecasting With Deep Learning: A Survey. Philosophical Transactions of the Royal Society 2020 paper bib

    Bryan Lim, Stefan Zohren

57. Towards Causal Representation Learning. IEEE 2021 paper bib

    Bernhard Schölkopf, Francesco Locatello, Stefan Bauer, Nan Rosemary Ke, Nal Kalchbrenner, Anirudh Goyal, Yoshua Bengio

58. Deep Learning for Matching in Search and Recommendation. The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval 2018 paper bib

    Xu Jun, Xiangnan He, Hang Li

Deep Reinforcement Learning

1. A Brief Survey of Deep Reinforcement Learning. IEEE 2017 paper bib

   Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, Anil A Bharath

2. A Short Survey On Memory Based Reinforcement Learning. arXiv 2019 paper bib

   Dhruv Ramani

3. A Short Survey on Probabilistic Reinforcement Learning. arXiv 2019 paper bib

   Reazul Hasan Russel

4. A Survey of Exploration Strategies in Reinforcement Learning. McGill University 2003 paper bib

   McFarlane R

5. A Survey of Inverse Reinforcement Learning: Challenges, Methods and Progress. arXiv 2018 paper bib

   Saurabh Arora, Prashant Doshi

6. A Survey of Reinforcement Learning Algorithms for Dynamically Varying Environments. arXiv 2020 paper bib

   Sindhu Padakandla

7. A Survey of Reinforcement Learning Informed by Natural Language. IJCAI 2019 paper bib

   Jelena Luketina, Nantas Nardelli, Gregory Farquhar, Jakob N. Foerster, Jacob Andreas, Edward Grefenstette, Shimon Whiteson, Tim Rocktäschel

8. A Survey of Reinforcement Learning Techniques: Strategies, Recent Development, and Future Directions. arXiv 2020 paper bib

   Amit Kumar Mondal

9. A Survey on Deep Reinforcement Learning for Audio-Based Applications. arxiv 2021 paper bib

   Siddique Latif, Heriberto Cuayáhuitl, Farrukh Pervez, Fahad Shamshad, Hafiz Shehbaz Ali, Erik Cambria

10. A survey on intrinsic motivation in reinforcement learning. arXiv 2019 paper bib

    Aubret, Arthur, Matignon, Laetitia, Hassas, Salima

11. A Survey on Reproducibility by Evaluating Deep Reinforcement Learning Algorithms on Real-World Robots. Conference on Robot Learning 2019 paper bib

    Nicolai A. Lynnerup, Laura Nolling, Rasmus Hasle, John Hallam

12. Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics. Mathematics 2020 paper bib

    Amir Mosavi, Pedram Ghamisi, Yaser Faghan, Puhong Duan

13. Curriculum Learning for Reinforcement Learning Domains: A Framework and Survey. Journal of Machine Learning Research 2020 paper bib

    Sanmit Narvekar, Bei Peng, Matteo Leonetti, Jivko Sinapov, Matthew E. Taylor, Peter Stone

14. Deep Model-Based Reinforcement Learning for High-Dimensional Problems, a Survey. arxiv 2020 paper bib

    Aske Plaat, Walter Kosters, Mike Preuss

15. Deep Reinforcement Learning: An Overview. arXiv 2017 paper bib

    Yuxi Li

16. Derivative-Free Reinforcement Learning: A Review. Frontiers of Computer Science in 2020 2020 paper bib

    Hong Qian, Yang Yu

17. Feature-Based Aggregation and Deep Reinforcement Learning: A Survey and Some New Implementations. IEEE 2019 paper bib

    Dimitri P. Bertsekas

18. Model-Based Deep Reinforcement Learning for High-Dimensional Problems, a Survey. arXiv 2020 paper bib

    Aske Plaat, Walter Kosters, Mike Preuss

19. Model-based Reinforcement Learning: {A} Survey. arXiv 2020 paper bib

    Thomas M. Moerland, Joost Broekens, Catholijn M. Jonker

20. Reinforcement Learning for Combinatorial Optimization: A Survey. arxiv 2020 paper bib

    Nina Mazyavkina, Sergey Sviridov, Sergei Ivanov, Evgeny Burnaev

21. Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey. IEEE 2020 paper bib

    Wenshuai Zhao, Jorge Peña Queralta, Tomi Westerlund

Federated Learning

1. A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection. arxiv 2021 paper bib

   Qinbin Li, Zeyi Wen, Zhaomin Wu, Sixu Hu, Naibo Wang, Yuan Li, Xu Liu, Bingsheng He

2. A Survey towards Federated Semi-supervised Learning. arXiv 2020 paper bib

   Yilun Jin, Xiguang Wei, Yang Liu, Qiang Yang

3. Achieving Security and Privacy in Federated Learning Systems: Survey, Research Challenges and Future Directions. arxiv 2020 paper bib

   Alberto Blanco-Justicia, Josep Domingo-Ferrer, Sergio Martínez, David Sánchez, Adrian Flanagan, Kuan Eeik Tan

4. Advances and Open Problems in Federated Learning. arXiv 2019 paper bib

   Peter Kairouz, H Brendan Mcmahan, Brendan Avent, Aurelien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, Keith Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings, Rafael G L Doliveira, Salim El Rouayheb, David Evans, Josh Gardner, Zachary A Garrett, Adria Gascon, Badih Ghazi, Phillip B Gibbons, Marco Gruteser, Zaid Harchaoui, Chaoyang He, Lie He, Zhouyuan Huo, Ben Hutchinson, Justin Hsu, Martin Jaggi, Tara Javidi, Gauri Joshi, Mikhail Khodak, Jakub Konecný, Aleksandra Korolova, Farinaz Koushanfar, Sanmi Koyejo, Tancrede Lepoint, Yang Liu, Prateek Mittal, Mehryar Mohri, Richard Nock, Ayfer Ozgur, Rasmus Pagh, Mariana Raykova, Hang Qi, Daniel Ramage, Ramesh Raskar, Dawn Song, Weikang Song, Sebastian U Stich, Ziteng Sun, Ananda Theertha Suresh, Florian Tramer, Praneeth Vepakomma, Jianyu Wang, Li Xiong, Zheng Xu, Qiang Yang, Felix X Yu, Han Yu, Sen Zhao

5. Fusion of Federated Learning and Industrial Internet of Things: A Survey. arxiv 2021 paper bib

   Parimala M, Swarna Priya R M, Quoc-Viet Pham, Kapal Dev, Praveen Kumar Reddy Maddikunta, Thippa Reddy Gadekallu, Thien Huynh-The

6. Privacy and Robustness in Federated Learning: Attacks and Defenses. arXiv 2020 paper bib

   Lingjuan Lyu, Han Yu, Xingjun Ma, Lichao Sun, Jun Zhao, Qiang Yang, Philip S. Yu

7. Threats to Federated Learning: A Survey. Conference on Robot Learning 2020 paper bib

   Lingjuan Lyu, Han Yu, Qiang Yang

8. Towards Utilizing Unlabeled Data in Federated Learning: A Survey and Prospective. arXiv 2020 paper bib

   Yilun Jin, Xiguang Wei, Yang Liu, Qiang Yang

9. Emerging Trends in Federated Learning: From Model Fusion to Federated X Learning. arXiv 2021 paper

   Shaoxiong Ji, Teemu Saravirta, Shirui Pan, Guodong Long, Anwar Walid

Few-Shot and Zero-Shot Learning

1. A Survey of Zero-Shot Learning: Settings, Methods, and Applications. ACM Transactions on Intelligent Systems and Technology 2019 paper bib

   Wei Wang,Vincent W. Zheng,Han Yu,Chunyan Miao

2. Few-shot Learning: A Survey. arXiv 2019 paper bib

   Yaqing Wang, Quanming Yao

3. Generalizing from a Few Examples: A Survey on Few-Shot Learning. ACM Computing Surveys 2019 paper bib

   Yaqing Wang, Quanming Yao, James Kwok, Lionel M. Ni

4. Learning from Few Samples: A Survey. arXiv 2020 paper bib

   Nihar Bendre, Hugo Terashima Marín, Peyman Najafirad

5. Learning from Very Few Samples: A Survey. arXiv 2020 paper bib

   Jiang Lu, Pinghua Gong, Jieping Ye, Changshui Zhang

General Machine Learning

1. A survey of dimensionality reduction techniques. arXiv 2014 paper bib

   C.O.S. Sorzano, J. Vargas, A. Pascual Montano

2. A Survey of Predictive Modelling under Imbalanced Distributions. arXiv 2015 paper bib

   Paula Branco, Luis Torgo, Rita Ribeiro

3. A Survey on Activation Functions and their relation with Xavier and He Normal Initialization. arXiv 2020 paper bib

   Leonid Datta

4. A Survey on Data Collection for Machine Learning: a Big Data -- AI Integration Perspective. IEEE 2018 paper bib

   Yuji Roh, Geon Heo, Steven Euijong Whang

5. A survey on feature weighting based K-Means algorithms. Journal of Classification 2016 paper bib

   Renato Cordeiro de Amorim

6. A Survey on Graph Kernels. Applied Network ence 2020 paper bib

   Nils M. Kriege, Fredrik D. Johansson, Christopher Morris

7. A Survey on Large-Scale Machine Learning. IEEE 2020 paper bib

   Meng Wang，Weijie Fu，Xiangnan He，Shijie Hao，Xindong Wu

8. A Survey on Multi-output Learning. IEEE 2019 paper bib

   Donna Xu, Yaxin Shi, Ivor W. Tsang, Yew-Soon Ong, Chen Gong, Xiaobo Shen

9. A Survey on Resilient Machine Learning. arXiv 2017 paper bib

   Atul Kumar, Sameep Mehta

10. A Survey on Surrogate Approaches to Non-negative Matrix Factorization. Vietnam journal of mathematics 2018 paper bib

    Pascal Fernsel, Peter Maass

11. A Tutorial on Network Embeddings. arXiv 2018 paper bib

    Haochen Chen, Bryan Perozzi, Rami Al-Rfou, Steven Skiena

12. Adversarial Examples in Modern Machine Learning: A Review. arXiv 2019 paper bib

    Rey Reza Wiyatno, Anqi Xu, Ousmane Dia, Archy de Berker

13. Algorithms Inspired by Nature: A Survey. arXiv 2019 paper bib

    Pranshu Gupta

14. Backdoor Learning: A Survey. arXiv 2020 paper bib

    Yiming Li, Baoyuan Wu, Yong Jiang, Zhifeng Li, Shu-Tao Xia

15. Deep Tree Transductions - A Short Survey. INNS Big Data and Deep Learning 2019 paper bib

    Davide Bacciu, Antonio Bruno

16. Graph Representation Learning: A Survey. APSIPA Transactions on Signal and Information Processing 2020 paper bib

    Fenxiao Chen, Yuncheng Wang, Bin Wang, C.-C. Jay Kuo

17. Heuristic design of fuzzy inference systems: A review of three decades of research. Engineering Applications of Artificial Intelligence 2019 paper bib

    Varun Ojha, Ajith Abraham, Vaclav Snasel

18. Hierarchical Mixtures-of-Experts for Exponential Family Regression Models with Generalized Linear Mean Functions: A Survey of Approximation and Consistency Results. Uncertainty in Artificial Intelligence 2013 paper bib

    Wenxin Jiang, Martin A. Tanner

19. Hyperbox based machine learning algorithms: A comprehensive survey. arXiv 2019 paper bib

    Thanh Tung Khuat, Dymitr Ruta, Bogdan Gabrys

20. Imbalance Problems in Object Detection: A Review. IEEE 2020 paper bib

    Kemal Oksuz, Baris Can Cam, Sinan Kalkan, Emre Akbas

21. Learning Representations of Graph Data -- A Survey. arXiv 2019 paper bib

    Mital Kinderkhedia

22. Machine Learning at the Network Edge: A Survey. arXiv 2019 paper bib

    M.G. Sarwar Murshed, Christopher Murphy, Daqing Hou, Nazar Khan, Ganesh Ananthanarayanan, Faraz Hussain

23. Machine Learning for Spatiotemporal Sequence Forecasting: A Survey. arXiv 2018 paper bib

    Xingjian Shi, Dit-Yan Yeung

24. Machine Learning in Network Centrality Measures: Tutorial and Outlook. ACM Computing Surveys 2019 paper bib

    Felipe Grando, Lisandro Zambenedetti Granville, Luís C. Lamb

25. Machine Learning Testing: Survey, Landscapes and Horizons. IEEE 2019 paper bib

    Jie M. Zhang, Mark Harman, Lei Ma, Yang Liu

26. Machine Learning that Matters. arxiv 2012 paper bib

    Kiri Wagstaff

27. Machine Learning with World Knowledge: The Position and Survey. arXiv 2017 paper bib

    Yangqiu Song, Dan Roth

28. Mean-Field Learning: a Survey. arXiv 2012 paper bib

    Hamidou Tembine, Raúl Tempone, Pedro Vilanova

29. Multidimensional Scaling, Sammon Mapping, and Isomap: Tutorial and Survey. arXiv 2020 paper bib

    Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley

30. Multimodal Machine Learning: A Survey and Taxonomy. arXiv 2017 paper bib

    Tadas Baltrusaitis, Chaitanya Ahuja, Louis-Philippe Morency

31. Multi-Objective Multi-Agent Decision Making: A Utility-based Analysis and Survey. Autonomous Agents and Multi Agent Systems 2020 paper bib

    Roxana Rădulescu, Patrick Mannion, Diederik M. Roijers, Ann Nowé

32. Narrative Science Systems: A Review. Computer ence 2015 paper bib

    Paramjot Kaur Sarao, Puneet Mittal, Rupinder Kaur

33. Network Representation Learning: A Survey. IEEE 2020 paper bib

    Daokun Zhang, Jie Yin, Xingquan Zhu, Chengqi Zhang

34. Relational inductive biases, deep learning, and graph networks. arXiv 2018 paper bib

    Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinicius Flores Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, Caglar Gülçehre, H. Francis Song, Andrew J. Ballard, Justin Gilmer, George E. Dahl, Ashish Vaswani, Kelsey R. Allen, Charles Nash, Victoria Langston, Chris Dyer, Nicolas Heess, Daan Wierstra, Pushmeet Kohli, Matthew Botvinick, Oriol Vinyals, Yujia Li, Razvan Pascanu

35. Relational Representation Learning for Dynamic (Knowledge) Graphs: A Survey. JMLR 2019 paper bib

    Seyed Mehran Kazemi, Rishab Goel, Kshitij Jain, Ivan Kobyzev, Akshay Sethi, Peter Forsyth, Pascal Poupart

36. Security and Privacy of Machine Learning Models: A Survery. 软件学报 2019 paper bib

    纪守领, 杜天宇, 李进锋, 沈超, 李博

37. Self-supervised Learning: Generative or Contrastive. arXiv 2020 paper bib

    Xiao Liu, Fanjin Zhang, Zhenyu Hou, Zhaoyu Wang, Li Mian, Jing Zhang, Jie Tang

38. Statistical Queries and Statistical Algorithms: Foundations and Applications. arXiv 2020 paper bib

    Lev Reyzin

39. Structure Learning of Probabilistic Graphical Models: A Comprehensive Survey. Eprint Arxiv 2011 paper bib

    Yang Zhou

40. Survey on Feature Selection. Computer ence 2015 paper bib

    Tarek Amr Abdallah, Beatriz de La Iglesia

41. Survey on Five Tribes of Machine Learning and the Main Algorithms. Software Guide 2019 paper bib

    LI Xu-ran, DING Xiao-hong

42. Survey: Machine Learning in Production Rendering. arXiv 2020 paper bib

    Shilin Zhu

43. The Benefits of Population Diversity in Evolutionary Algorithms: A Survey of Rigorous Runtime Analyses. Theory of Evolutionary Computation 2018 paper bib

    Dirk Sudholt

44. Tutorial on Variational Autoencoders. arXiv 2016 paper bib

    Carl Doersch

45. Unsupervised Cross-Lingual Representation Learning. ACL 2019 paper bib

    Sebastian Ruder, Anders Søgaard, Ivan Vulic

46. Verification for Machine Learning, Autonomy, and Neural Networks Survey. arXiv 2018 paper bib

    Weiming Xiang, Patrick Musau, Ayana A. Wild, Diego Manzanas Lopez, Nathaniel Hamilton, Xiaodong Yang, Joel Rosenfeld, Taylor T. Johnson

Generative Adversarial Networks

1. A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications. arXiv 2020 paper bib

   Jie Gui, Zhenan Sun, Yonggang Wen, Dacheng Tao, Jieping Ye

2. A Survey on Generative Adversarial Networks: Variants, Applications, and Training. arXiv 2020 paper bib

   Abdul Jabbar, Xi Li, Bourahla Omar

3. Adversarial Examples on Object Recognition: A Comprehensive Survey. arXiv 2020 paper bib

   Alex Serban, Erik Poll, Joost Visser

4. GAN Inversion: A Survey. arXiv 2021 paper bib

   Weihao Xia, Yulun Zhang, Yujiu Yang, Jing-Hao Xue, Bolei Zhou, Ming-Hsuan Yang

5. Generative Adversarial Networks: A Survey and Taxonomy. arXiv 2019 paper bib

   Zhengwei Wang, Qi She, Tomas E Ward

6. Generative Adversarial Networks: An Overview. IEEE 2018 paper bib

   Antonia Creswell, Tom White, Vincent Dumoulin, Kai Arulkumaran, Biswa Sengupta, Anil A Bharath

7. How Generative Adversarial Nets and its variants Work: An Overview of GAN. arXiv 2017 paper bib

   Yongjun Hong, Uiwon Hwang, Jaeyoon Yoo, Sungroh Yoon

8. Stabilizing Generative Adversarial Network Training: A Survey. arXiv 2020 paper bib

   Maciej Wiatrak, Stefano V. Albrecht, Andrew Nystrom

Graph Neural Networks

1. A Comprehensive Survey of Graph Embedding: Problems, Techniques and Applications. IEEE Transactions on Knowledge and Data Engineering 2018 paper bib

   HongYun Cai, Vincent W. Zheng, Kevin Chen-Chuan Chang

2. A Comprehensive Survey on Graph Neural Networks. IEEE 2019 paper bib

   Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, Philip S. Yu

3. A Survey on Graph Neural Networks for Knowledge Graph Completion. arxiv 2020 paper bib

   Siddhant Arora

4. A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sources. arXiv 2020 paper bib

   Xiao Wang, Deyu Bo, Chuan Shi, Shaohua Fan, Yanfang Ye, Philip S. Yu

5. A Survey on The Expressive Power of Graph Neural Networks. arXiv 2020 paper bib

   Ryoma Sato

6. Adversarial Attack and Defense on Graph Data: A Survey. arXiv 2018 paper bib

   Lichao Sun, Ji Wang, Philip S. Yu, Bo Li

7. Automated Machine Learning on Graphs: A Survey. arXiv 2021 paper bib

   Ziwei Zhang, Xin Wang, Wenwu Zhu

8. Bridging the Gap between Spatial and Spectral Domains: A Survey on Graph Neural Networks. arXiv 2020 paper bib

   Zhiqian Chen, Fanglan Chen, Lei Zhang, Taoran Ji, Kaiqun Fu, Liang Zhao, Feng Chen, Chang-Tien Lu

9. Computing Graph Neural Networks: A Survey from Algorithms to Accelerators. arxiv 2020 paper bib

   Sergi Abadal, Akshay Jain, Robert Guirado, Jorge López-Alonso, Eduard Alarcón

10. Deep Graph Structure Learning for Robust Representations: A Survey. arXiv 2021 paper bib

    Yanqiao Zhu, Weizhi Xu, Jinghao Zhang, Qiang Liu, Shu Wu, Liang Wang

11. Explainability in Graph Neural Networks: A Taxonomic Survey. arxiv 2020 paper bib

    Hao Yuan, Haiyang Yu, Shurui Gui, Shuiwang Ji

12. Foundations and modelling of dynamic networks using Dynamic Graph Neural Networks: A survey. arXiv 2020 paper bib

    Joakim Skarding, Bogdan Gabrys, Katarzyna Musial

13. Graph Embedding for Combinatorial Optimization: A Survey. arXiv 2020 paper bib

    Yun Peng, Byron Choi, Jianliang Xu

14. Graph embedding techniques, applications, and performance: A survey. Knowledge Based Systems 2018 paper bib

    Palash Goyal, Emilio Ferrara

15. Graph Neural Network for Traffic Forecasting: A Survey. arxiv 2021 paper bib

    Weiwei Jiang, Jiayun Luo

16. Graph Neural Networks Meet Neural-Symbolic Computing: A Survey and Perspective. arXiv 2020 paper bib

    Luis C. Lamb, Artur Garcez, Marco Gori, Marcelo Prates, Pedro Avelar, Moshe Vardi

17. Graph Neural Networks: A Review of Methods and Applications. arXiv 2018 paper bib

    Jie Zhou, Ganqu Cui, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Maosong Sun

18. Graph Neural Networks: Taxonomy, Advances and Trends. arXiv 2020 paper bib

    Yu Zhou, Haixia Zheng, Xin Huang

19. Graph Self-Supervised Learning: A Survey. arXiv 2021 paper bib

    Yixin Liu, Shirui Pan, Ming Jin, Chuan Zhou, Feng Xia, Philip S. Yu

20. Image/Video Deep Anomaly Detection: A Survey. arXiv 2021 paper bib

    Bahram Mohammadi, Mahmood Fathy, Mohammad Sabokrou

21. Introduction to Graph Neural Networks. IEEE 2020 paper bib

    Zhiyuan Liu, Jie Zhou

22. Meta-Learning with GNNs:Methods&Applications. arXiv 2021 paper bib

    Debmalya Mandal, Sourav Medya, Brian Uzzi, Charu Aggarwal

23. Self-Supervised Learning of Graph Neural Networks: A Unified Review. arXiv 2021 paper bib

    Yaochen Xie, Zhao Xu, Zhengyang Wang, Shuiwang Ji

24. Tackling Graphical NLP problems with Graph Recurrent Networks. arXiv 2019 paper bib

    Linfeng Song

Interpretability and Analysis

1. A Survey Of Methods For Explaining Black Box Models. ACM Computing Surveys 2018 paper bib

   Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, Dino Pedreschi

2. A Survey of Safety and Trustworthiness of Deep Neural Networks: Verification, Testing, Adversarial Attack and Defence, and Interpretability. Computer ence 2018 paper bib

   Xiaowei Huang, Daniel Kroening, Wenjie Ruan, James Sharp, Youcheng Sun, Emese Thamo, Min Wu, Xinping Yi

3. A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI. IEEE TNNLS 2020 paper bib

   Erico Tjoa, Cuntai Guan

4. A Survey on the Explainability of Supervised Machine Learning. Journal of Artificial Intelligence Research 2020 paper bib

   Nadia Burkart, Marco F. Huber

5. Causal Interpretability for Machine Learning -- Problems, Methods and Evaluation. Sigkdd Explorations 2020 paper bib

   Raha Moraffah, Mansooreh Karami, Ruocheng Guo, Adrienne Raglin, Huan Liu

6. Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI. Information Fusion 2020 paper bib

   Alejandro Barredo Arrieta, Natalia Diazrodriguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador Garcia, Sergio Gillopez, Daniel Molina, Richard Benjamins, Raja Chatila, Francisco Herrera

7. Explainable Artificial Intelligence Approaches: A Survey. arXiv 2021 paper bib

   Sheikh Rabiul Islam, William Eberle, Sheikh Khaled Ghafoor, Mohiuddin Ahmed

8. Explainable artificial intelligence: A survey. MIPRO 2018 paper bib

   Filip Karlo Došilović, Mario Brcic, Nikica Hlupic

9. Explainable Reinforcement Learning: A Survey. CD-MAKE 2020 2020 paper bib

   Erika Puiutta, Eric M. S. P. Veith

10. Foundations of Explainable Knowledge-Enabled Systems. Knowledge Graphs for eXplainable Artificial Intelligence: Foundations, Applications and Challenges/arXiv 2020 paper bib

    Shruthi Chari

11. How Convolutional Neural Networks See the World — A Survey of Convolutional Neural Network Visualization Methods. Mathematical Foundations of Computing 2018 paper bib

    Zhuwei Qin, Fuxun Yu, Chenchen Liu, Xiang Chen

12. How Generative Adversarial Networks and Their Variants Work: An Overview. IEEE 2017 paper bib

    Yongjun Hong, Uiwon Hwang, Jaeyoon Yoo, Sungroh Yoon

13. Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challenges. arxiv 2020 paper bib

    Christoph Molnar, Giuseppe Casalicchio, Bernd Bischl

14. Language (Technology) is Power: A Critical Survey of "Bias" in NLP. Association for Computational Linguistics 2020 paper bib

    Su Lin Blodgett, Solon Barocas, Hal Daumé III, Hanna Wallach

15. Machine learning interpretability: A survey on methods and metrics. Electronics 2019 paper bib

    Diogo V. Carvalho, Eduardo M. Pereira, Jaime S. Cardoso

16. Opportunities and Challenges in Explainable Artificial Intelligence(XAI): A Survey. arXiv 2020 paper bib

    Arun Das, Paul Rad

17. Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI). IEEE Access 2018 paper bib

    Amina Adadi, Mohammed Berrada

18. Survey & Experiment: Towards the Learning Accuracy. arXiv 2010 paper bib

    Zeyuan Allen Zhu

19. Survey of explainable machine learning with visual and granular methods beyond quasi-explanations. arXiv 2020 paper bib

    Kovalerchuk, Boris and Ahmad, Muhammad Aurangzeb and Teredesai, Ankur

20. Understanding Neural Networks via Feature Visualization: A survey. arXiv 2019 paper bib

    Anh Nguyen, Jason Yosinski, Jeff Clune

21. Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers. IEEE Transactions on Visualization and Computer Graphics 2019 paper bib

    Fred Hohman, Minsuk Kahng, Robert Pienta, Duen Horng Chau

22. Visual interpretability for deep learning: a survey. Frontiers of Information Technology & Electronic Engineering 2018 paper bib

    Quanshi Zhang, Songchun Zhu

23. Visualisation of Pareto Front Approximation: A Short Survey and Empirical Comparisons. arXiv 2019 paper bib

    Huiru Gao, Haifeng Nie, Ke Li

24. When will the mist clear? On the Interpretability of Machine Learning for Medical Applications: a survey. arxiv 2020 paper bib

    Antonio-Jesús Banegas-Luna, Jorge Peña-García, Adrian Iftene, Fiorella Guadagni, Patrizia Ferroni, Noemi Scarpato, Fabio Massimo Zanzotto, Andrés Bueno-Crespo, Horacio Pérez-Sánchez

Interpretability and Analysis of Models for NLP

1. A Survey on Explainability in Machine Reading Comprehension. arxiv 2020 paper bib

   Mokanarangan Thayaparan, Marco Valentino, André Freitas

2. *Which BERT? A Survey Organizing Contextualized Encoders. EMNLP 2020 paper bib

   Patrick Xia, Shijie Wu, Benjamin Van Durme

Interpretability and AnalysisA1

1. A brief survey of visualization methods for deep learning models from the perspective of Explainable AI. Information Visualization 2018 paper bib

   Ioannis Chalkiadakis

Meta Learning

1. A Comprehensive Overview and Survey of Recent Advances in Meta-Learning. arXiv 2020 paper bib

   Huimin Peng

2. A Survey of Deep Meta-Learning. Metalearning: Applications to Automated Machine Learning and Data Mining 2020 paper bib

   Mike Huisman, Jan N. van Rijn, Aske Plaat

3. Meta-learning for Few-shot Natural Language Processing: A Survey. arXiv 2020 paper bib

   Wenpeng Yin

4. Meta-Learning in Neural Networks: A Survey. arXiv 2020 paper bib

   Timothy M. Hospedales, Antreas Antoniou, Paul Micaelli, Amos J. Storkey

5. Meta-Learning: A Survey. arXiv 2018 paper bib

   Joaquin Vanschoren

Metric Learning

1. A Survey on Metric Learning for Feature Vectors and Structured Data. arXiv 2013 paper bib

   Aurelien Bellet, Amaury Habrard, Marc Sebban

2. A Tutorial on Distance Metric Learning: Mathematical Foundations, Algorithms and Experiments. arXiv 2018 paper bib

   Juan Luis Suarez, Salvador Garcia, Francisco Herrera

ML Applications

1. 360 degree view of cross-domain opinion classification: a survey. Artificial Intelligence Review 2020 paper bib

   Rahul Kumar Singh，Manoj Kumar Sachan，R. B. Patel

2. A Comprehensive Survey on Deep Music Generation: Multi-level Representations, Algorithms, Evaluations, and Future Directions. arXiv 2020 paper bib

   Shulei Ji, Jing Luo, Xinyu Yang

3. A guide to deep learning in healthcare. Nature medicine 2019 paper bib

   Andre Esteva, Alexandre Robicquet, Bharath Ramsundar, Volodymyr Kuleshov, Mark DePristo, Katherine Chou, Claire Cui, Greg Corrado, Sebastian Thrun & Jeff Dean

4. A Survey of Adaptive Resonance Theory Neural Network Models for Engineering Applications. Neural Networks 2019 paper bib

   Leonardo Enzo Brito da Silva, Islam Elnabarawy, Donald C. Wunsch II

5. A Survey of Machine Learning for Computer Architecture and Systems. arXiv 2021 paper bib

   Nan Wu, Yuan Xie

6. A Survey of Machine Learning Methods and Challenges for Windows Malware Classification. arXiv 2020 paper bib

   Edward Raff, Charles Nicholas

7. A survey on applications of augmented, mixed andvirtual reality for nature and environment. arXiv 2020 paper bib

   Jason Rambach, Gergana Lilligreen, Alexander Sch盲fer, Ramya Bankanal, Alexander Wiebel, Didier Stricker

8. A survey on deep hashing for image retrieval. arXiv 2020 paper bib

   Xiaopeng Zhang

9. A Survey on Deep Learning based Brain-Computer Interface: Recent Advances and New Frontiers. arXiv 2019 paper bib

   Xiang Zhang, Lina Yao, Xianzhi Wang, Jessica J M Monaghan, David Mcalpine, Yu Zhang

10. A Survey on Deep Learning in Medical Image Analysis. Medical Image Analysis 2017 paper bib

    Geert J S Litjens, Thijs Kooi, Babak Ehteshami Bejnordi, Arnaud A A Setio, Francesco Ciompi, Mohsen Ghafoorian, Jeroen A W M Van Der Laak, Bram Van Ginneken, Clara I Sanchez

11. A Survey on Machine Learning Applied to Dynamic Physical Systems. arxiv 2020 paper bib

    Sagar Verma

12. Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial. IEEE 2019 paper bib

    Mingzhe Chen, Ursula Challita, Walid Saad, Changchuan Yin, Mérouane Debbah

13. Deep Image Retrieval: A Survey. arXiv 2021 paper bib

    Wei Chen, Yu Liu, Weiping Wang, Erwin M. Bakker, Theodoros Georgiou, Paul Fieguth, Li Liu, Michael S. Lew

14. Deep Learning for Scene Classification: A Survey. arXiv 2021 paper bib

    Delu Zeng, Minyu Liao, Mohammad Tavakolian, Yulan Guo, Bolei Zhou, Dewen Hu, Matti Pietikäinen, Li Liu

15. Fashion Meets Computer Vision: A Survey. arXiv 2020 paper bib

    Wen-Huang Cheng, Sijie Song, Chieh-Yun Chen, Shintami Chusnul Hidayati, Jiaying Liu

16. Going Deeper Into Face Detection: A Survey. arXiv 2021 paper bib

    Shervin Minaee, Ping Luo, Zhe Lin, Kevin Bowyer

17. How Developers Iterate on Machine Learning Workflows -- A Survey of the Applied Machine Learning Literature. arXiv 2018 paper bib

    Doris Xin, Litian Ma, Shuchen Song, Aditya G. Parameswaran

18. Image-to-Image Translation: Methods and Applications. arXiv 2021 paper bib

    Yingxue Pang, Jianxin Lin, Tao Qin, Zhibo Chen

19. Local Differential Privacy and Its Applications: A Comprehensive Survey. arXiv 2020 paper bib

    Mengmeng Yang, Lingjuan Lyu, Jun Zhao, Tianqing Zhu, Kwok-Yan Lam

20. Machine Learning Aided Static Malware Analysis: A Survey and Tutorial. arXiv 2018 paper bib

    Andrii Shalaginov, Sergii Banin, Ali Dehghantanha, Katrin Franke

21. Machine Learning for Cataract Classification and Grading on Ophthalmic Imaging Modalities: A Survey. arxiv 2020 paper bib

    Xiaoqing Zhang, JianSheng Fang, Yan Hu, Yanwu Xu, Risa Higashita, Jiang Liu

22. Machine Learning for Electronic Design Automation: A Survey. arXiv 2021 paper bib

    Guyue Huang, Jingbo Hu, Yifan He, Jialong Liu, Mingyuan Ma, Zhaoyang Shen, Juejian Wu, Yuanfan Xu, Hengrui Zhang, Kai Zhong, Xuefei Ning, Yuzhe Ma, Haoyu Yang, Bei Yu, Huazhong Yang, Yu Wang

23. Machine Learning for Survival Analysis: A Survey. arXiv 2017 paper bib

    Ping Wang, Yan Li, Chandan K. Reddy

24. Object Detection in 20 Years: A Survey. IEEE 2019 paper bib

    Zhengxia Zou, Zhenwei Shi, Yuhong Guo, Jieping Ye

25. The Creation and Detection of Deepfakes:A Survey. arXiv 2020 paper bib

    Yisroel Mirsky, Wenke Lee

26. The Threat of Adversarial Attacks on Machine Learning in Network Security -- A Survey. arxiv 2019 paper bib

    Olakunle Ibitoye, Rana Abou-Khamis, Ashraf Matrawy, M. Omair Shafiq

27. Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey. Ieee Access 6 2018 paper bib

    Naveed Akhtar, Ajmal Mian

Model Compression and Acceleration

1. A Survey of Model Compression and Acceleration for Deep Neural Networks. IEEE 2017 paper bib

   Yu Cheng, Duo Wang, Pan Zhou, Tao Zhang

2. A Survey on Methods and Theories of Quantized Neural Networks. arXiv 2018 paper bib

   Yunhui Guo

3. An Overview of Neural Network Compression. arXiv 2020 paper bib

   James O' Neill

4. Compression of Deep Learning Models for Text: A Survey. arXiv 2020 paper bib

   Manish Gupta, Puneet Agrawal

5. Knowledge Distillation: A Survey. arXiv 2020 paper bib

   Jianping Gou, Baosheng Yu, Stephen John Maybank, Dacheng Tao

6. Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey. arXiv 2020 paper bib

   Jiayi Liu, Samarth Tripathi, Unmesh Kurup, Mohak Shah

7. Pruning and Quantization for Deep Neural Network Acceleration: A Survey. arXiv 2021 paper bib

   Tailin Liang, John Glossner, Lei Wang, Shaobo Shi

8. Survey of Machine Learning Accelerators. IEEE 2020 paper bib

   Albert Reuther, Peter Michaleas, Michael Jones, Vijay Gadepally, Siddharth Samsi, Jeremy Kepner

Multi-Label Learning

1. A Review on Multi-Label Learning Algorithms. IEEE transactions on knowledge and data engineering 2013 paper bib

   Min-Ling Zhang, Zhi-Hua Zhou

2. Multi-Label Classification: An Overview. International Journal of Data Warehousing and Mining (IJDWM) 2007 paper bib

   Grigorios Tsoumakas, Ioannis Katakis

3. Multi‐label learning: a review of the state of the art and ongoing research. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 2014 paper bib

   Eva Gibaja, Sebastián Ventura

4. The Emerging Trends of Multi-Label Learning. arxiv 2020 paper bib

   Weiwei Liu, Xiaobo Shen, Haobo Wang, Ivor W. Tsang

Multi-Task and Multi-View Learning

1. A Brief Review on Multi-Task Learning. Multimedia Tools and Applications 2018 paper bib

   Kimhan Thung, Chong Yaw Wee

2. A Survey on Multi-Task Learning. arXiv 2017 paper bib

   Yu Zhang, Qiang Yang

3. A Survey on Multi-view Learning. Computer ence 2013 paper bib

   Chang Xu, Dacheng Tao, Chao Xu

4. An overview of multi-task learning. National Science Review 2018 paper bib

   Yu Zhang, Qiang Yang

5. An Overview of Multi-Task Learning in Deep Neural Networks. arXiv 2017 paper bib

   Sebastian Ruder

6. Multi-Task Learning for Dense Prediction Tasks: A Survey. arXiv 2020 paper bib

   Simon Vandenhende, Stamatios Georgoulis, Wouter Van Gansbeke, Marc Proesmans, Dengxin Dai, Luc Van Gool

7. Multi-Task Learning with Deep Neural Networks: A Survey. arXiv 2020 paper bib

   Michael Crawshaw

8. Revisiting Multi-Task Learning in the Deep Learning Era. arXiv 2020 paper bib

   Simon Vandenhende, Stamatios Georgoulis, Marc Proesmans, Dengxin Dai, Luc Van Gool

NLP-inspired Visual Models

1. A Survey on Visual Transformer. arXiv 2021 paper bib

   Kai Han, Yunhe Wang, Hanting Chen, Xinghao Chen, Jianyuan Guo, Zhenhua Liu, Yehui Tang, An Xiao, Chunjing Xu, Yixing Xu, Zhaohui Yang, Yiman Zhang, Dacheng Tao

2. Transformers in Vision: A Survey. arXiv 2021 paper bib

   Salman Khan, Muzammal Naseer, Munawar Hayat, Syed Waqas Zamir, Fahad Shahbaz Khan, Mubarak Shah

Online Learning

1. A Survey of Algorithms and Analysis for Adaptive Online Learning. Journal of Machine Learning Research 2017 paper bib

   H. Brendan McMahan

2. Online Continual Learning in Image Classification: An Empirical Survey. arxiv 2021 paper bib

   Zheda Mai, Ruiwen Li, Jihwan Jeong, David Quispe, Hyunwoo Kim, Scott Sanner

3. Online Learning: A Comprehensive Survey. arXiv 2018 paper bib

   Steven C.H. Hoi, Doyen Sahoo, Jing Lu, Peilin Zhao

4. Preference-based Online Learning with Dueling Bandits: A Survey. arXiv 2018 paper bib

   Robert Busa-Fekete, Eyke Hüllermeier, Adil El Mesaoudi-Paul

Optimization

1. A Survey of Optimization Methods from a Machine Learning Perspective. IEEE 2019 paper bib

   Shiliang Sun, Zehui Cao, Han Zhu, Jing Zhao

2. A Systematic and Meta-analysis Survey of Whale Optimization Algorithm. Computational Intelligence and Neuroscience 2019 paper bib

   Hardi M. Mohammed, Shahla U. Umar, Tarik A. Rashid

3. An overview of gradient descent optimization algorithms. arXiv 2017 paper bib

   Sebastian Ruder

4. Convex Optimization Overview. IEEE 2008 paper bib

   Kolter Zico, Lee Honglak

5. Evolutionary Multitask Optimization: a Methodological Overview, Challenges and Future Research Directions. arXiv 2021 paper bib

   Eneko Osaba, Aritz D. Martinez, Javier Del Ser

6. Gradient Boosting Machine: A Survey. arXiv 2019 paper bib

   Zhiyuan He, Danchen Lin, Thomas Lau, Mike Wu

7. Investigating Bi-Level Optimization for Learning and Vision from a  Unified Perspective: A Survey and Beyond. arXiv 2021 paper bib

   Risheng Liu, Jiaxin Gao, Jin Zhang, Deyu Meng, Zhouchen Lin

8. Nature-Inspired Optimization Algorithms: Research Direction and Survey. arXiv 2021 paper bib

   Sachan Rohit Kumar, Kushwaha Dharmender Singh

9. Optimization for deep learning: theory and algorithms. arXiv 2019 paper bib

   Ruoyu Sun

10. Optimization Models for Machine Learning: A Survey. arXiv 2019 paper bib

    Claudio Gambella, Bissan Ghaddar, Joe Naoum-Sawaya

11. Particle Swarm Optimization: A survey of historical and recent developments with hybridization perspectives. Machine Learning & Knowledge Extraction 2019 paper bib

    Saptarshi Sengupta, Sanchita Basak, Richard Alan Peters II

Semi-Supervised and Unsupervised Learning

1. A brief introduction to weakly supervised learning. National Science Review 2018 paper bib

   Zhihua Zhou

2. A Survey of Unsupervised Dependency Parsing. COLING 2020 paper bib

   Wenjuan Han, Yong Jiang, Hwee Tou Ng, Kewei Tu

3. A Survey on Deep Semi-supervised Learning. arXiv 2021 paper bib

   Xiangli Yang, Zixing Song, Irwin King, Zenglin Xu

4. A survey on Semi-, Self- and Unsupervised Learning for Image Classification. 2020 paper bib

   Lars Schmarje, Monty Santarossa, Simon-Martin Schröder, Reinhard Koch

5. A Survey on Semi-Supervised Learning Techniques. International Journal of Computer Trends & Technology 2014 paper bib

   V. Jothi Prakash, Dr. L.M. Nithya

6. Graph-based Semi-supervised Learning: A Comprehensive Review. arXiv 2021 paper bib

   Zixing Song, Xiangli Yang, Zenglin Xu, Irwin King

7. Improvability Through Semi-Supervised Learning: A Survey of Theoretical Results. arXiv 2019 paper bib

   Alexander Mey, Marco Loog

8. Learning from positive and unlabeled data: a survey. Machine Learning 2020 paper bib

   Jessa Bekker, Jesse Davis

Transfer Learning

1. A Comprehensive Survey on Transfer Learning. arXiv 2019 paper bib

   Fuzhen Zhuang, Zhiyuan Qi, Keyu Duan, Dongbo Xi, Yongchun Zhu, Hengshu Zhu, Hui Xiong, Qing He

2. A Survey of Unsupervised Deep Domain Adaptation. arXiv 2020 paper bib

   Garrett Wilson, Diane J. Cook

3. A Survey on Deep Transfer Learning. International Conference on Artificial Neural Networks 2018 paper bib

   Chuanqi Tan, Fuchun Sun, Tao Kong, Wenchang Zhang, Chao Yang, Chunfang Liu

4. A survey on domain adaptation theory: learning bounds and theoretical guarantees. arXiv 2020 paper bib

   Ievgen Redko, Emilie Morvant, Amaury Habrard, Marc Sebban, Younès Bennani

5. A Survey on Transfer Learning. IEEE Transactions on knowledge and data engineering 2010 paper bib

   Pan, Sinno Jialin, Qiang Yang

6. A Survey on Transfer Learning in Natural Language Processing. arXiv 2020 paper bib

   Zaid Alyafeai, Maged Saeed AlShaibani, Irfan Ahmad

7. Deep Learning for Text Attribute Transfer: A Survey. arXiv 2020 paper bib

   Di Jin, Zhijing Jin, Rada Mihalcea

8. Evolution of transfer learning in natural language processing. arXiv 2019 paper bib

   Aditya Malte, Pratik Ratadiya

9. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. arXiv 2019 paper bib

   Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu

10. Neural Unsupervised Domain Adaptation in NLP - A Survey. arXiv 2020 paper bib

    Alan Ramponi, Barbara Plank

11. Overcoming Negative Transfer: A Survey. arxiv 2020 paper bib

    Wen Zhang, Lingfei Deng, Dongrui Wu

12. Transfer Adaptation Learning: A Decade Survey. arXiv 2019 paper bib

    Lei Zhang, Xinbo Gao

13. Transfer learning for reinforcement learning domains: A survey. Journal of Machine Learning Research 2009 paper bib

    Matthew E. Taylor, Peter Stone

14. Transfer Learning in Deep Reinforcement Learning: A Survey. arXiv 2020 paper bib

    Zhuangdi Zhu, Kaixiang Lin, Jiayu Zhou

Trustworthy Machine Learning

1. A Survey on Bias and Fairness in Machine Learning. arXiv 2019 paper bib

   Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, Aram Galstyan

2. Differential Privacy and Machine Learning: a Survey and Review. Eprint Arxiv 2014 paper bib

   Zhanglong Ji, Zachary C. Lipton, Charles Elkan

3. Tutorial: Safe and Reliable Machine Learning. ACM 2019 paper bib

   Suchi Saria, Adarsh Subbaswamy

Team Members

The project is maintained by

Ziyang Wang, Shuhan Zhou, Nuo Xu, Bei Li, Yinqiao Li, Quan Du, Tong Xiao, and Jingbo Zhu

Natural Language Processing Lab., School of Computer Science and Engineering, Northeastern University

NiuTrans Research

Please feel free to contact us if you have any questions (wangziyang [at] stumail.neu.edu.cn or libei_neu [at] outlook.com).

Acknowledge

We would like to thank the people who have contributed to this project. They are

Xin Zeng, Laohu Wang, Chenglong Wang, Xiaoqian Liu, Xuanjun Zhou, Jingnan Zhang, Yongyu Mu, Zefan Zhou, Yanhong Jiang, Xinyang Zhu, Xingyu Liu, Dong Bi, Ping Xu, Zijian Li, Fengning Tian, Hui Liu, Kai Feng, Yuhao Zhang, Chi Hu, Di Yang, Lei Zheng, Hexuan Chen, Zeyang Wang, Tengbo Liu, Xia Meng, Weiqiao Shan, Tao Zhou, Runzhe Cao, Yingfeng Luo, Binghao Wei, Wandi Xu, Yan Zhang, Yichao Wang, Mengyu Ma, Zihao Liu