Awesome deep logic

Must-Read Papers or Resources on how to integrate symbolic logic into deep neural nets.

Survey and Open Challenges

1. From Machine Learning to Machine Reasoning Leon Bottou Arxiv 2011 [pdf]

2. From Statistical Relational to Neuro-Symbolic Artificial Intelligence Luc De Raedt , Sebastijan Dumanˇci ́c , Robin Manhaeve and Giuseppe Marra Arxiv 2020 [pdf]

3. Graph Neural Networks Meet Neural-Symbolic Computing: A Survey and Perspective Luis C. Lamb et,al. Arxiv 2020 [pdf]

4. Relational inductive biases, deep learning and graph networks Peter W. Battaglia et,al. Arxiv 2018 [pdf]

Logic as Knowledge Regularization

1. Clinical Temporal Relation Extraction with Probabilistic Soft Logic Regularization and Global Inference. Yichao Zhou, Yu Yan, Rujun Han, J. Harry Caufield,Kai-Wei Chang, Yizhou Sun, Peipei Ping and Wei Wang. AAAI 2021 [pdf] [code]

2. Integrating Deep Learning with Logic Fusion for Information Extraction. Wenya Wang, Sinno Jialin Pan. AAAI 2020 [pdf] [code]

3. Logic-guided Data Augmentation and Reguralization for Consistent Question Answering. Akari Asai, Hannaneh Hajishirzi. ACL 2020 [pdf] [code]

4. Structured Tuning for Semantic Role Labeling. Tao Li, Parth Anand Jawale, Martha Palmer, Vivek Srikumar ACL 2020 [pdf] [code]

5. Leveraging Declarative Knowledge in Text and First-Order Logic for Fine-Grained Propaganda Detection. Ruize Wang, Duyu Tang, et,al EMNLP 2020 [pdf]

6. Joint Constrained Learning for Event-Event Relation Extraction Haoyu Wang, Muhao Chen, Hongming Zhang, Dan Roth EMNLP 2020 [pdf]

7. A Logic-Driven Framework for Consistency of Neural Models. Tao Li, Vivek Gupta, Maitrey Mehta, Vivek Srikumar EMNLP-IJCNLP 2019 [pdf] [code]

8. Adversarially regularising neural NLI models to integrate logical background knowledge. Pasquale Minervini, Sebastian Riedel. CoNLL 2018 [pdf] [code]

9. Lifted Rule Injection for Relation Embeddings. Thomas Demeester, Tim Rocktäschel, Sebastian Riedel EMNLP 2016 [pdf]

Incorporate Logic into NN Module

1. Logical Neural Networks Ryan Riegel et,al (IBM Research) Arxiv 2020 [pdf]

Explainability and Understanding

1. What Can Neural Networks Reson About? Keyulu Xu, Jingling Li et,al ICLR 2020 [pdf] [code]

2. Relational Reasoning and Generalization using Non-symbolic Neural Networks Arxiv 2020 [pdf]

Related Application

1. Correlating neural and symbolic representations of language. Grzegorz Chrupała, Afra Alishahi. ACL 2019 [pdf][code]

2. Representing Meaning with a Combination of Logical and Distributional Models. I. Beltagy, Stephen Roller, Pengxiang Cheng, Katrin Erk, Raymond J. Mooney. Computational Linguistics 2016 [pdf] [code]