finch is a project that contains the collection of my implementations on machine learning (models + tests) mainly based on TensorFlow and PyTorch

I am actively responsible for this project, and there will be more models in the future ...

You are more than welcome to send an email to me in English / Chinese for any suggestion or question, I will try my best to answer as soon as I see it

Installation

The following command downloads the whole project, however it is large. It is recommended to manually download the files (you need)

git clone https://github.com/zhedongzheng/finch.git

Any test file can be run directly

python xxxx_test.py

The main dependence is:

• TensorFlow >=1.2.1
• PyTorch >=0.12
• scikit-learn

Other Language Support

中文

Style of My Code

I write each model as a single Class with fit() and predict() methods (scikit-learn API style), and then write separate test files for different incoming data. All the code below follow this style.

Contents

• Machine Learning
  • Linear Model
  • Ensemble
• Deep Learning
  • Multilayer Perceptron
  • Convolutional Network
  • Recurrent Network
  • Autoencoder
  • Highway Network
  • Generative Adversarial Network
• Reinforcement Learning
  • Policy Gradient
• Natural Language Processing
  • Preprocessing
  • Language Model
  • Text Classification
  • Text Generation
  • Sequence Labelling
  • Sequence to Sequence
• Information Retrieval
  • Recommender System
• Computer Vision
  • OpenCV

Machine Learning

Linear Model

• TensorFlow   |   Linear Regression     Model     Test   |  

• TensorFlow   |   Logistic Regression     Model     Test   |  

• TensorFlow   |   SVM (Linear) Classifier     Model     Test   |  

• Java   |   Logistic Regression     Model     Test   |  

• Java   |   SVM (Linear) Classifier     Model     Test   |  

Ensemble

• Python   |   Bagging Classifier     Model     Test   |  

• Python   |   Adaboost Classifier     Pseudocode     Model     Test   |  

• Python   |   Random Forest Classifier     Model     Test   |  

Deep Learning

Multilayer Perceptron

• TensorFlow   |   MLP Classifier     Model     MNIST Test     CIFAR10 Test   |  

• PyTorch   |   MLP Classifier     Model     MNIST Test     CIFAR10 Test   |  

Convolutional Network

• TensorFlow   |   Conv2D Classifier     Model     MNIST Test     CIFAR10 Test   |  

• PyTorch   |   Conv2D Classifier     Model     MNIST Test     CIFAR10 Test   |  

Recurrent Network

• TensorFlow   |   LSTM Classifier     Model     MNIST Test     CIFAR10 Test   |  

• TensorFlow   |   LSTM Regressor     Model     Test     Preview   |  

• PyTorch   |   LSTM Classifier     Model     MNIST Test     CIFAR10 Test   |  

• PyTorch   |   GRU Regressor     Model     Test   |  

Autoencoder

• TensorFlow   |   Stacked Autoencoder (weights-tied)     Model     MNIST Test   |  

• TensorFlow   |   Denoising Autoencoder     Model     MNIST Test   |  

• TensorFlow   |   Sparse Autoencoder     Model     MNIST Test   |  

• TensorFlow   |   Variational Autoencoder     Model     MNIST Test   |  

• TensorFlow   |   Conv2D Autoencoder (weights-tied)     Model     MNIST Test     CIFAR10 Test   |  

Highway Network

• TensorFlow   |   MLP Highway Classifier     Model     MNIST Test   |  

• TensorFlow   |   Conv1D Highway Classifier     Model     IMDB Test   |  

Generative Adversarial Network

• TensorFlow   |   MLP GAN     Model     Test   |   MLP Conditional GAN     Model     Test   |  

• TensorFlow   |   DCGAN     MNIST     Model     Test     Result   |  

Reinforcement Learning

Policy Gradient

• TensorFlow   |   CartPole     Model     Test   |  

Natural Language Processing

Text Preprocessing

• Python   |   Text Cleaning

• Python   |   Word Indexing

Language Model

• Sklearn   |   Latent Semantic Analysis     Wiki     Model     Test   |  

• Python   |   Tri-Gram     Wiki     Model     Test   |  

• Sklearn   |   TF-IDF     Test     Result   |  

• TensorFlow   |   Word2vec (Skip-Gram)     Model     Test   |  

Text Classification

• Sklearn   |   TF-IDF + Logistic Regression     IMDB Test   |  

• TensorFlow   |   Conv1D     Model     IMDB Test   |   Concat Conv1D     Model     IMDB Test     Result   |  

• TensorFlow   |   LSTM     Model     IMDB Test   |  

• TensorFlow   |   Conv1D-LSTM     Model     IMDB Test   |  

• TensorFlow   |   Bi-directional LSTM + Attention     Model     IMDB Test     Result   |  

• PyTorch   |   Conv1D     Model     IMDB Test   |  

• PyTorch   |   LSTM     Model     IMDB Test   |  

• PyTorch   |   Conv1D-LSTM     Model     IMDB Test   |  

• PyTorch   |   Bi-directional LSTM + Attention     Model     IMDB Test     Result   |  

Text Generation

• Python   |   2nd order Markov     Model     Robert Frost Test   |  

• TensorFlow   |   Char-RNN     Karpathy's Idea     Model   |   《Anna Karenina》 Test   |   Beijing Address Test   |  

• TensorFlow   |   CNN-RNN     Original Paper     Model     Test   |  

Sequence Labelling

• TensorFlow   |   LSTM     Model   |   POS Tagging Test   |   Chinese Segmentation Test   |  

• TensorFlow   |   Bi-directional LSTM     Model   |   POS Tagging Test   |   Chinese Segmentation Test   |  

• TensorFlow   |   Bi-directional LSTM + CRF     Model   |  

  • POS Tagging Test   |   Result

  • Chinese Segmentation Test   |   Result

• PyTorch   |   LSTM     Model   |   POS Tagging Test   |   Chinese Segmentation Test   |  

• PyTorch   |   Bi-directional LSTM     Model   |   POS Tagging Test   |   Chinese Segmentation Test   |  

Sequence to Sequence

• TensorFlow   |   Dynamic Seq2Seq     Model     Sorting Test   |  

• TensorFlow   |   Dynamic Seq2Seq + Bi-directional Encoder     Model     Sorting Test   |  

• TensorFlow   |   Dynamic Seq2Seq + Attention     Model     Sorting Test     Result   |  

• TensorFlow   |   Dynamic Seq2Seq + Beam-Search Decoder     Model     Sorting Test   |  

• TensorFlow   |   Ultimate: Bi-directional Encoder + Attention + Beam-Search Decoder     Model     Sorting Test   |  

Information Retrieval

Recommender System

• Python   |   Collborative Filtering   |   MovieLens     User-based     Test   |   NBA 2013-14     Player-based     Test

• Python   |   Apriori   |   MovieLens     Function     Test   |  

• TensorFlow   |   Matrix Factorization     Model     MovieLens Test   |  

Computer Vision

OpenCV

• OP   |   Resize

• OP   |   Rotations

• Segmentation   |   Contours

• Segmentation   |   Sorting Contours

• Detection   |   Face & Eye Detection Using Cascade Classifier

• Detection   |   Walker & Car Detection Using Cascade Classifier