Planetoid

Introduction

This is an implementation of Planetoid, a graph-based semi-supervised learning method proposed in the following paper:

Revisiting Semi-Supervised Learning with Graph Embeddings. Zhilin Yang, William W. Cohen, Ruslan Salakhutdinov. ICML 2016.

Run the demo

We include the Citeseer dataset in the directory data, where the data structures needed are pickled.

To run the transductive version,

python test_trans.py

To run the inductive version,

python test_ind.py

You can refer to test_trans.py and test_ind.py for example usages of our model.

Models

The models are implemented mainly in trans_model.py (transductive) and ind_model.py (inductive), with inheritance from base_model.py. You might refer to the source files for detailed API documentation.

Prepare the data

Transductive learning

The input to the transductive model contains:

• x, the feature vectors of the training instances,
• y, the one-hot labels of the training instances,
• graph, a dict in the format {index: [index_of_neighbor_nodes]}, where the neighbor nodes are organized as a list. The current version only supports binary graphs.

Let L be the number of training instances. The indices in graph from 0 to L - 1 must correspond to the training instances, with the same order as in x.

Inductive learning

The input to the inductive model contains:

• x, the feature vectors of the labeled training instances,
• y, the one-hot labels of the labeled training instances,
• allx, the feature vectors of both labeled and unlabeled training instances (a superset of x),
• graph, a dict in the format {index: [index_of_neighbor_nodes]}.

Let n be the number of both labeled and unlabeled training instances. These n instances should be indexed from 0 to n - 1 in graph with the same order as in allx.

Hyper-parameter tuning

Refer to test_ind.py and test_trans.py for the definition of different hyper-parameters (passed as arguments). It is also important to tune the numbers of iterations for optimization, including init_ier_label, init_iter_graph, iter_graph, iter_inst, and iter_label.