This Feedforward Neural Network was implemented from scratch (without the use of any existing NN library) as a project for the course in Machine Learning (ML).
Among the features implemented, there are:
- Stochastic gradient descent
- Various activation functions
- Gradient computations
- Gradient correctness checker
- Momentum
- L2 regularization
- Layer Normalization
- Dropout
- Simple ensemble model