Skip to content

Commit 0121667

Browse files
Added comment about the bug in the LSTM
1 parent 774d7ce commit 0121667

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

vis_lstm_model.py

+3
Original file line numberDiff line numberDiff line change
@@ -54,6 +54,9 @@ def forward_pass_lstm(self, word_embeddings):
5454
c[lstm_step] = i * new_c
5555
else:
5656
c[lstm_step] = f * c[lstm_step-1] + i * new_c
57+
58+
# BUG IN THE LSTM --> Haven't corrected this yet, Will have to retrain the model.
59+
# h[lstm_step] = o * tf.nn.tanh(c[lstm_step])
5760
h[lstm_step] = o * tf.nn.tanh(new_c)
5861
layer_output.append(h[lstm_step])
5962

0 commit comments

Comments
 (0)