Skip to content

Commit

Permalink
(cleaned up a comment)
Browse files Browse the repository at this point in the history
  • Loading branch information
frankseide committed May 6, 2016
1 parent b41df14 commit ed75033
Show file tree
Hide file tree
Showing 2 changed files with 0 additions and 26 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -156,19 +156,6 @@ speechTrain = [
z = W * S(LSTMoutput[numLSTMLayers]) + B; // top-level input to Softmax

// training
# vvv PROBABLY OUTDATED
# TODO: the following fails with useExplicitCriterion = true in FullUtterance mode:
# --> 'err' gets overwritten by crExplicit
# and with useExplicitCriterion = fals:
# --> 'err' comes out equal to 'ce'
# and the crExplicit value also comes out inaccurate (while it is totally fine with Truncated LSTM)
# so do it this way for now:
#ce = CrossEntropyWithSoftmax(labels, z, tag='criterion')
# ^^^ PROBABLY OUTDATED

#ce = CrossEntropyWithSoftmax(labels, z, tag='criterion') // this is the objective, as a node
#err = ErrorPrediction(labels, z, tag='evaluation') // this also gets tracked

# this shows how both CE and frame error rate can be constructed as BS expressions
# BUGBUG: The per-sample criterion will trigger a bug fix in momentum computation
# which leads to a slightly better objective value than the baseline.
Expand Down
13 changes: 0 additions & 13 deletions Tests/EndToEndTests/Speech/LSTM/cntk.cntk
Original file line number Diff line number Diff line change
Expand Up @@ -138,19 +138,6 @@ speechTrain = [
z = W * S(LSTMoutput[numLSTMLayers]) + B; // top-level input to Softmax

// training
# vvv PROBABLY OUTDATED
# TODO: the following fails with useExplicitCriterion = true in FullUtterance mode:
# --> 'err' gets overwritten by crExplicit
# and with useExplicitCriterion = fals:
# --> 'err' comes out equal to 'ce'
# and the crExplicit value also comes out inaccurate (while it is totally fine with Truncated LSTM)
# so do it this way for now:
#ce = CrossEntropyWithSoftmax(labels, z, tag='criterion')
# ^^^ PROBABLY OUTDATED

#ce = CrossEntropyWithSoftmax(labels, z, tag='criterion') // this is the objective, as a node
#err = ErrorPrediction(labels, z, tag='evaluation') // this also gets tracked

# this shows how both CE and frame error rate can be constructed as BS expressions
# BUGBUG: The per-sample criterion will trigger a bug fix in momentum computation
# which leads to a slightly better objective value than the baseline.
Expand Down

0 comments on commit ed75033

Please sign in to comment.