Skip to content

Commit

Permalink
Fix typo
Browse files Browse the repository at this point in the history
  • Loading branch information
eric-haibin-lin authored Nov 24, 2018
1 parent 1cd50d7 commit f76bd0f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tokenization.py
Original file line number Diff line number Diff line change
Expand Up @@ -99,7 +99,7 @@ def convert_ids_to_tokens(inv_vocab, ids):


def whitespace_tokenize(text):
"""Runs basic whitespace cleaning and splitting on a peice of text."""
"""Runs basic whitespace cleaning and splitting on a piece of text."""
text = text.strip()
if not text:
return []
Expand Down

0 comments on commit f76bd0f

Please sign in to comment.