Name		Name	Last commit message	Last commit date
parent directory ..
java/dev/pigweed/tokenizer		java/dev/pigweed/tokenizer
pool		pool
public/pw_tokenizer		public/pw_tokenizer
pw_tokenizer_private		pw_tokenizer_private
py		py
BUILD.bazel		BUILD.bazel
BUILD.gn		BUILD.gn
CMakeLists.txt		CMakeLists.txt
README.md		README.md
add_tokenizer_sections_to_default_script.ld		add_tokenizer_sections_to_default_script.ld
argument_types_test.cc		argument_types_test.cc
argument_types_test_c.c		argument_types_test_c.c
backend.gni		backend.gni
base64.cc		base64.cc
base64_test.cc		base64_test.cc
database.gni		database.gni
decode.cc		decode.cc
decode_test.cc		decode_test.cc
detokenize.cc		detokenize.cc
detokenize_fuzzer.cc		detokenize_fuzzer.cc
detokenize_test.cc		detokenize_test.cc
docs.rst		docs.rst
encode_args.cc		encode_args.cc
generate_decoding_test_data.cc		generate_decoding_test_data.cc
global_handlers_test.cc		global_handlers_test.cc
global_handlers_test_c.c		global_handlers_test_c.c
hash.cc		hash.cc
hash_test.cc		hash_test.cc
options.proto		options.proto
proto.rst		proto.rst
pw_tokenizer_linker_sections.ld		pw_tokenizer_linker_sections.ld
simple_tokenize_test.cc		simple_tokenize_test.cc
token_database.cc		token_database.cc
token_database_fuzzer.cc		token_database_fuzzer.cc
token_database_test.cc		token_database_test.cc
tokenize.cc		tokenize.cc
tokenize_test.cc		tokenize_test.cc
tokenize_test_c.c		tokenize_test_c.c
tokenize_to_global_handler.cc		tokenize_to_global_handler.cc
tokenize_to_global_handler_with_payload.cc		tokenize_to_global_handler_with_payload.cc

README.md

pw_tokenizer: Tools for replacing string literals with binary tokens

pw_tokenizer is a portable, general purpose module for replacing printf-style string literals with compact binary tokens.