Skip to content

Commit

Permalink
Creating README documentation for examples
Browse files Browse the repository at this point in the history
  • Loading branch information
alyxdow authored Apr 20, 2023
1 parent 23a837b commit a4a20fe
Showing 1 changed file with 20 additions and 0 deletions.
20 changes: 20 additions & 0 deletions bark/assets/prompts/readme.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
# Example Prompts Data

The provided data is in the .npz format, which is a file format used in Python for storing arrays and data. The data contains three arrays: semantic_prompt, coarse_prompt, and fine_prompt.

```semantic_prompt```

The semantic_prompt array contains a sequence of token IDs generated by the BERT tokenizer from Hugging Face. These tokens encode the text input and are used as an input to generate the audio output. The shape of this array is (n,), where n is the number of tokens in the input text.

```coarse_prompt```

The coarse_prompt array is an intermediate output of the text-to-speech pipeline, and contains token IDs generated by the first two codebooks of the EnCodec Codec from Facebook. This step converts the semantic tokens into a different representation that is better suited for the subsequent step. The shape of this array is (2, m), where m is the number of tokens after conversion by the EnCodec Codec.

```fine_prompt```

The fine_prompt array is a further processed output of the pipeline, and contains 8 codebooks from the EnCodec Codec. These codebooks represent the final stage of tokenization, and the resulting tokens are used to generate the audio output. The shape of this array is (8, p), where p is the number of tokens after further processing by the EnCodec Codec.

Overall, these arrays represent different stages of a text-to-speech pipeline that converts text input into synthesized audio output. The semantic_prompt array represents the input text, while coarse_prompt and fine_prompt represent intermediate and final stages of tokenization, respectively.



0 comments on commit a4a20fe

Please sign in to comment.