Skip to content

Commit

Permalink
doc: update Readme.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ryan-nccu committed Dec 27, 2024
1 parent 523775a commit acc6009
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ python ./rag.py --index "bm25" --dataset "hotpotqa-train" --similarity bertscore
#### `--maxKnowledge` parameter notice:
> [!NOTE]
> Approximate Tokens count corresponding to knowledge document size of "squad-train" and "hotpotqa-train" dataset.
>
> datasets=("squad-train")
> - when k = 3, tokens = 21,000
> - when k = 4, tokens = 32,000
Expand All @@ -90,8 +90,8 @@ python ./rag.py --index "bm25" --dataset "hotpotqa-train" --similarity bertscore
#### `--maxQuestion` parameter notice:
> - when using "squad-train" dataset, 1 knowledge has average 150 questions
> - when using "hotpotqa-train" dataset, 1 knowledge has 1 question
>
> [!NOTE]
> [!TIP]
> Since 1 document in "hotpoqa-train" dataset has only 1 question, it may not satisfy large-scale evaluation.
> Multiple evaluation could be a relatively better approach.
>
Expand Down

0 comments on commit acc6009

Please sign in to comment.