Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Crystalcareai authored Sep 10, 2024
1 parent b328b4f commit 04fe628
Showing 1 changed file with 6 additions and 4 deletions.
10 changes: 6 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# EvolKit

EvolKit is an innovative framework for automatically enhancing the complexity of instructions used in fine-tuning Large Language Models (LLMs). Our project aims to revolutionize the evolution process by leveraging open-source LLMs, moving away from closed-source alternatives.
EvolKit is an framework for automatically enhancing the complexity of instructions used in fine-tuning Large Language Models (LLMs). Our project aims to revolutionize the evolution process by leveraging open-source LLMs, moving away from closed-source alternatives.

## Key Features

Expand Down Expand Up @@ -53,9 +53,9 @@ python run_evol.py --dataset <dataset_name> [options]

### Models

We found 2 models work the best:
We found 2 models that work very well with this pipeline:
- Qwen2-72B-Instruct and DeepSeek-V2.5 (GPTQ and AWQ versions are fine too).
- Other models might works but it has to be very good at generating structured content (in order to parse using parsing operations)
- Other models might work but it has to be very good at generating structured content (in order to parse using parsing operations)

### VLLM Support

Expand Down Expand Up @@ -110,5 +110,7 @@ EvolKit consists of several key components:

The script saves the results in JSON format to the specified output file. Each entry in the JSON file represents an evolved instruction along with relevant metadata.

Find a 20k subset of a dataset generated using EvolKit [here](https://huggingface.co/datasets/arcee-ai/EvolKit-20k)

## Acknowledgement
- Microsoft's WizardLM team for the inspiration from the [AutoEvol paper](https://arxiv.org/pdf/2406.00770).
- Microsoft's WizardLM team for the inspiration from the [AutoEvol paper](https://arxiv.org/pdf/2406.00770).

0 comments on commit 04fe628

Please sign in to comment.