To generate the completions (after pip installing the requirements), run:
mkdir results
python run.py
Then to evaluate the completion results, run
pip3 install -e .
evaluate_functional_correctness results/name_of_results_file
khulnasoft/eval
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|