To install dependencies, run:
pip3 install transformers datasets tokenizers sentencepiece xformers==0.0.16 scikit-learn accelerate hydra-core hydra-joblib-launcher hydra-ax-sweeper omegaconf python-box
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117