Translation Tools

LLM translation toolkit for subtitle files.

Installation

Create a new environment with mamba:

mamba create -n tools git python pytorch pytorch-cuda -c conda-forge -c nvidia -c pytorch
mamba activate tools

Clone the repository and install requirements:

git clone https://github.com/zuellni/translation-tools
cd translations-tools
pip install -r requirements.txt

Use wheels for ExLlamaV2 and FlashAttention on Windows:

pip install exllamav2-X.X.X+cuXXX.torchX.X.X-cp3XX-cp3XX-win_amd64.whl
pip install flash_attn-X.X.X+cuXXX.torchX.X.X-cp3XX-cp3XX-win_amd64.whl

Download a model (Gemma-2-9B-It recommended) and translate something:

cd translations-tools
git lfs install
git clone https://huggingface.co/turboderp/gemma-2-9b-it-exl2 -b 6.0bpw --depth 1
python translate.py -h

Name		Name	Last commit message	Last commit date
Latest commit History 30 Commits
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
config.json.example		config.json.example
requirements.txt		requirements.txt
translate.py		translate.py
translate_vision.py		translate_vision.py