termic-data

Warning
This repo has been archived as termic data is now stored on Dropbox. Scripts are now available in the main termic repo.

---

This repository contained Microsoft's translation memory and glossary files used by termic. Check the termic repo for more information on data collection.

Structure

• /csv_to_merge: seperate .csv translation memory files for each language,
• /data: merged .csv translation memory files (see merge_csv.py) and .xslx glossary files for each language,
• /feather: examples of pandas feather file (for local data),
• /scripts:
  • convert_to_feather.py: use this script to convert .csv and .xlsx files to the feather format,
  • merge_csv.py: use this script to merge the .csv files in the csv_to_merge folder into one .csv file.

Usage

NOTE: was written specifically for merge_csv.py.

Set up a virtualenv:

mkdir -p ~/.cache/virtualenvs
python3 -m venv ~/.cache/virtualenvs/termic-data
source ~/.cache/virtualenvs/termic-data/bin/activate
python3 -m pip install -r ./scripts/requirements.txt

Contributors

• benediktkr