Software
I’ve developed tools to support research on language and large-scale text data.
Blowtorch
macOS utility for connecting to NYU’s Torch cluster
Simplifies the process of working on the Torch supercomputing cluster by combining authentication, job submission, SSH, and IDE launch into a single interface.
lexichron
Python tools for studying semantic change in large corpora
Pipelines for preparing and analyzing large text corpora (e.g., Google Ngrams and COHA). Supports data acquisition, filtering, restructuring, and training word embedding models..
batchify
R package to turn notebooks into Slurm scripts
Run in a notebook cell to submit the entire notebook as a configurable Slurm batch job. Optionally fence code to include or exclude from the job.batchify-py
Python package to turn notebooks into Slurm scripts
Python port of batchify. Run in a notebook cell to submit the entire notebook as a configurable Slurm batch job. Optionally fence code to include or exclude from the job.