Machine Learning Engineering Open Book

The Art of Debugging Open Book

helper git tools

Automatic GPU+CPU memory profiling, re-use and memory leaks detection using jupyter/ipython experiment containers

ML/DL Math and Method notes

Stas' Python Cookbook - Python recipes that I use daily

Helper scripts and notes that were used while porting various nlp models

Python tools

No description.

Convert arctic_shift Reddit data dumps into thread-view documents

Video Transcripts of fast.ai MOOC courses made into searchable ebooks

🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

helper tools for the conda environment

Fine-Tune EleutherAI GPT-Neo And GPT-J-6B To Generate Netflix Movie Descriptions Using Hugginface And DeepSpeed

Bash tools

a very basic Google Earth kml generator

A pytest plugin to run ipython/jupyter notebook cells as unit/integration tests

jupyter-notebook-tools

No description.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

an effort to resist Internet entropy - save useful knowledge

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

A simple way to train and use NLP models with multi-GPU, TPU, mixed-precision

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

GPU Logger for jupyter/ipython (memory usage, execution time)

A distributed deep learning framework that supports flexible parallelization strategies.

💥Fast State-of-the-Art Tokenizers optimized for Research and Production

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Deep learning for dummies. All the practical details and useful utilities that go into working with real models.

Merges pdfs and creates handy outline

🤗 Fast, efficient, open-access datasets and evaluation metrics for Natural Language Processing and more in PyTorch, TensorFlow, NumPy and Pandas

No description.

NeMo: a toolkit for conversational AI

make tools

Example models using DeepSpeed

pytorch code examples for measuring the performance of collective communication calls in AI workloads

Fast Inference Solutions for BLOOM

Simple and flexible progress bar for Jupyter Notebook and console

Miscellaneous tools

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

The k6 documentation website.

A high-throughput and memory-efficient inference and serving engine for LLMs

No description.

tensorboard tools

Cloud HPC Toolkit is an open-source software offered by Google Cloud which makes it easy for customers to deploy HPC environments on Google Cloud.

Pocket Survival Guide for Sys Admin - http://psg.skinforum.org/ -

Monitor processes and parallel workloads for hangs

TP/PP/DP implementation of llama using apex blocks

Explorations in building seq2seq models using PyTorch and fast.ai

Public repo for HF blog posts

The friendly PIL fork (Python Imaging Library)

Traversal over Python's objects sub-tree and calculating the total size of the sub-tree (deep size).

Official repository for IPython itself. Other repos in the IPython organization contain things like the website, documentation builds, etc.

IPython Kernel for Jupyter

Python bindings for NVIDIA CUDA APIs.

Projects and exercises for the latest Deep Learning ND program https://www.udacity.com/course/deep-learning-nanodegree--nd101

The fast.ai deep learning library, lessons, and tutorials

Crosswalk of ICD-9-CM to ICD-10-CM diagnostic codes for common pain conditions. Organized into diagnostic clusters for population pain research based on U.S. National Pain Strategy framework.

Various work files for fast.ai lessons

MIMIC Code Repository: Code shared by the research community for the MIMIC-III database

Code for Stanford CS224u

Unsupervised Language Model Pre-training for French

The lightweight PyTorch wrapper for ML researchers. Scale your models. Write less boilerplate

little scripts to make things easier when building nlp things

Submission to https://pytorch.org/hub/

No description.

No description.

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

Benchmarks are the key to sustainable software developement

[Prototype] Tools for the concurrent manipulation of variably sized Tensors.

my machine learning note

PyTorch extensions for high performance and large scale training.

v1 of the fastai library. v2 is the current version. v1 is still supported for bug fixes, but will not receive new features.

Totally Versatile Miscellanea for Pytorch

Task Manager for Linux for Nvidia graphics cards

Profiling and inspecting memory in pytorch

No description.

Pytest plugin for analyzing resource usage during test sessions

Codebase for the project

Ongoing research training transformer language models at scale, including: BERT & GPT-2

functorch is a prototype of JAX-like composable function transforms for PyTorch.

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

Ongoing research training transformer models at scale

Easily store custom metadata with setuptools.

Innioasis Updater is a Firmware Installer / Updater / Reset tool for Innioasis Y1 on Windows, Mac and Linux. Developed by Ryan Specter as a fork of mtkclient

verl: Volcano Engine Reinforcement Learning for LLMs

Camera controls for Linux

cgmemtime measures the high-water RSS+CACHE memory usage of a process and its descendant processes.

Fixing weird quirks and poor defaults

Simple python script to convert m4b audio books to a group of mp3 files split by chapter.

Making large AI models cheaper, faster and more accessible

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

Profiling for the Habana Gaudi.

Global middle-mouse-click copy/paste for Mac OSX (C).

DeepSpeed FastGen

SGLang is a fast serving framework for large language models and vision language models.

A stand-alone implementation of several NumPy dtype extensions used in machine learning.

NVIDIA GPU metrics exporter for Prometheus leveraging DCGM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization, sparsity, distillation, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.

8-bit CUDA functions for PyTorch

No description.

Making Reddit data accessible to researchers, moderators and everyone else. Interact with the data through large dumps, an API or web interface.

Development repository for the Triton language and compiler

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financial LLMs. Our goal is to continually push forward the open-source development of financial artificial intelligence (AI).

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

NCCL Tests

Simple, Elegant, Typed Argument Parsing with argparse

No description.

M4 experiment logbook

Repo for external large-scale work

Pipeline for pulling and processing online language model pretraining data from the web

A Python module that converts a list of dictionaries to a markdown formatted table.

version-string management for VCS-controlled trees

Basic notebook checks. Do they run? Do they contain lint?

Tool that allows interactive SNOMED, ICD-10, MeSH, and NLM lookups

Controlling GPU fan speed on a headless linux computer requires spoofing a display.

Source code examples from the Parallel Forall Blog

Run IPython notebooks as command-line scripts, generate HTML reports

A tool for writing test procedures and automation code in Jupyter notebook which can then be executed using pytest.

An utility for watching the memory consumption and time spent on each IPython input cell

IPython tool to report memory usage deltas for every command you type

Estimates the size of a PyTorch model in memory

A small package to create visualizations of PyTorch execution graphs

make your debug printing more friendly

Datasets, Transforms and Models specific to Computer Vision

Collection of generative models in Pytorch version.

Model summary in PyTorch similar to `model.summary()` in Keras

A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.

PyTorch implementation of image classification models for CIFAR-10/CIFAR-100/MNIST/FashionMNIST

Python 3 Bindings for the NVIDIA Management Library

No description.

Conda documentation

hub helps you win at git.

The 3rd edition of course.fast.ai - coming in 2019

An informative and fancy bash prompt for Git users

Documentation source for fastai (see http://docs.fast.ai for final docs)

Check links and anchors in Web pages or full Web sites.

check links in web documents or full websites

A simple JavaScript table of contents, designed for Jekyll (or similar) sites.

Easy TOC creation for GitHub README.md

Sample Python Django application for Azure Pipelines docs

Custom git commands I have in my $PATH (~/bin)

Commands and tools for building conda packages

Send notification emails for pushes to a git repository (an improved version of post-receive-mail)

:arrow_right_hook: Runs scripts from webhooks.

Email change notifications for git (and GitHub).

:outbox_tray: A github WebHook that emails detailed diffs of your commits.

The official Emacswiki repository