Sebastian Raschka

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Learn how ChatGPT-style language models work by building one from scratch in PyTorch, chapter by chapter, with code you run yourself.

Implement a reasoning LLM in PyTorch from scratch, step by step

Code Repository for Machine Learning with PyTorch and Scikit-Learn

A collection of various deep learning architectures, models, and tips

A collection of Jupyter Notebooks implementing classic deep learning architectures, from basic perceptrons to CNNs like AlexNet and MobileNet, in both TensorFlow and PyTorch, with code and explanations side by side.

LLM Architecture Gallery source data

Minimal and readable coding agent harness implementation in Python to explain the core components of coding agents.

The "Python Machine Learning (1st edition)" book code repository and info resource

Jupyter Notebook code examples from the first edition of 'Python Machine Learning' by Sebastian Raschka, covering classification, clustering, neural networks, and text analysis using scikit-learn and NumPy.

The "Python Machine Learning (2nd edition)" book code repository and info resource

A library of extension and helper modules for Python's data analysis and machine learning libraries.

The "Python Machine Learning (3rd edition)" book code repository

A collection of tutorials and examples for solving and understanding machine learning and pattern classification tasks

Useful functions, tutorials, and other Python-related things

Repository for "Introduction to Artificial Neural Networks and Deep Learning: A Practical Guide with Applications in Python"

Examples of matplotlib codes and plots

A 4-hour coding workshop to understand how LLMs are implemented and used

An IPython magic extension for printing date and time stamps, version numbers, and hardware information

Machine Learning Q and AI book

Collection of useful machine learning codes and snippets (originally intended for my personal use)

Course material for STAT 479: Machine Learning (FS 2019) taught by Sebastian Raschka at University Wisconsin-Madison

No description.

STAT 453: Intro to Deep Learning @ UW-Madison (Spring 2020)

STAT 453: Intro to Deep Learning @ UW-Madison (Spring 2021)

Course material for STAT 479: Deep Learning (SS 2019) at University Wisconsin-Madison

PyPrind - Python Progress Indicator Utility

A repository with IPython notebooks of algorithms implemented in Python.

Course material for STAT 479: Machine Learning (FS 2018) at University Wisconsin-Madison

STAT 451: Intro to Machine Learning @ UW-Madison (Fall 2020)

A machine learning approach to classify songs by mood.

Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024

LoRA and DoRA from Scratch Implementations

No description.

A collection of tools to collect and download various data.

Code material for a data science tutorial

RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems

No description.

An ongoing fun challenge where I'll try to post one Python benchmark per day.

No description.

Machine learning with scikit-learn tutorial at PyData Chicago 2016

Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy

Machine learning with Python tutorial at MSU Data Science 2018

A collection of useful tutorials for Protein Science

A Python command line tool that creates a Table of Contents for Markdown documents

This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog post.

Cyclemoid implementation for PyTorch

A Python module to retrieve and compare SMILE strings of chemical compounds from the free ZINC online database

Code snippets for "Introduction to Deep Learning with TensorFlow" at PyData Ann Arbor Aug 2017

Supplementary material for the article "Model Evaluation, Model Selection, and Algorithm Selection in Machine Learning"

Ordinal Regression tutorial for the International Summer School on Deep Learning 2019

Gzip and nearest neighbors for text classification

Code examples for my Interpretable Machine Learning Blog Series

This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

Jupyter Notebook for the "Scientific Computing in Python: Introduction to NumPy and Matplotlib" blog article

R Scripts for general data analysis and plotting

Supplementary material for "Understanding Parameter-Efficient Finetuning of Large Language Models: From Prefix Tuning to Adapters"

Master programming by recreating your favorite technologies from scratch.

No description.

Utility functions for Python's multiprocessing standard library module

Utility functions for parsing BibTeX files and creating citation reference lists.

A repository to index and organize the latest machine learning courses found on YouTube.

Finetuning BLOOM on a single GPU using gradient-accumulation

Comparing four automatic image augmentation techniques in PyTorch: AutoAugment, RandAugment, AugMix, and TrivialAugment

Workshop materials for posit::conf(2023)

Collection of PyTorch-related utility functions

No description.

Calculates hydrogen-bond interaction tables for protein-small molecule complexes, based on protein PDB and protonated ligand MOL2 structure input. Raschka et al. (2018) J. Computer-Aided Molec. Design

No description.

No description.

Vision transformer finetuning scripts

Intro to GAN Tutorial for the International Summer School of Deep Learning 2021 in Gdansk

Various R lang related material for teaching.

screenlamp is a Python toolkit for hypothesis-driven virtual screening

Materials for the "My Workflow for Understanding LLM Architectures" tutorial

Activity From Virtual Screening Code Repository

Video+code lecture on building nanoGPT from scratch

A collection of PyMOL plugins to visualize atomic bonds.

Slides and code for the talk at UW-Madison's Data Science Club, 10 Oct 2019

Materials for "Transformers from the Ground Up" at PyData Jeddah on August 5, 2021

Experiments for the blog post "No, We Don't Have to Choose Batch Sizes As Powers Of 2"

A novel approach to pose selection in protein-ligand docking based on graph theory.

Scikit-learn tutorial at SciPy2016

MNIST files in PNG format

scikit-learn: machine learning in Python

Python command line tools as productivity supplements for Posix systems

Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.

Code for the paper "Language Models are Unsupervised Multitask Learners"

Sharing Deep Learning Research Models with Lightning Part 1: Building A Super Resolution App

Slides for my machine learning course based on Sebastian Raschka's Python Machine Learning book

Code for the DataPipes article

No description.

Native macOS app for splitting and converting PDF figures

No description.

The MATH training dataset without MATH-500 test portion

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Tools for generating hydrogen-bond interaction visualizations from Hbind

Deep learning framework to train, deploy, and ship AI products Lightning fast.

Protein Recognition Index (PRI), measuring the similarity between H-bonding features in a given complex (predicted or designed) and the characteristic H-bond trends from crystallographic complexes

Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.

Implementation of SAN model for imparting gender privacy to face images

PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, EfficientNetV2, NFNet, Vision Transformer, MixNet, MobileNet-V3/V2, RegNet, DPN, CSPNet, and more

Model evaluation utilities

NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day

A Python tool that automatically creates and optimizes Machine Learning pipelines using genetic programming.

matplotlib: plotting with Python

No description.

8-bit CUDA functions for PyTorch

https://huyenchip.com/ml-interviews-book/

Ordinal Regression PyTorch Hub

No description.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Go ahead and axolotl questions

✨A Python framework to explore, label, and monitor data for NLP projects

A playbook for systematically maximizing the performance of deep learning models.

Debug GitHub rendering issues

Code for "TorchMetrics -- How do we use it, and what's the difference between .update() and .forward()"

My Solutions for the Advent of Code 2016

Computation using data flow graphs for scalable machine learning

A repository to store code examples to reproduce issues for bug reports.

Implementation of DoRA

The website for PyTorch

Conditional GAN for generating synthetic tabular data.

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.

The fundamental package for scientific computing with Python.

Word cloud from the results of the book-giveaway

Machine learning metrics for distributed, scalable PyTorch applications.

Ten Simple Rules for Deep Learning in Biology

Face recognition with deep neural networks.

A collaboratively written review paper on deep learning, genomics, and precision medicine

Python module to perform under sampling and over sampling with various techniques.

A place to submit conda recipes before they become fully fledged conda-forge feedstocks

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, quantization, LoRA fine-tuning, pre-training. Apache 2.0-licensed.

An Implementation of Mutli-layer Perceptron in C++

Distributed skorch on Ray Train

Bayesian Additive Regression Trees For Python

A web based tool for visualization of the forward and reverse modes of automatic differentiation

Website for NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1 GPU + 1 Day

Tensorflow Keras implementation of ordinal regression using consistent rank logits (CORAL) by Cao et al. (2019)

No description.

No description.

A conda-smithy repository for biopandas.

Data loaders and abstractions for text and NLP

No description.

Project documentation with Markdown.

Public repository for managing Grid Platform documentation synced with gitbook on docs.grid.ai

No description.

A conda-smithy repository for watermark.

Tiny python-markdown extension for easier use of MathJax with Markdown

A conda-smithy repository for mlxtend.