Harry Mellor

An open-source auction hosting system

A way to use superpixels at run-time with Pytorch

A collection of utilities and notebooks for analysing your finances

A high-throughput and memory-efficient inference and serving engine for LLMs

No description.

Optimized firmware for RepRap 3D printers based on the Arduino platform.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

FlashInfer: Kernel Library for LLM Serving

This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

A framework for few-shot evaluation of language models.

Common recipes to run vLLM

A Sphinx extension that automatically generates API documentation for your Python packages.

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

A Quartz fork used to publish ML notes made in Obsidian

This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.

No description.

No description.

Enforce the output format (JSON Schema, Regex etc) of a language model

Fast and memory-efficient exact attention

Tools to speed up using Selenium

Tools to speed up using Telegram bots

A selenium based Cookie Clicker bot