Thomas Parnell

A high-throughput and memory-efficient inference and serving engine for LLMs

IBM development fork of https://github.com/huggingface/text-generation-inference

Can AI Agents Build Bespoke LLM Serving Systems?

vLLM plugin for Spyre based on torch-spyre

No description.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Fast and memory-efficient exact attention

FM Benchmarking Framework

🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

vLLM adapter for a TGIS-compatible gRPC server.

Demonstrate throughput of PyTorch FSDP

No description.

No description.

LLM training code for MosaicML foundation models

Library for Semi-Automated Data Science

The source code that powers readthedocs.org

This repo contains ancillary information used to assist users of IBM Watson Machine Learning Community Edition. This repo will contain How To's, Readme's, Dockerfiles, etc. that can be consumed by users looking to get started.

A template Sphinx repo

OpenML AutoML Benchmarking Framework