13-day longest streak
👋 This is Kaichao You, a tech lover! I'm a researcher in AI/ML, and participate in open-source projects I use. Since 2024, I have been working on vLLM, a high-performance…
👋 This is Kaichao You, a tech lover!
I'm a researcher in AI/ML, and participate in open-source projects I use. Since 2024, I have been working on vLLM, a high-performance and easy-to-use library for LLM inference.
I'm now starting Inferact Inc. as a co-founder and Chief Scientist. Inferact was founded by creators and core maintainers of vLLM, aiming to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Check the blog for my story and the announcement for the company.
We are actively hiring strong candidates in AI inference, distributed systems, and machine learning. Please submit your application or email me.
If you want to know my research, please visit my personal homepage. This page is about my open-source contributions.
⚡ Fun fact:
You know what? If you are working with AI/ML, there are probably some lines of code in your computer/server that are written by me!
:sunglasses: Repos I made technical contributions to:
Thanks to the education in Tsinghua University, I’m equipped with full-stack abilities, ranging from low-level (assembly), backend (django) to high-level (deep learning frameworks), frontend (vue). Therefore, I occasionally participate in many open-source projects. Below is an incomplete list of my open-source contributions:
I'm a core developer for:
[](https://github.com/vllm-project/vllm)
[](https://github.com/thu-ml/tianshou)
I'm a collaborator and constantly contribute to:
[](https://github.com/pytorch/pytorch)
I contribute a language server protocol (LSP) to triton:
[](https://github.com/openai/triton)
I have many other random contributions to the following famous open-source projects:
[](https://github.com/llvm/llvm-project)
[](https://github.com/antlr/antlr4)
[](https://github.com/open-mmlab/mmcv)
[](https://github.com/open-mmlab/mmengine)
[](https://github.com/open-mmlab/mmdetection)
[](https://github.com/openai/tiktoken)
[](https://github.com/pytorch/vision)
<!--
youkaichao/youkaichao is a ✨ _special_ ✨ repository because its README.md (this file) appears on your GitHub profile.
Here are some ideas to get you started:
- 🔭 I’m currently working on ...
- 🌱 I’m currently learning ...
- 👯 I’m looking to collaborate on ...
- 🤔 I’m looking for help with ...
- 💬 Ask me about ...
- 📫 How to reach me: ...
- 😄 Pronouns: ...
- ...
-
pytorch ★ PINNED ⑂
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Python ★ 0 7mo agoExplain → -
mmdetection ★ PINNED ⑂
Open MMLab Detection Toolbox
Python ★ 1 7y agoExplain → -
antlr4 ★ PINNED ⑂
ANTLR (ANother Tool for Language Recognition) is a powerful parser generator for reading, processing, executing, or translating structured text or binary files.
Java ★ 1 7y agoExplain → -
triton ★ PINNED ⑂
Development repository for the Triton language and compiler
C++ ★ 0 2y agoExplain → -
tianshou ★ PINNED ⑂
An elegant, flexible, and superfast PyTorch deep Reinforcement Learning platform.
Python ★ 1 5y agoExplain → -
vllm ★ PINNED ⑂
A high-throughput and memory-efficient inference and serving engine for LLMs
Python ★ 10 2mo agoExplain → -
onenote-to-markdown ⑂
OneNote导出成Markdown文件的脚本
Python ★ 69 3y agoExplain → -
minidb
minimal database
Java ★ 41 7y agoExplain → -
fast_bpe_tokenizer
fast bpe tokenizer, simple to understand, easy to use
Jupyter Notebook ★ 28 3y agoExplain → -
dolly ⑂
No description.
Python ★ 26 3y agoExplain → -
youkaichao
github profile
★ 23 1d agoExplain → -
my-portable-aiml-environment
A dockerfile to build my portable environment for AI/ML development, with some daily used packags!
Dockerfile ★ 22 1y agoExplain → -
mnist-wrong-test
test images with not appropriate labels in MNIST dataset
★ 10 8y agoExplain → -
ftp-project
ftp-project for the network course
Python ★ 9 7y agoExplain → -
daka
No description.
★ 9 5y agoExplain → -
list_pytorch_nightly
List recently available pytorch nightly version, for every day
★ 8 2y agoExplain → -
compiler
No description.
Python ★ 6 7y agoExplain → -
conda-migrate
How to migrate conda/anaconda/miniconda (far more than just a `mv`!)
★ 5 6y agoExplain → -
awsome-domain-adaptation ⑂
A collection of AWESOME things about domian adaptation
★ 5 6y agoExplain → -
hello_frame_eval
A hello-world usage for frame eval api.
C ★ 4 2y agoExplain → -
flashinfer ⑂
FlashInfer: Kernel Library for LLM Serving
Python ★ 3 3mo agoExplain → -
ChallengeHub
Software Engineering 2018 project, collegiate contest platform
Vue ★ 3 7y agoExplain → -
CGproject
No description.
JavaScript ★ 3 5y agoExplain → -
DeepSeek-V3.2-Exp ⑂
No description.
★ 2 9mo agoExplain → -
DeepSeek-V3 ⑂
No description.
★ 2 10mo agoExplain → -
py_blame
blame the function that changes something
Python ★ 2 1y agoExplain → -
xz-detector
Just `xz --version` is not enough!
C ★ 2 2y agoExplain → -
archlab
archlab for CSAPP course
C ★ 2 7y agoExplain → -
EmbeddedSystem
No description.
nesC ★ 2 7y agoExplain → -
simple-rsa
simple rsa implementation
Python ★ 2 5y agoExplain → -
vllm-project.github.io ⑂
No description.
★ 1 1y agoExplain → -
tutorials ⑂
No description.
Jupyter Notebook ★ 1 9mo agoExplain → -
pplx-kernels ⑂
Perplexity GPU Kernels
C++ ★ 1 1y agoExplain → -
torch_cmake_example
No description.
CMake ★ 1 1y agoExplain → -
TRUMPY
Analyze backward memory usage in pytorch!
Python ★ 1 3y agoExplain → -
LLaMA-Factory ⑂
Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
★ 1 1y agoExplain → -
shared_buffer_extension
No description.
C++ ★ 1 1y agoExplain → -
flash-attention ⑂
Fast and memory-efficient exact attention
Python ★ 1 1y agoExplain → -
WtfTicket
No description.
Python ★ 1 7y agoExplain → -
mmcv ⑂
Open MMLab Computer Vision Foundation
Python ★ 1 2y agoExplain → -
vision ⑂
Datasets, Transforms and Models specific to Computer Vision
Jupyter Notebook ★ 1 6y agoExplain → -
PromptPapers ⑂
Must-read papers on prompt-based tuning for pre-trained language models.
★ 1 4y agoExplain → -
haskell-project
project for the haskell course with a Haskell-to-Javascript compiler
Haskell ★ 1 7y agoExplain → -
flappygun
web project, not sure it can work now
JavaScript ★ 1 7y agoExplain → -
human-pose-estimation.pytorch ⑂
The project is an official implement of our ECCV2018 paper "Simple Baselines for Human Pose Estimation and Tracking(https://arxiv.org/abs/1804.06208)"
Python ★ 1 7y agoExplain → -
d2l-en ⑂
Dive into Deep Learning, Berkeley STAT 157 (Spring 2019) textbook. With code, math, and discussions.
Python ★ 1 7y agoExplain → -
cpython ⑂
The Python programming language
Python ★ 1 6y agoExplain → -
competition_submission_template ⑂
The submission template for the MineRL Competition @ NeurIPS 2019. Clone this to make a new submission! BASELINES HERE:
★ 1 6y agoExplain → -
linux ⑂
Linux kernel source tree
★ 1 4y agoExplain → -
ddd20-utils ⑂
DDD20 End-to-End Event Camera Driving Dataset
Jupyter Notebook ★ 1 4y agoExplain → -
cmake_example ⑂
Example pybind11 module built with a CMake-based build system
Python ★ 1 4y agoExplain → -
randomnames
random names
★ 1 7y agoExplain → -
AsmPainter
assembly implementation of a windows painter
Assembly ★ 1 7y agoExplain → -
nixl ⑂
NVIDIA Inference Xfer Library (NIXL)
★ 0 2mo agoExplain → -
uv ⑂
An extremely fast Python package and project manager, written in Rust.
Rust ★ 0 10mo agoExplain → -
wheelnext ⑂
WheelNext Website
★ 0 10mo agoExplain → -
DeepEP ⑂
DeepEP: an efficient expert-parallel communication library
Cuda ★ 0 1y agoExplain → -
expecttest ⑂
No description.
Python ★ 0 1y agoExplain → -
mmengine ⑂
OpenMMLab Foundational Library for Training Deep Learning Models
Python ★ 0 2y agoExplain → -
transformers ⑂
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
★ 0 1y agoExplain → -
pack_nvshmem
No description.
Shell ★ 0 1y agoExplain → -
AttrDictX ⑂
A dictionary that allows attribute-style access, for py 312
Python ★ 0 1y agoExplain → -
DeepSpeedExamples ⑂
Example models using DeepSpeed
★ 0 2y agoExplain → -
rlhf_debug
No description.
Python ★ 0 1y agoExplain → -
rfcs ⑂
PyTorch RFCs (experimental)
★ 0 1y agoExplain → -
buildkite-ci ⑂
No description.
HCL ★ 0 1y agoExplain → -
filelock ⑂
A platform-independent file lock for Python.
★ 0 2y agoExplain → -
compare_pass_data
No description.
Python ★ 0 2y agoExplain → -
mypy ⑂
Optional static typing for Python
★ 0 2y agoExplain → -
llvm-project ⑂
The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.
★ 0 2y agoExplain → -
tiktoken ⑂
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Python ★ 0 3y agoExplain → -
Auto-GPT ⑂
An experimental open-source attempt to make GPT-4 fully autonomous.
Python ★ 0 3y agoExplain → -
easydl
utils to make deep learning easy
Python ★ 0 8y agoExplain → -
DiscreteMathHomework
Discrete Math Programming Homework of 2017 Spring
Python ★ 0 9y agoExplain → -
camera_monitor ⑂
Project for 2018 web backend semester (python course)
Python ★ 0 7y agoExplain → -
decision_boundary_for_neural_networks
demo to draw decision boundary for neural networks
Jupyter Notebook ★ 0 7y agoExplain → -
Xlearn ⑂
Transfer Learning Library
Jupyter Notebook ★ 0 8y agoExplain → -
HardwareDesigning
No description.
ASP ★ 0 9y agoExplain → -
match
[真人图书馆]匹配程序
Python ★ 0 9y agoExplain →
No repos match these filters.