Yuchen Cheng

LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

Distributed ML Training and Fine-Tuning on Kubernetes

☸️ Easy, advanced inference platform for large language models on Kubernetes

A light weight vLLM simulator, for mocking out replicas.

GenAI inference performance benchmarking tool

A Kubernetes Native Batch System (Project under CNCF)

A Scrapy extension for sending notification to Slack channels

PDM project template of @rudeigerc

A tool converting .csv file to .xes

dblp-visualizer

@rudeigerc's personal blog

Raycast extension for Zotero

No description.

Command line tool for Dex IdP gRPC interface

No description.

A minimal theme for Hugo

Reading List for Stream Processing

Trackio integration for MLflow tracking store

A lightweight, local-first, and free experiment tracking Python library built on top of 🤗 Datasets and Spaces.

A simple Zsh plugin for sending notifications to other services

Shiki transformer that adds an extra file title

Container Signing

lab-cse

A naive web bookstore

Programming projects from Stanford CS193p course

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)

Run OpenClaw more securely inside NVIDIA OpenShell with managed inference

Client for OpenClaw — Connect ClawWork to your own OpenClaw and unlock 10x multi-session productivity.

Community Repo for Nowledge Labs Products

Offline optimization of your disaggregated Dynamo graph

Bub it. Build it.

xURL: Client for AI Agents URLs

A workload for deploying LLM inference services on Kubernetes

Variant optimization autoscaler for distributed inference workloads

A Datacenter Scale Distributed Inference Serving Framework

a CLI tool to compare CustomResourceDefinitions and identify breaking changes

@rudeigerc's agent skills

A framework for efficient model inference with omni-modality models

General-purpose web UI for Kubernetes clusters

verl: Volcano Engine Reinforcement Learning for LLMs

AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.

No description.

No description.

agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.

Benchmark and optimize LLM inference across frameworks with ease

Kubeflow SDK for ML Experience

PyTorch native post-training library

Apache OpenDAL: access data freely.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

Cloud Native Benchmarking of Foundation Models

Cost-efficient and pluggable Infrastructure components for GenAI inference

Shiki transformer that adds a copy-to-clipboard button

Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. It fills a gap between model experimentation and production activities. It provides a central interface for all stakeholders in the MLOps lifecycle to collaborate on ML models.

Repository used to main group ACLs used by Kubeflow developers

Kubeflow Website

llm-d benchmark scripts and tooling

JobSet: An API for managing a group of Jobs as a unit

Gateway API Inference Extension

SGLang is a fast serving framework for large language models and vision language models.

@rudeigerc's dotfiles

@rudeigerc's NeoVim config

The Cloud-Native API Gateway and AI Gateway

Automated Machine Learning on Kubernetes

Kubernetes-based, scale-to-zero, request-driven compute

Terraform VMware vSphere provider

Home of the Hierarchical Namespace Controller (HNC). Adds hierarchical policies and delegated creation to Kubernetes namespaces for improved in-cluster multitenancy.

A container runtime written in Rust

A gRPC Go middleware for validating messages via bufbuild/protovalidate following Google's API Improvement Proposals AIP-193

Protocol Buffer Validation - Go, Java, Python, and C++ Beta Releases!

Structured Text Generation

Kubernetes WithOut Kubelet - Simulates thousands of Nodes and Clusters.

CEL Playground provides a simple and user-friendly interface to write and quickly evaluate CEL expressions.

Golang gRPC Middlewares: interceptor chaining, auth, logging, retries and more.

Typer, build great CLIs. Easy to code. Based on Python type hints.

A high-throughput and memory-efficient inference and serving engine for LLMs

A Go framework for end-to-end testing of components running in Kubernetes clusters.

knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.

Machine Learning Pipelines for Kubeflow

Machine Learning Toolkit for Kubernetes

User-friendly WebUI for LLMs (Formerly Ollama WebUI)

Operating LLMs in production

A modern Python package and dependency manager supporting the latest PEP standards

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Helm chart repository

Tekton demo for Python projects

Performance tests and benchmarks

A demo project using pybind11 and CMake with PDM

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Easily create a beautiful website using Academic and Hugo

Generation of diagrams like flowcharts or sequence diagrams from text in a similar manner as markdown

An extension pack including a set of extensions for Python development in Visual Studio Code

Go project template of @rudeigerc

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

The build backend used by PDM that supports latest packaging standards.

Event triggering with Tekton!

Catalog of shared Tasks and Pipelines.

Dex Operator for Kubernetes

A toolkit to run Ray applications on Kubernetes

CLI for building apps using Cloud Native Buildpacks

icslabs

SE344 - Computer Graphics

A naive particle system simulating the fire

TeamNote is a platform for people to share and create notes together.

Docker-compatible CLI for containerd, with support for Compose

The Finch CLI an open source client for container development

Linux virtual machines, typically on macOS, for running containerd

CodeEdit App for macOS – Elevate your code editing experience. Open source, free forever.

Grammarly for VS Code

Kubernetes Operations (kops) - Production Grade K8s Installation, Upgrades, and Management

@rudeigerc's Rime configurations

Production-Grade Container Scheduling and Management

Kubebuilder - SDK for building Kubernetes APIs using CRDs

Open Graph Image as a Service - generate cards for Twitter, Facebook, Slack, etc

QoS based scheduling system for hybrid orchestration workloads on Kubernetes, bringing workloads the best layout and status.

homebrew tap

Homebrew tap of @rudeigerc

Everything you need to extend Raycast.

🏕️ Development environment for machine learning

concurrent, cache-efficient, and Dockerfile-agnostic builder toolkit

OpenID Connect (OIDC) identity and OAuth 2.0 provider with pluggable connectors

Apache Flink Kubernetes Operator

Kueue: Kubernetes-native Job Queueing

A web-based simulator for the Kubernetes scheduler

VMware Tanzu Community Edition is a full-featured, easy to manage Kubernetes platform for learners and users on your local workstation or your favorite cloud. Tanzu Community Edition enables the creation of application platforms: infrastructure, tooling, and services providing location to run applications and enable positive developer experiences.

Generate Double-Entry Bookkeeping Code From Bills (From Alipay, Wechat to BeanCount)

kcp is a prototype of a Kubernetes API server that is not a Kubernetes cluster - a place to create, update, and maintain Kube-like APIs with controllers above or without clusters.

SLO Generator is a tool to compute SLIs, SLOs, Error Budgets and Burn rate and export an SLO report to supported exporters.

Advent of Code 2021

The schedule of the seminar

Apache Beam is a unified programming model for Batch and Streaming

Repo for the controller-runtime subproject of kubebuilder (sig-apimachinery)

Kubernetes website and documentation repo:

A reverse proxy that provides authentication with Google, Azure, OpenID Connect and many more identity providers.

Declarative continuous deployment for Kubernetes.

The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.

Customization of kubernetes YAML configurations

Jaeger Operator for Kubernetes simplifies deploying and running Jaeger on Kubernetes.

The API (CRD) of Volcano

Apache Flink

Kubetest2 is the framework for launching and running end-to-end tests on Kubernetes.

CNCF Jaeger, a Distributed Tracing Platform

Kubernetes operator to manage installation, updation and uninstallation of tektoncd projects (pipeline, …)

Kubernetes IN Docker - local clusters for testing Kubernetes

TiDB operator creates and manages TiDB clusters running in Kubernetes.

Community documentation for the Tekton project

Mirror of Apache Kafka

Apache Kafka running on Kubernetes

Open source specification and implementation of Knative event binding and delivery

Apache Camel K is a lightweight integration platform, born on Kubernetes, with serverless superpowers

A CLI for interacting with Tekton!

A working place for multi-tenancy related proposals and prototypes.

A dashboard for Tekton!

🏆 Use Ant Design like a Pro!

The Helm website for docs, blog and project info.

Beautiful static documentation for your API

The Kubernetes Package Manager

《机器学习》（西瓜书）公式推导解析，在线阅读地址：https://datawhalechina.github.io/pumpkin-book

LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

Getting started with Flux and the Helm Operator

No description.

Managing Helm releases with Flux Helm Operator

No description.

No description.

Clean and minimal personal blog theme for Hugo

alfred-video-detector

An Alfred workflow to generate colors from hex string

Some materials as TA of SE232

No description.

Calculator for testing

The official Swift style guide for raywenderlich.com.

CaretTab - New Tab Page Replacement