Jiaxin Shan

Production-Grade Container Scheduling and Management

Mirror of Apache Spark

Autoscaling components for Kubernetes

Machine Learning Toolkit for Kubernetes

AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads

No description.

Serverless Paper Reading and Discussion

Capstone Security Project (concentrate on PrivacyDetection, AntiTheft and AntiVirus)

Bytedance OSS Project Template

A high-throughput and memory-efficient inference and serving engine for LLMs

Serving LLMs on heterogeneous decentralized clusters.

Serve 100s of Fine-Tuned LLMs in Production for the Cost of 1

腾讯高性能分布式图计算框架Plato

Kubecon archives (in building)

No description.

An Android tool using TTS speech recognition to help people send message, email, social statuses fast and convenient.

AWS Workshop for Learning EKS

No description.

No description.

A lightweight sandboxing tool for enforcing filesystem and network restrictions on arbitrary processes at the OS level, without requiring a container.

My personal interested papers

Cost-efficient and pluggable Infrastructure components for GenAI inference

Python library and web service for Open Source Software Health and Sustainability metrics & data collection.

Dedicated Game Server Hosting and Scaling for Multiplayer Games on Kubernetes

A framework for efficient model inference with omni-modality models

NVIDIA Inference Xfer Library (NIXL)

High Performance KV Cache Store for LLM

SGLang is a fast serving framework for large language models and vision language models.

KV cache store for distributed LLM inference

Redis for LLMs

A fast, clean, responsive Hugo theme.

No description.

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Reproduce of Pre-warming is Not Enough (SoCC'24)

Gateway API Inference Extension

No description.

A container runtime written in Rust

A library developed by Volcano Engine for high-performance reading and writing of PyTorch model files.

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

Stateless cluster local OCI registry mirror.

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Kubernetes website and documentation repo:

OpenAgents: An Open Platform for Language Agents in the Wild

a serverless db service based on TiDB on the cloud, implementing dynamically scale the compute and storage nodes based on business load changes.

A efficient and effective few-shot NL2SQL method on GPT-4.

Generate comic panels using a LLM + SDXL. Powered by Hugging Face 🤗

Enhancements tracking repo for Kubernetes

The TikTok OpenSDK features Login Kit and Share Kit which allow your users to log in using their TikTok account and share content from your app to TikTok.

Easy, Fast, Secure and Cost-Efficient LLM Pipelines to generate GhatGPT-like private domain models and knowledgeable agents for your organization.

MOSS is an artificial intelligence character in the movie "The Wandering Earth." s, enabling it to autonomously analyze, infer, and make decisions.

No description.

⚡ Building applications with LLMs through composability ⚡

The release repo for "Vicuna: An Open Chatbot Impressing GPT-4"

Instruct-tune LLaMA on consumer hardware

A framework for few-shot evaluation of autoregressive language models.

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110).

Evals is a framework for evaluating OpenAI models and an open-source registry of benchmarks.

No description.

No description.

Idle containers when not handling requests.

An open and reliable container runtime

runc bindings for Go

Go-based framework for running benchmarks against Docker, containerd, runc, or any CRI-compliant runtime

CLI tool for spawning and running containers according to the OCI specification

Appshark is a static taint analysis platform to scan vulnerabilities in an Android app.

The toolkit to pack, ship, store, and deliver container content

Work with OCI registries, but for secure supply chain - managing content like artifacts, images, SBOM

NVIDIA Federated Learning Application Runtime Environment

SkyPilot is a framework for easily running machine learning workloads on any cloud through a unified interface.

OCI Image Format

Kubernetes Rust Kubelet

WebAssembly System Interface

A High Performance Metadata System for Kubernetes

Data-centric declarative deep learning framework

Amazon EC2 instance comparison site

Collection of tools and code examples to demonstrate best practices in using Amazon EC2 Spot Instances.

Distributed training framework for TensorFlow, Keras, and PyTorch.

test-infra configurations

A simulator of Kuberntes for batch and service workload.

📈DevStats code

Apache Kibble - a tool to collect, aggregate and visualize data about any software project

Go library for accessing the GitHub API

Contributed modules to ray

Language Server Protocol integration for JupyterLab (code navigation + hover suggestions + linters + autocompletion + rename)

Model serving related infrastructure in Kubeflow

Repository for out-of-tree scheduler plugins based on scheduler framework.

Run Amazon EKS on your own infrastructure 🚀

Machine Learning Pipelines for Kubeflow

Tools for ML/Tensorflow on Kubernetes.

Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration

devstats of Github orgs and repos

A unified operator for running deep learning/machine learning workloads on Kubernetes

Curated applications for Kubernetes

Performance tests and benchmarks

Cluster-wide aggregator of resource usage data.

An implementation of the custom.metrics.k8s.io API using Prometheus

Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud

FoundationDB - the open source, distributed, transactional key-value store

Arktos for large-scale cloud platform

Dapr is a portable, event-driven, runtime for building distributed applications across cloud and edge.

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

Workflow engine for Kubernetes

阅读 boltDB 源码后的小结

📜Fork for tracking CNCF projects

Go client for Kubernetes.

Kubernetes community content

Run Kubernetes on MySQL, Postgres, sqlite, dqlite, not etcd.

A place for the community to engage with virtual kubelet.

Virtual Kubelet is an open source Kubernetes kubelet implementation.

No description.

BTree provides a simple, ordered, in-memory data structure for Go programs.

No description.

etcd operator creates/configures/manages etcd clusters atop Kubernetes

Kubernetes Native Edge Computing Framework (project under CNCF)

Start Tensorboard in Jupyter Notebook

No description.

Kubeflow blog based on fastpages

Elyra extends JupyterLab Notebooks with an AI centric approach.

A repository for Kustomize manifests

No description.

Home for the Cluster Management API work, a subproject of sig-cluster-lifecycle

PyTorch on Kubernetes

A blazingly small and sane redis java client

Example notebooks that show how to apply machine learning, deep learning and reinforcement learning in Amazon SageMaker

Test infrastructure for the Kubernetes project.

Repository for hyperparameter tuning

No description.

Running High Performance Computing (HPA) applications on EKS using Elastic Fabric Adapter (EFA).

Declarative configurations for KF community infrastructure

GPU plugin to the node feature discovery for Kubernetes

No description.

Performance optimization for Spark running on Kubernetes

A best practices guide for day 2 operations, including operational excellence, security, reliability, performance efficiency, and cost optimization.

TFX is an end-to-end platform for deploying production ML pipelines

Apache Beam is a unified programming model for Batch and Streaming

Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.

Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other examples

No description.

Kubernetes Operations (kops) - Production Grade K8s Installation, Upgrades, and Management

a CLI for Amazon EKS

Tools to use with the controller-runtime libraries

A list of references for MLOps

Repository used to main group ACLs used by Kubeflow developers

Incubating project for xgboost operator

A Kubernetes operator for mxnet jobs

Feature Store for Machine Learning

No description.

Apache Yunikorn Common scheduler interface - Incubating

Apache YuniKorn Scheduler core - Incubating

Apache K8shim bridges Kubernetes and YuniKorn - Incubating

Common APIs and libraries shared by other Kubeflow operator repositories.

Repository for batch predict

kfctl is a CLI for deploying and managing Kubeflow

A Collection of GitHub Actions That Facilitate MLOps

The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog as a central repository to store structural and operational metadata for their data. AWS Glue provides out-of-box integration with Amazon EMR that enables customers to use the AWS Glue Data Catalog as an external Hive Metastore. This is an open-source implementation of the Apache Hive Metastore client on Amazon EMR clusters that uses the AWS Glue Data Catalog as an external Hive Metastore. It serves as a reference implementation for building a Hive Metastore-compatible client that connects to the AWS Glue Data Catalog. It may be ported to other Hive Metastore-compatible platforms such as other Hadoop and Apache Spark distributions

PyTorch elastic training

Amazon EKS Pod Identity Webhook

No description.

The open source version of the Amazon EKS user guide. You can submit feedback & requests for changes by submitting issues in this repo or by making proposed changes & submitting a pull request.

The Amazon ECR containerd resolver is an implementation of a containerd Resolver and Fetcher that can pull images from and push images to Amazon ECR using the Amazon ECR API instead of the Docker Registry API.

A repository to host extended examples and tutorials

This is a fork/refactoring of the ajmyyra/ambassador-auth-oidc project

A Kubernetes Native Batch System

Build and manage real-life data science projects with ease.

A Kubernetes DaemonSet to gracefully handle EC2 Spot Instance interruptions.

Spark cloud integration: tests, s3 committer and more

NVIDIA GPU Operator creates/configures/manages GPUs atop Kubernetes

Tools for monitoring NVIDIA GPUs on Linux

Test infrastructure and tooling for Kubeflow.

Apache Hadoop

Collection of tools and examples for managing Accelerated workloads in Kubernetes Engine

Prometheus Exporter for NVIDIA GPUs using NVML

Fluent Bit Kubernetes Daemonset

A Fluent Bit output plugin for CloudWatch Logs

An example of building kubernetes operator (Flink) using Abstract operator's framework

Kubernetes operator that provides control plane for managing Apache Flink applications

Python SDK for building, training, and deploying ML models

Hands-on Learning with KubeFlow + Keras/TensorFlow 2.0 + TF Extended (TFX) + Kubernetes + Airflow + Jupyter

NVIDIA device plugin for Kubernetes

Networking plugin repository for pod networking in Kubernetes using Elastic Network Interfaces on AWS

A tool to use AWS IAM credentials to authenticate to a Kubernetes cluster

Deep learning benchmark results and optimization tips on EKS.

Repository for assets related to Metadata.

Add-on agent to generate and expose cluster-level metrics.

A batch scheduler of Kubernetes for ML/BigData/HPC workload

Information about the Kubeflow community including proposals and governance information.

CSI Driver of AWS FSx for Lustre https://aws.amazon.com/fsx/lustre/

No description.

Deep Learning Models optimized for AWS

Benchmark code

Use TensorFlow efficiently

Repository for the MPI operator.

Repository for benchmarking

Packer configuration for building a custom EKS AMI

Train and Deploy Machine Learning Models on Kubernetes using Amazon EKS

Validation Generation for Kubeflow CRD on Kubernetes

A website built in AngularJS and Facebook API which can let you know some small secret like who care you most, who may have a secret love on you.

No description.

Open source platform for the complete machine learning lifecycle

A low-latency prediction-serving system