1-day current streak·13-day longest streak
Hi there, I'm Roy 👋 I'm a Software developer, love LLM inference :) Currently I am building vLLM.
-
vllm ★ PINNED ⑂
A high-throughput and memory-efficient inference and serving engine for LLMs
Python ★ 0 13d agoExplain → -
esmeetu
No description.
★ 4 6mo agoExplain → -
smalltiffio
small tiff file format io util. (tiff reader)
Python ★ 1 3y agoExplain → -
dynamo ⑂
A Datacenter Scale Distributed Inference Serving Framework
★ 0 21d agoExplain → -
recipes ⑂
Common recipes to run vLLM
★ 0 5d agoExplain → -
srt-slurm ⑂
NVIDIA Inference Benchmarks provide recipes in ready-to-use templates for evaluating platform speed. Validate your platform across specific AI use cases across hardware and software combinations.
★ 0 14d agoExplain → -
fastsafetensors ⑂
High-performance safetensors model loader
Python ★ 0 3mo agoExplain → -
flashinfer ⑂
FlashInfer: Kernel Library for LLM Serving
Python ★ 0 4mo agoExplain → -
dify ⑂
An Open-Source Assistants API and GPTs alternative. Dify.AI is an LLM application development platform. It integrates the concepts of Backend as a Service and LLMOps, covering the core tech stack required for building generative AI-native applications, including a built-in RAG engine.
TypeScript ★ 0 1y agoExplain → -
dify-sandbox ⑂
A lightweight, fast, and secure code execution environment that supports multiple programming languages
★ 0 1y agoExplain → -
hof
a ftp server over hdfs using ftpserver.
Java ★ 0 1y agoExplain → -
Archlinux-config
archlinux, i3wm, tmux configs.
Python ★ 0 8y agoExplain → -
gdal ⑂
GDAL is an open source X/MIT licensed translator library for raster and vector geospatial data formats.
C++ ★ 0 6y agoExplain → -
geotrellis ⑂
GeoTrellis is a geographic data processing engine for high performance applications.
Scala ★ 0 6y agoExplain →
No repos match these filters.
More creators on gitmyhub
programthink xiaolai brunosimon douglascrockford standardgalactic