Jelly Lee

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.

LLM全栈优质资源汇总

LLM/MLOps/LLMOps

unify-easy-llm（ULM）旨在打造一个简易的一键式大模型训练工具，支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。

车联网智能分析系统

模型可视化工具netron的Flask版本

No description.

Spark、Kafka、Redis、ElasticSearch、Hadoop...

Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]

A curated list of awesome frameworks, libraries and software for IOT/BigData/AI/Cloud/Python/Java...

Making large AI models cheaper, faster and more accessible

An awesome & curated list of best LLMOps tools for developers

No description.

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

Minimalistic large language model 3D-parallelism training

Nano vLLM

No description.

Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

CMMLU: Measuring massive multitask language understanding in Chinese

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

Some Java and Scala Frame

elasticsearch stopword

Column oriented distributed data store ideal for powering interactive applications

No description.

R study

Study and Note SQL

Databricks Scala Coding Style Guide

The Scala programming language

Study Share Communication

Java Notes

Study Scala

No description.

Note Markdown SourceCode

No description.

Markdown 基本语法。

No description.

No description.

No description.

No description.

No description.

pipreqs - Generate pip requirements.txt file based on imports of any project

ansj分词.ict的真正java实现.分词效果速度都超过开源版的ict. 中文分词,人名识别,词性标注,用户自定义词典

Building and evaluating several machine learning models to assess credit risk, includes: Training a logistic regression classifier, calculating the balanced accuracy score, generating a confusion matrix and printing the classification report.

自然语言处理 中文分词 词性标注 命名实体识别 依存句法分析 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁

吴恩达老师的机器学习课程个人笔记

AiLearning: 机器学习 - MachineLearning - ML、深度学习 - DeepLearning - DL、自然语言处理 NLP

No description.

Install KubeSphere on existing Kubernetes cluster

No description.

本项目将《动手学深度学习》(Dive into Deep Learning)原书中的MXNet实现改为PyTorch实现。

A curated list of awesome frameworks, libraries and software for the Java programming language.

sanic

No description.

No description.

A curated list of awesome Machine Learning frameworks, libraries and software.

A public repo of datasets

NLP模型训练脚手架

Public repo for HF blog posts

Transformer related optimization, including BERT, GPT

OpenTextClassification is all you need for text classification! Open text classification for everyone, enjoy your NLP journey! 这可能是目前为止最全面的开源文本分类项目，支持中英双语、多种模型、多种任务。

The release repo for "Vicuna: An Open Chatbot Impressing GPT-4"

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

No description.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Ongoing research training transformer models at scale

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

No description.

No description.

No description.

SGLang is a fast serving framework for large language models and vision language models.

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

A high-throughput and memory-efficient inference and serving engine for LLMs

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库

LLM Quantization Eval Toolkit

Code Repository of Evaluating Quantized Large Language Models

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

巴菲特致股东的信1957-2024,巴菲特先生的信一直是价值投资的经典范本，超越时间，超越周期，站在资本与金融的顶峰，他和他的战友芒格先生事价值投资的坚定实践者。Warren E. Buffett's Letter,To the Stockholders of Berkshire Hathaway Inc

QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Repository of LV-Eval Benchmark

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

The Triton TensorRT-LLM Backend

No description.

Scala Application