zhifu gao Claim this profile

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models.

A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.

Open-source alternative to AI video platforms — Free AI image & video generation studio with 200+ models (Flux, Midjourney, Kling, Sora, Veo). No content filters. Self-hosted, MIT licensed.

Hold a key, speak, release — AI-polished text appears at your cursor in any app. Open-source voice input for macOS & Windows. (按住快捷键说话，松开即得润色后的文字)

Create polished demo videos without editing skills. Mac/Windows/Linux

PC 端语音输入工具，离线识别，高准确率、低延迟，支持热词、LLM润色。按住CapsLock或鼠标侧键X2说话，松开自动上屏。

🎬 卡卡字幕助手 | VideoCaptioner - 基于 LLM 的智能字幕助手 - 视频字幕生成、断句、校正、字幕翻译全流程处理！- A powered tool for easy and efficient video subtitling.

The media player for language learning, with dual subtitles, AI-generated subtitles, real-time translation, and more!

Set of 📝 with 🔗 to help those building Voice AI agents 🎙️🤖

Open-source framework for conversational voice AI agents

Open Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider. Uses Stream's edge network for ultra-low latency.

Voice-to-text dictation app. Local first, free, and open source.

Cool open source projects. Choose your project and get involved in Open Source development now.

Collection of AI-related utilities. Welcome to submit pull requests /收藏AI相关的实用工具，欢迎提交pull requests

No description.

2018/2019/校招/春招/秋招/算法/机器学习(Machine Learning)/深度学习(Deep Learning)/自然语言处理(NLP)/C/C++/Python/面试笔记

《剑指 Offer》 Python, Java, C++ 解题代码，LeetBook《图解算法数据结构》配套代码仓。

Deep Speaker: an End-to-End Neural Speaker Embedding System https://arxiv.org/pdf/1705.02304.pdf

A matlab landmarking tool via Face++ API

End-to-End Speech Processing Toolkit

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

Your faithful, impartial partner for audio evaluation — know yourself, know your rivals. 真实评测，知己知彼。A unified benchmark framework for ASR/TTS/Audio Codec/audio LLM evaluation

Official Model Studio CLI（阿里云百炼 CLI）built for AI Agent frameworks, exposing models, search, multimodal, and workflow capabilities as structured tool calls.

Bilibili视频转文字，一步到位，输入链接即可使用

🚀 Truly open-source AI avatar(digital human) toolkit for offline video generation and digital human cloning.

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

直播间 AI 互动助手（快手+抖音）：实时采集弹幕与主播语音，LLM 生成评论自动发送，帮你的直播间热场

No description.

🎤 开源免费的 AI 语音输入工具 — 基于FunASR，本地处理，为中文而生 | Free & open-source voice input tool with local FunASR

Fast, small, and fully autonomous AI personal assistant infrastructure, any OS, any platform — deploy anywhere, swap anything 🦀

Open Multi-Agent Interactive Classroom — Get an immersive, multi-agent learning experience in just one click

Integrate cutting-edge LLM technology quickly and easily into your apps

Mock channel server CLI for OpenClaw testing

An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.

💖🧸 Self hosted, you-owned Grok Companion, a container of souls of waifu, cyber livings to bring them into our worlds, wishing to achieve Neuro-sama's altitude. Capable of realtime voice chat, Minecraft, Factorio playing. Web / macOS / Windows supported.

一个用于在VRCAHT中使用语音来控制模型或作为翻译器输出内容的超轻量级本地部署程序。VRCLS, also known as VRChat LinguaSync, is a super lightweight local deployment program used in VRCAHT to control models or output content as a translator using voice

Speakr is a personal, self-hosted web application designed for transcribing audio recordings

Real-time audio translation, captures system audio + mic, runs ASR (Whisper/SenseVoice), translates via LLM API with streaming display. Perfect for VTubers, livestreamers, and watching foreign content. Windows 实时音频翻译，ASR 语音识别后 LLM 流式翻译显示，适合 VTuber、主播和外语视频观看。

AI that sees your screen, listens to your conversations and tells you what to do

SOTA Open Source TTS

FunASR/SenseVoice microphone STT extension for oobabooga textgen

No description.

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.

Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞

A hive mind communication platform

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

Build AI Agents, Visually

A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.

Official documentation, blog, and changelog for LibreChat. Built with Next.js and Fumadocs. Live at librechat.ai

TensorFlow documentation

✨ Light and Fast AI Assistant. Support: Web | iOS | MacOS | Android | Linux | Windows

A list of AI autonomous agents

No description.

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

Universal memory layer for AI Agents

Row-Bot - Personal AI Sovereignty. A local-first AI assistant with integrated tools, a personal knowledge graph, voice, vision, shell, browser automation, scheduled tasks, health tracking, and messaging channels. Run locally via Ollama or add opt-in cloud models. Your data stays on your machine.

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

An awesome repository of local AI tools

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

The official LiteLLM docs repository

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Open-source meeting transcription API for Google Meet, Microsoft Teams & Zoom. Auto-join bots, real-time WebSocket transcripts, MCP server for AI agents. Self-host or use hosted SaaS.

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

本地优先的一站式桌面字幕工具，内置 6 种 ASR 引擎与全平台 GPU 加速及 17+ 翻译服务商，覆盖音视频转写、翻译、校对、字幕烧录封装全流程，跨 Windows/macOS/Linux 运行

faster_whisper GUI with PySide6

语音输入 + AI 润色，开源 Typeless 替代品。支持个人使用和团队/企业内部自部署。按下快捷键说话，文字自动输入到任何应用。

Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.

Conversational voice AI agents

开源免费的 Wispr Flow 替代方案 | 集成FunASR本地模型和可配置大语言模型的下一代中文桌面语音工作流

CI tools for Transformers

Local voice clone, video dubbing, dictation and audiobook maker. The open-source ElevenLabs alternative.

高性能 Linux 离线中文语音输入法，基于 Ali FunASR(VocoType-cli). ~0.1s 瞬时上屏，输入法级稳定性， 极高中文准确率、低资源占用(CPU Only).支持 IBus / Fcitx5

快速提取音视频内容，整理成一份结构化的markdown笔记

Real time interactive streaming digital human

Orca is the ADE for working with a fleet of parallel agents. Run any coding agent with your own subscription. Available on desktop and mobile.

腾讯会议摸鱼工具

A collection of projects showcasing RAG, agents, workflows, and other AI use cases

Netflix-level subtitle cutting, translation, alignment, and even dubbing - one-click fully automated AI video subtitle team | Netflix级字幕切割、翻译、对齐、甚至加上配音，一键全自动视频搬运AI字幕组

Buzz transcribes and translates audio offline on your personal computer. Powered by OpenAI's Whisper.

Simultaneous speech-to-text models

No description.

Orchestrate multiple coding agents from desktop and mobile

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Wyoming protocol server for faster whisper speech to text system

SGLang Omni: High-Performance Multi-Stage Pipeline Framework for Omni Models

智能视频多语言AI配音/翻译工具 - Linly-Dubbing — “AI赋能，语言无界”

Digital Avatar Conversational System - Linly-Talker. 😄✨ Linly-Talker is an intelligent AI system that combines large language models (LLMs) with visual models to create a novel human-AI interaction method. 🤝🤖 It integrates various technologies like Whisper, Linly, Microsoft Speech Services, and SadTalker talking head generation system. 🌟🔬

👩🏿‍💻👨🏾‍💻👩🏼‍💻👨🏽‍💻👩🏻‍💻中国独立开发者项目列表 -- 分享大家都在做什么

The agent that grows with you

A curated list of awesome streaming video tools, frameworks, libraries, and learning resources.

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

🧑‍🚀 全世界最好的LLM资料总结（多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型） | Summary of the world's best LLM resources.

Fun-ASR is an end-to-end speech recognition large model launched by Tongyi Lab.

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

MacOS语音输入法，实时识别、大模型文本优化、全本地存储

利用AI大模型，一键解说并剪辑视频； Using AI models to automatically provide commentary and edit videos with a single click.

本项目为xiaozhi-esp32提供后端服务，帮助您快速搭建ESP32设备控制服务器。Backend service for xiaozhi-esp32, helps you quickly build an ESP32 device control server.

Keep track of big models in audio domain, including speech, singing, music etc.

Collection of resources on the applications of Large Language Models (LLMs) in Audio AI.

Awesome Neural Codec Models, Text-to-Speech Synthesizers & Speech Language Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

🗺️ AI/ML 오픈소스 생태계 시각화

Build, run, and manage agent platforms.

Speech recognition module for Python, supporting several engines and APIs, online and offline.

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

LlamaIndex is the leading document agent and OCR platform

Build local voice agents with open-source models

Open Source framework for voice and multimodal conversational AI

A framework for building realtime voice AI agents 🤖🎙️📹

No description.

No description.

Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.

💿 Free software that works great, and also happens to be open-source Python.

A curated list of Artificial Intelligence (AI) courses, books, video lectures and papers.

:memo: An awesome Data Science repository to learn and apply for real world problems.

A curated list of awesome Deep Learning tutorials, projects and communities.

Daily tracking of awesome audio papers, including music generation, zero-shot tts, asr, audio generation

A curated list of awesome Claude Skills, resources, and tools for customizing Claude AI workflows

A curated list of awesome Speaker Diarization papers, libraries, datasets, and other resources.

Probably the best curated list of data science software in Python.

Awesome-LLM: a curated list of Large Language Model

Awesome Privacy - A curated list of services and alternatives that respect your privacy because PRIVACY MATTERS.

🤗 A list of wonderful open-source projects & applications integrated with Hugging Face libraries.

Python资源大全中文版，包括：Web框架、网络爬虫、模板引擎、数据库、数据可视化、图片处理等，由「开源前哨」和「Python开发者」微信公号团队维护更新。

Awesome Chatbot Projects,Corpus,Papers,Tutorials.Chinese Chatbot =>:

【干货】史上最全的PyTorch学习资源汇总

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

Awesome MCP Servers - A curated list of Model Context Protocol servers

Awesome speech/audio LLMs, representation learning, and codec models

:book: A curated list of resources dedicated to Natural Language Processing (NLP)

A collection of MCP servers.

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

An awesome & curated list of best LLMOps tools for developers

A curated list of modern Generative Artificial Intelligence projects and services

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Curated list of python software and packages related to scientific research in audio

A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.

🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

machine-readable data for https://awesome-selfhosted.net

Audio Large Language Models

A curated list of Artificial Intelligence Top Tools

An opinionated list of Python frameworks, libraries, tools, and resources

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

MCP 资源精选， MCP指南，Claude MCP，MCP Servers, MCP Clients

中英文敏感词、语言检测、中外手机/电话归属地/运营商查询、名字推断性别、手机号抽取、身份证抽取、邮箱抽取、中日文人名库、中文缩写库、拆字词典、词汇情感值、停用词、反动词表、暴恐词表、繁简体转换、英文模拟中文发音、汪峰歌词生成器、职业名称词库、同义词库、反义词库、否定词库、汽车品牌词库、汽车零件词库、连续英文切割、各种中文词向量、公司名字大全、古诗词库、IT词库、财经词库、成语词库、地名词库、历史名人词库、诗词词库、医学词库、饮食词库、法律词库、汽车词库、动物词库、中文聊天语料、中文谣言数据、百度中文问答数据集、句子相似度匹配算法集合、bert资源、文本生成&摘要相关工具、cocoNLP信息抽取工具、国内电话号码正则匹配、清华大学XLORE:中英文跨语言百科知识图谱、清华大学人工智能技术系列报

🔊 Awesome list for Whisper — an open-source AI-powered speech recognition system developed by OpenAI

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

A curated list of resources for Chinese NLP 中文自然语言处理相关资料

A curated list of awesome Machine Learning frameworks, libraries and software.

Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Homepage of FunCodec project

No description.

FSA/FST algorithms, differentiable, with PyTorch compatibility.

Production First and Production Ready End-to-End Speech Recognition Toolkit

No description.

CUDA-Warp RNN-Transducer

Collection of TensorFlow Examples

Implementation of Deep Linear Discriminant Analysis (DeepLDA)

PyTorch implementation of SENet

Squeeze-and-Excitation Networks

Proxy is a high performance HTTP(S), websocket, TCP, UDP, Socks5 proxy server implemented by golang. Now, it supports chain-style proxies,nat forwarding in different lan,TCP/UDP port forwarding, SSH forwarding.Proxy是golang实现的高性能http,https,websocket,tcp,socks5代理服务器,支持内网穿透,链式代理,通讯加密,智能HTTP,SOCKS5代理,域名黑白名单,跨平台,KCP协议支持,集成外部API。

An LDA/PLDA estimator using KALDI in python for speaker verification tasks

Implementation of state of the art d-vector approach for speaker verification

pytorch tutorial for beginners

Sequence modeling benchmarks and temporal convolutional networks

Pretrained ConvNets for pytorch: NASNet, ResNeXt, ResNet, InceptionV4, InceptionResnetV2, Xception, DPN, etc.

📚 高速上手现代 C++ 11/14/17

Speaker embedding(verification and recognition) using Pytorch

A MATLAB implementation of the ID3 decision tree algorithm for EECS349 - Machine Learning

NetVLAD: CNN architecture for weakly supervised place recognition

Fit a Gaussian mixture model given a set of data

scikit-learn: machine learning in Python

This is now the official location of the Kaldi project.

SPP_net : Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition

[Not Completed Yet] C++ implementation of Joint Cascade Face Detection and Alignment.

Neural Network code

The project is an C++ implementation of Face Alignment at 3000fps via Local Binary Features

Face alignment in 3000 FPS

a c++ implementation of face alignment in 3000fps

C++ implementation of Face Alignment at 3000 FPS via Regressing Local Binary Features

Predict facial landmarks with Deep CNNs powered by Caffe.

code for paper "Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis"

Full version (training+testing) of implementation of Shizhan Zhu et al.'s CVPR-15 work Face Alignment by Coarse-to-Fine Shape Searching

No description.

MXNet Tutorial for NVidia GTC 2016.

Residual networks with MatConvNet

Deep Residual Learning for Image Recognition

Caffe: a fast open framework for deep learning.