Nan Zhu

a benchmark to test scalability of xgboost4j-spark and relevant projects

debugging performance issues for Spark applications

repo containing XGBoost-based ML project for various purposes

an automatic tool to deploy Hadoop on EC2

Implementation of Hedera based on Floodlight

a fat tree topology developed within mininet env

a flexible and lightweight workload generator for Hadoop 1.x

No description.

Mirror of Apache Spark

RLLearning

docker-scripts for daily dev

Distributed Neural Networks for Spark

LongTermFairScheduler

NVIDIA Isaac GR00T N1.6 - A Foundation Model for Generalist Robots.

local ray env for learning

Notebooks for the O'Reilly book "Learning Ray"

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

RAPIDS Accelerator JNI For Apache Spark

A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

REST job server for Spark

BigDL: Distributed Deep Learning Library for Apache Spark

Distributed Tensorflow, Keras and BigDL on Apache Spark

Apache Celeborn Site

No description.

Uniffle is a high performance, general purpose Remote Shuffle Service.

the cli tool to select ec2 instances based on filters

Expressive types for Spark.

A new C++ vectorized database acceleration library aimed to optimizing query engines and data processing systems.

Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.

A cluster computing framework for processing large-scale geospatial data

No description.

Terraform module to provision a fully managed AWS EKS Node Group

Apache Iceberg

Spark SQL listener to record lineage information

Spark SQL Macros provides a mechanism similar to Spark User-Defined function registration; with the key enhancement being that custom code gets compiled to equivalent Catalyst Expressions at macro define time.

This is the companion repository for the book How Query Engines Work.

Apache Arrow DataFusion and Ballista query engines

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

Large-scale and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, on single node, hadoop yarn and more.

some programs to play around cockroachdb

CockroachDB To-Do Apps

Chisel 3

Flexible Intermediate Representation for RTL

Self-Driving Database Management System from Carnegie Mellon University

Reliable Allreduce and Broadcast Interface for distributed machine learning

bring deep learning workloads to bare metal

Morpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.

Easy TOC creation for GitHub README.md

HiBench is a big data benchmark suite.

A common bricks library for building scalable and portable distributed machine learning.

A realtime distributed OLAP datastore

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Spark with minimal hand tuning

Open source platform for the machine learning lifecycle

A simple optimizing Brainfuck compiler (used as demo for my QCon Beijing 2015 talk)

Mirror of Apache Arrow

Apache Parquet

The repo to host all the web data including images for documents in dmlc projects.

Efficient and Flexible Distributed Deep Learning Framework, for python, R, Julia and more

A lightweight parameter server interface

fast tree inference

TLAPlusCourseProject

No description.

Mirror of Apache Parquet

Achieving Real-time Data Analytics with Spark and EventHubs

Microsoft Azure Storage Library for Java

Mirror of Apache Hive

Mirror of Apache livy (Incubating)

Distributed. Columnar. Versioned. Streaming. SQL.

Deep Learning Pipelines for Apache Spark

A java agent to generate method mappings to use with the linux `perf` tool

PerfJ is a wrapper of linux perf for java programs.

No description.

Mirror of Apache Ambari

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

No description.

example code to show

Performance monitoring and tuning tool for Apache Hadoop

TPC-DS benchmark kit with some modifications/additions

Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, ...

Port of TPC-DS dsdgen to Java

script actions in powershell and bash to install/update new components on HDInsight clusters

No description.

Tensorflow wrapper for DataFrames on Apache Spark

test_timestamp

Example showing how events can be generated and pushed to Microsoft Azure Sevicebus Eventhubs

integration test for xgboost

Java client library for Azure Event Hubs https://azure.microsoft.com/services/event-hubs

A generic Java client for Microsoft Azure EventHubs

Examples showing how streaming events can be persisted to Azure blob, Hive table and Azure SQL Table through Spark.

COMP 535: Computer Network

start learning typescript

The Self-Driving Database Management System

Avro Data Store based on Akka

http://macrobase.io/

No description.

the homepage http://dmlc.ml

本项目是July的《程序员编程艺术》的电子书版本

a medium inspired jekyll theme

personal repo for learning Haskell

MapDB provides concurrent Maps, Sets and Queues backed by disk storage or off-heap-memory. It is a fast and easy to use embedded Java database engine.

A library that provides an embeddable, persistent key-value store for fast storage.

Automatically exported from code.google.com/p/maiter

Automatically exported from code.google.com/p/gpudb

No description.

a benchmark program for evaluating MapDB performance

an example on how to use silhouette 2.0 with slick

A module that provides OAuth, OAuth2 and OpenID authentication for Play Framework applications

No description.

Scala.js, the Scala to JavaScript compiler

Akka Project

Implementation of GeoHashes in java. We try to be/stay compliant to the spec, as far as possible.

A tool for managing Apache Kafka.

No description.

No description.

Dashboard to aid in Spark pull request reviews

Open Source, Distributed, RESTful Search Engine

No description.

Next-generation DOM manipulation

some test code for spark development

Mirror of Apache Hadoop common

Scripts used to setup a Spark cluster on EC2 - my fork

Floodlight SDN OpenFlow Controller- my fork

my homepage in mcgill university

spark_based_bbnp

No description.

RipL-POX (Ripcord-Lite for POX): A simple network controller for OpenFlow-based data centers

The POX Controller

Statistical Workload Injector for MapReduce - Project at UC Berkeley AMP Lab