GCHQ ORG

Stroom is a highly scalable data storage, processing and analysis platform.

The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis

A cloud-native, serverless, scalable, cheap key-value store

Managing the lifecycle of machine learning to support scalability, impact, collaboration, compliance and sharing.

LD-Explorer is the missing tool for exploring, federating and querying linked data resources directly from the browser

A large-scale entity and relation database supporting aggregation of properties

GCHQ's internal Boiling Frogs research paper on software development and organisational change in the face of disruption #boilingfrogs

A server providing RESTful access to CyberChef

A Tool for Complex and Scalable Data Access Policy Enforcement

Fast k-NN graph construction for slow metrics

gaffer-tools is deprecated. Use https://github.com/gchq/gafferpy instead

A library for coreset algorithms, written in JAX for fast execution and GPU support.

Easily generate reproducible infrastructure

Gaffer Docker images and associated Helm charts for deploying on Kubernetes

Documentation for Stroom and associated projects

Magma Core is a collection of Java Classes and utilities to enable HQDM objects and patterns to be created and consumed as RDF Linked Data.

Event Logging is an XML Schema for describing the auditable events generated by computer systems, hardware devices and access control systems

A flexible library for writing functional operations in Java

Code for generating synthetic data for testing

A Python package for easily implementing Concourse resource types.

A Java JAXB library for generating events conforming to the Event Logging XML Schema

The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis

A set of D3 data visualisations for use in Stroom dashboards or other applications

Java implementation of the High-Quality Data Model framework.

IRIS Worm is a real-time data graphing component.

Documentation for Gaffer

Content for Stroom such as XML Schemas, translations, pipelines and dashboards

No description.

A lightweight package to conduct data quality measurements in Pandas and Spark dataframes

Python API for Gaffer

Kai is an experimental Graph-as-a-Service framework built with the Amazon CDK

Acts as a proxy for forwarding and aggregating data en route to Stroom

No description.

Applications and resources on which Stroom services depend

An IRIS component for displaying gantt-style categorised data over time.

An IRIS component for navigating and interacting with time based data.

A home for all stroom related ansible playbooks, roles, etc.

A framework for configurable operation executors

No description.

No description.

No description.

Utility for generating data suitable for testing Stroom

Contains all the implementations for Palisade data reader technologies.

Contains the various examples for demoing Palisade

Contains the code for the client libraries for Palisade

A collection of client libraries to help with sending data to Stroom

Contains the service implementations for a Palisade deployment

A simple java program that can be used for pulling data (such as log files) from remote hosts and forwarding it to Stroom

The new (for StroomV7) React based user interface for Stroom

A shaded version of org.apache.hbase:hbase-common: shades Jersey and excludes logging.

Disorder in, order out

A shaded version of org.apache.hadoop:hadoop-common: shades Jersey and excludes logging.

No description.

No description.

Contains the libraries that are common across Palisade services

No description.

A shaded version of org.apache.hadoop:hadoop-hdfs: shades Jersey and excludes logging.

No description.

An example of how to run Stroom processing from the command line

No description.

No description.

A Gradle plugin for retrieving remote dependencies by URL. E.g. from GitHub releases.

No description.

No description.

No description.

Generic library for generating test data with configurable fields, formats and outputs

Annotations Service for Stroom Dashboards

Stroom Kubernetes operator, for automating the deployment and lifecycle management of a Stroom cluster

Stroom Kubernetes operator, for automating the deployment and lifecycle management of a Stroom cluster

Analytic demonstrator / event generator for Stroom. Includes stochastic event generation component, that features a state machine and is capable of creating realistic looking streams of data, e.g. for UEBA development.

An Apache Spark Datasource for access to data held within Stroom

Dependency analysis plugin for gradle

A Stroom API wrapper around Elastic Search