The tools behind the platforms we build

What each tool is genuinely good at, where it fits in an enterprise architecture, and when we would tell you to use something else.

A data catalogue that records what data exists and observes how it is actually queried to inform what it shows.

An open source platform for building, scheduling and monitoring batch data workflows written in Python.

An open source metadata and governance framework built for Hadoop platforms, with a type system you extend.

A framework for processing continuous data streams with local state, event time and exactly once recovery.

An open source data discovery tool built around search, ranking results by how heavily each asset is used.

A data warehouse service on AWS that stores data by column and distributes it across the nodes of a cluster.

One programming model for batch and streaming pipelines that can run on several different processing engines.

A framework for storing and processing large datasets across a cluster of machines.

A web application framework from Google that supplies routing, forms and data access as part of the framework.

Not sure which tool fits your problem?

We will tell you when the answer is the one you already have.