Skip to content
bruin-dataPublic

About

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

Topics

Resources

Contributing

Security policy

Stars

1.8k stars

Watchers

11 watching

Forks

Latest commit

 

History

8,566 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Bruin Logo

Bruin is a data pipeline tool that brings together data ingestion, data transformation with SQL, Python & R, and data quality into a single framework. It works with all the major data platforms and runs on your local machine, an EC2 instance, or GitHub Actions.

Bruin CLI - Demo

Bruin is packed with features:

  • 📥 ingest data with ingestr / Python
  • ✨ run SQL, Python & R transformations on many platforms
  • 📐 table/view materializations, incremental tables
  • 🐍 run Python in isolated environments using uv
  • 💅 built-in data quality checks
  • 🚀 Jinja templating to avoid repetition
  • ✅ validate pipelines end-to-end via dry-run
  • 👷 run on your local machine, an EC2 instance, or GitHub Actions
  • 🔒 secrets injection via environment variables
  • VS Code extension for a better developer experience
  • ⚡ written in Golang
  • 📦 easy to install and use

Installation

Please see the installation instructions here.

Community

Join our Slack community here.

Quickstart

Take a look at our quickstart guide here.

About

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

Topics

Resources

Contributing

Security policy

Stars

1.8k stars

Watchers

11 watching

Forks

Releases

Packages

Used by

Contributors

Languages