dbt-core

Overview

dbt Core is a command-line tool for data transformation that allows analysts to write SQL select statements to build tables and views. It handles dependency management, testing, and documentation, following software engineering practices. Written in Rust for performance.

README Preview

\n  \n\n\n> [!WARNING]\n> **dbt Core v1 development has moved to the [`1.latest`](https://github.com/dbt-labs/dbt-core/tree/1.latest) branch.**\n> The `main` branch now hosts dbt Core v2.0 (alpha) — a ground-up rewrite in Rust that is the foundation of the Fusion engine. If you're looking for the Python implementation of dbt Core, switch to [`1.latest`](https://github.com/dbt-labs/dbt-core/tree/1.latest).\n\n**[dbt](https://www.getdbt.com/)** enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.\n\n\n\n## About dbt Core v2.0\n\n> 🚧 dbt Core v2.0 is in alpha. Behavior, APIs, and on-disk formats may change before the stable release.\n\ndbt Core v2.0 is engineered for performance at scale — parsing, compiling, and running projects in a fraction of the time compared to v1. It's released under the Apache 2.0 license and is the foundation of the [Fusion engine](https://docs.getdbt.com/docs/fusion/about-fusion).\n\nThe big shifts from v1:\n\n- **Faster** — parse and compile times are dramatically improved, especially on the largest dbt projects.\n- **Stricter** — a tightly-defined language specification enforces correctness at parse time.\n- **More scalable artifacts** — v2.0 produces Parquet artifacts that can be easily queried, joined, and analyzed to understand your dbt project. The artifacts encompass everything in the JSON artifacts (e.g. `manifest.json`), which continue to be produced for backwards compatibility.\n- **Easier to install** — distributed as a single self-contained binary, with no Python runtime or dependency management required.\n- **A completely revamped local documentation experience** — dbt docs is now powered by those new artifacts and capable of scaling to large projects.\n\n### Supported operating systems and architectures\n\ndbt Core v2.0 and its drivers are compiled per operating system and architecture.\n\nLegend:\n* 🟢 — Supported today\n* 🟡 — Not yet supported