Smaddanki

  • Core data pipeline building blocks

    perspective 10 Jan 2025

    Seven decisions — processing, ingestion, loading, change management, processing method, quality and storage — determine what a pipeline can do.

  • Data pipeline components

    blueprint 30 Dec 2024

    Every data pipeline is the same set of components; what differs is which implementation you pick for each.

  • 13 data pipeline design principles

    blueprint 29 Dec 2024

    A pipeline is reliable because of thirteen properties it holds, not because of the tools it is built from.