databricks-L2 · DE Pro · Domain 1B + 3 — Lakeflow Declarative Pipelines

Lakeflow Declarative Pipelines (ETL)

Build a declarative ETL pipeline: a streaming table, quality expectations with a quarantine path, an AUTO CDC INTO flow doing SCD Type 2, and a materialized view — plus a defensible streaming-vs-MV decision. Definitions of DLT won't move the gate.

Not submitted

Your mentor

Rao Venkataraman

active

Pipelines are where engineers get exposed. Show me a streaming table that's actually streaming, expectations that quarantine instead of silently dropping, and a CDC flow that holds history. I'll flag the gate you're closest to failing.

The deliverable · 8 gates

▸Streaming table definition

▸Quality expectations (EXPECT) with quarantine two-table pattern

▸AUTO CDC INTO flow implementing SCD Type 2

▸Materialized view definition

▸Streaming-table vs materialized-view decision rationale

▸Naming reconciliation (DLT / APPLY CHANGES ↔ Lakeflow / AUTO CDC)

▸Pipeline validation evidence

▸Short design explanation

Your work · artifact bundle

0 files

Empty workspace. Add files, upload a folder, or load a demo bundle to start.

Submit the bundle to the kernel. It grades the artifact gate-by-gate — the mentor never gives a verdict.

Kernel evaluation

PASS = ∏ γᵢ over 8 gates · any failed factor ⇒ FAIL

Recognition Filter

Naming Reconciliation

Streaming Table

Quality Expectations

CDC Flow

Materialized View

Engineering Decision

Evidence Completeness

World output

Pipeline Core

Locked until every gate passes. Nothing downstream can attach to an unverified layer.