This page lists every tutorial in the Claude for Data Engineers series: 10 videos that take Claude and Claude Code into real data engineering work. We install Claude Code and start a data project, go through every Claude Code concept, write, debug and speed up SQL, build a PySpark pipeline and a dbt project, connect Claude to a database with MCP, build a data-quality skill, use hooks, sub-agents and parallel agents, review pull requests in GitHub Actions, and finish with an end-to-end project from raw CSV files to a dashboard.
Each part has a video and a written post with the exact prompt to type, the files Claude writes, and the real output of every command. Click a part to read it, or click a step to jump straight to it.
Part 1: Claude Code for Data Engineers: Install, Set Up and Your First Data Project
- Step 1: Where Claude Code lives
- Step 2: Install Claude Code
- Step 3: Sign in
- Step 4: First launch
- Step 5: Ask Claude what the repo does
- Step 6: Run /init and create CLAUDE.md
- Step 7: First script and a real run
- Step 8: Check the numbers
- Tips for your own repo
Part 2: Every Claude Code Concept Explained
- Step 1: Permission modes
- Step 2: Permission rules
- Step 3: Plan mode for a real data check
- Step 4: CLAUDE.md and memory
- Step 5: Slash commands
- Step 6: Context and /compact
- Step 7: Checkpoints and /rewind
- Step 8: Models and effort
- Step 9: Headless runs with claude -p
Part 3: Write, Debug and Speed Up SQL with Claude
- Step 1: Write SQL in the Claude app
- Step 2: Run it with Claude Code
- Step 3: Fix a broken query
- Step 4: Speed up a slow query
- Step 5: Window functions
- The checklist: SQL with Claude
Part 4: Build a PySpark Pipeline with Claude Code
- Step 1: Read the raw data and plan
- Step 2: Write the code
- Inside the transforms
- Step 3: Run it with Spark
- Step 4: Unit tests with pytest
- Step 5: Check the Parquet, save the commands
- The checklist: Spark with Claude
Part 5: Build a dbt Project with Claude Code
- Step 1: Open the project and load the seeds
- Step 2: Staging models
- Step 3: Marts and a first result
- Step 4: Tests that catch bad data
- Step 5: Fix it and run dbt build
- Step 6: Docs and CLAUDE.md
- Tips for dbt with Claude Code
Part 6: Connect Claude to Your Database with MCP
- What MCP is
- Step 1: A read-only Postgres role
- Step 2: Test the MCP server first
- Step 3: Add the server with claude mcp add
- Step 4: Ask questions about real data
- Safe MCP for data teams
- Step 5: Connectors in the Claude app
Part 7: Claude Skills for Data Work: Build a Data-Quality Skill
- What a skill is
- Step 1: Create the skill with Claude Code
- Inside SKILL.md
- Step 2: Claude picks it up by itself
- Step 3: Call it with /data-quality
- Step 4: Skills in the Claude app
- Skills that work
Part 8: Hooks, Sub-agents and Parallel Agents for Data Pipelines
- Three tools, three jobs
- Step 1: A hook that checks every SQL edit
- Step 2: The hook catches a real mistake
- Step 3: A read-only SQL reviewer sub-agent
- Step 4: Two worktrees for parallel sessions
- Step 5: Test and merge the parallel work
- Which one to use when
Part 9: Claude Code in CI/CD: Review Data Pipeline Pull Requests with GitHub Actions
- How Claude Code GitHub Actions works
- Step 1: Quick setup with /install-github-app
- Step 2: The workflow file, line by line
- Step 3: Automation mode with a prompt and claude_args
- Step 4: The same review, run locally
- Step 5: Fix the bug and re-run the checks
- Step 6: Headless claude -p and CI safety
Part 10: End-to-End Data Project with Claude Code: Raw CSV to Dashboard
- Step 1: Plan the project in plan mode
- Step 2: Profile the raw CSV
- Step 3: Ingest and model in raw, staging and marts
- Step 4: Data-quality checks catch a bad row
- Step 5: Build the HTML dashboard
- Step 6: One command for the whole pipeline
- The whole project
Each part has a matching video on the TechBrothersIT YouTube channel, in the "Claude for Data Engineers (Claude Code, SQL, PySpark, dbt)" playlist.



No comments:
Post a Comment
Note: Only a member of this blog may post a comment.