AWS DEA-C01 Cheat Sheet: Ingestion, Catalogs, and Lakehouse

Keep this cheat sheet open while drilling questions. DEA‑C01 rewards “production data platform realism”: correct service selection, replayability/backfills, partitioning/file formats, monitoring and data quality, and governance-by-default.

CDC: Change data capture, where source-system changes are emitted as events for downstream ingestion.

ETL: Extract, transform, and load workflow for moving and reshaping data into a target system.

Lake Formation: AWS governance layer for permissions and controls on S3-based data lakes.

MWAA: Managed Workflows for Apache Airflow, the AWS managed orchestration service for Airflow DAGs.

Data flow chooser

Use this when the question is really about where the pipeline should land, transform, govern, and publish.

    flowchart LR
	  SRC["Sources"] --> ING["Ingest: batch, stream, or CDC"]
	  ING --> RAW["Raw S3 landing"]
	  RAW --> ETL["Transform: Glue, EMR, Lambda"]
	  ETL --> CUR["Curated S3 / warehouse"]
	  CUR --> GOV["Governance: Lake Formation + catalog + permissions"]
	  CUR --> OBS["Observe: CloudWatch, CloudTrail, Macie"]

DEA-C01 answer sequence

Use this when the stem mixes sources, ingestion, storage, governance, and consumption.

    flowchart TD
	  S["Scenario"] --> I["Identify the source shape"]
	  I --> P["Pick batch, streaming, or CDC"]
	  P --> L["Land in durable storage first"]
	  L --> T["Transform with the right engine"]
	  T --> G["Apply catalog + permissions + governance"]
	  G --> C["Choose the serving layer"]
	  C --> M["Monitor quality, cost, and replayability"]

Quick facts (DEA-C01)

Fast strategy (what the exam expects)

• If the requirement is replayable + backfillable, design for idempotency, checkpoints, and reprocessing (S3 as durable landing is common).
• If you see “best cost/performance for queries on S3”, think Parquet + partitioning + Athena/Redshift Spectrum, not raw CSV scans.
• If you see “govern access to S3 data across services”, think Lake Formation + Glue Data Catalog, not just IAM.
• If you see “batch vs streaming”, focus on latency, ordering, retention, and operational complexity.
• If you see “audit” or “governance”, include CloudTrail, central log storage, and controlled access to logs.

Final 20-minute recall (exam day)

Cue -> best answer (pattern map)

Must-memorize DEA defaults

Last-minute traps

• Assuming exactly-once semantics by default.
• Partitioning on high-cardinality columns that hurt performance.
• Relying only on IAM where Lake Formation is explicitly required.
• Shipping pipelines without backfill/replay design.

1) End-to-end data platform on AWS (mental model)

    flowchart LR
	  SRC["Sources<br/>(SaaS, DBs, apps, streams)"] --> ING["Ingest<br/>(DMS, AppFlow, Kinesis, MSK)"]
	  ING --> RAW["S3 data lake<br/>(raw/bronze)"]
	  RAW --> ETL["Transform<br/>(Glue, EMR, Lambda)"]
	  ETL --> CUR["S3 curated<br/>(silver/gold)"]
	  CUR --> CAT["Glue Data Catalog"]
	  CAT --> ATH["Athena<br/>(serverless SQL)"]
	  CUR --> RS["Redshift<br/>(warehouse)"]
	  ATH --> BI["QuickSight / BI"]
	  RS --> BI
	  CUR --> GOV["Lake Formation<br/>(permissions)"]
	  ING --> ORCH["Orchestrate<br/>(MWAA, Step Functions, EventBridge)"]
	  ORCH --> ETL
	  MON["Monitor + audit<br/>(CloudWatch, CloudTrail, Macie)"] --> ORCH
	  MON --> RS
	  MON --> ATH

High-yield framing: DEA‑C01 is about the pipeline + platform, not just one service.

2) Ingestion patterns (Domain 1)

Batch vs streaming vs CDC (picker)

Triggers and scheduling (high yield)

3) ETL and processing choices (Domain 1)

Glue vs EMR vs Lambda vs Redshift (fast picker)

File formats (exam-friendly rules)

• Use Parquet/ORC for analytics on S3 (columnar + compression).
• Avoid raw CSV/JSON at scale for Athena/Redshift Spectrum scans (cost and performance).

4) Catalogs, partitions, and schema drift (Domain 2)

Glue Data Catalog (what it does)

• Central metadata store for S3 data (databases/tables/partitions).
• Enables engines like Athena, EMR, and Redshift Spectrum to interpret schema.

Crawlers vs explicit DDL

High-yield rule: keep partitions in sync (MSCK REPAIR / partition projection / crawler updates), or queries “miss” new data.

5) Storage and analytics service selection (Domain 2/3)

Athena vs Redshift (exam picker)

Redshift data loading (high yield)

• Use COPY from S3 for fast loads (parallel, columnar-friendly).
• Use UNLOAD to export query results back to S3.

6) SQL patterns (Domain 1/3)

Partition pruning (Athena mindset)

If your table is partitioned by dt, always filter by it:

1SELECT *
2FROM curated.events
3WHERE dt = '2025-12-12'
4  AND event_type = 'purchase';

CTAS for repeatable outputs (Athena)

1CREATE TABLE curated.daily_sales
2WITH (format='PARQUET', partitioned_by=ARRAY['dt'])
3AS
4SELECT dt, customer_id, SUM(amount) AS total
5FROM raw.sales
6GROUP BY dt, customer_id;

7) Orchestration and reliability (Domain 1/3)

MWAA vs Step Functions (fast picker)

    flowchart LR
	  E["EventBridge schedule"] --> W["Workflow start"]
	  W --> I["Ingest"]
	  I --> V{"Valid?"}
	  V -->|yes| T["Transform"]
	  V -->|no| Q["Quarantine + alert"]
	  T --> C["Catalog/partitions update"]
	  C --> P["Publish dataset"]
	  P --> N["Notify (SNS)"]

High-yield reliability rules:

• Design for retries + duplicates (at-least-once is normal).
• Make steps idempotent (safe re-runs).
• Track freshness/latency SLIs (what matters to users).

8) Monitoring and troubleshooting (Domain 3)

What to monitor

• Pipeline health: failures, retries, runtime, backlog/lag
• Freshness: “is today’s partition present?”
• Cost: scan volume (Athena), cluster usage (EMR/Redshift), data transfer
• Security/audit: access logs, permission changes

Common AWS tooling:

• CloudWatch (metrics/logs/alarms, Logs Insights)
• CloudTrail (API calls; audit)
• Macie (PII discovery; policy violations)

9) Data quality (Domain 3)

Data quality dimensions (memorize)

High-yield pattern: run checks in-pipeline, quarantine bad records, and alert.

10) Security and governance (Domain 4)

Lake Formation (why it’s a big deal)

Lake Formation helps you manage fine-grained permissions for data in S3 across engines like Athena/EMR/Redshift Spectrum, using a consistent governance model.

Encryption and key points

• Prefer SSE-KMS for S3 and service-level encryption for analytics services.
• Use TLS for encryption in transit.
• Don’t log secrets or raw PII; keep logs access-controlled.

Audit readiness checklist

• CloudTrail enabled and centralized (optionally CloudTrail Lake for queries)
• CloudWatch Logs retention + encryption set
• Access to logs is restricted (separation of duties)
• Data sharing has explicit approvals and is traceable

Next steps

• Use Resources to stay anchored to the official exam guide and core analytics docs.
• Use the FAQ to confirm expected depth, candidate profile, and service coverage.
• Turn your weak rows into replayable scenario prompts and drill them under time.

Quiz