Study DEA-C01 Orchestration, Workflows and Notifications: key concepts, common traps, and exam decision cues.
Pipelines are not just transforms chained together. They need orchestration, retries, sequencing, and notifications. DEA-C01 tests whether you can separate data processing from workflow coordination.
Orchestration: Coordination of multiple processing steps, dependencies, retries, and branching decisions in one workflow.
State-machine workflow: Workflow where each step and transition is explicit, which makes branching, retries, and failure handling easier to reason about.
Notification path: Delivery of alerts or events to people or systems after something important happens.
AWS wants you to separate:
DEA-C01 usually hides the right answer behind words like “pipeline,” “workflow,” or “alert.” The stronger first move is to ask whether the stem is about starting work, coordinating work, or simply telling someone what happened.
| Need | Strongest first fit | Why |
|---|---|---|
| DAG-style orchestration across many jobs | Amazon MWAA | The requirement is dependency-managed pipeline orchestration in an Airflow-style model |
| state-machine orchestration and branching | AWS Step Functions | The need is explicit state, branching, retries, and failure handling |
| event scheduling and triggering | Amazon EventBridge | The requirement is scheduling or event routing |
| simple alert fan-out | Amazon SNS | The issue is message delivery, not orchestration |
| queue-driven decoupling between producers and consumers | Amazon SQS | DEA-C01 expects you to separate queue buffering from workflow control |
| If the stem emphasizes… | Think first | Why this fits |
|---|---|---|
| starting a run on a schedule or incoming event | EventBridge | The center of gravity is the trigger |
| explicit branching, retries, and step state | Step Functions | This is state-machine workflow logic |
| Airflow-style DAG orchestration across jobs | MWAA | The pattern is managed Airflow orchestration |
| buffering work between producers and consumers | SQS | This is decoupling, not full workflow control |
| sending alerts to subscribers | SNS | This is fan-out notification, not orchestration |
The control path is often easier to answer correctly when you separate trigger, orchestrator, worker, and notification responsibilities.
flowchart TD
Trigger["EventBridge or Schedule"] --> Orchestrator["Step Functions / MWAA"]
Orchestrator --> Workers["Glue, Lambda, EMR, or Other Jobs"]
Workers --> Result["Success or Failure State"]
Result --> Notify["SNS or Other Notifications"]
| Question | Strongest first fit |
|---|---|
| “What starts the job on a schedule or event?” | EventBridge |
| “What coordinates branches, retries, and task order?” | Step Functions or MWAA |
| “What simply alerts subscribers?” | SNS |
| “What buffers work between producers and consumers?” | SQS |
If the problem is dependency coordination, retries, and state transitions, think orchestration first. If the problem is only message delivery, think notifications instead.
When several workflow services look viable, use this order:
| Trap | Better reading |
|---|---|
| “SNS is enough for multi-step retries and branching.” | SNS notifies; it does not orchestrate state transitions. |
| “EventBridge replaces workflow logic.” | EventBridge triggers or routes events, but it is not the full workflow brain. |
| “MWAA and Step Functions are interchangeable.” | DEA-C01 expects you to read DAG-style orchestration differently from state-machine branching. |
| “A queue is the same as orchestration.” | SQS buffers work; it does not coordinate the whole workflow lifecycle. |
| Situation | Stronger first answer |
|---|---|
| start a workflow every hour | EventBridge schedule |
| retry tasks and branch on validation outcomes | Step Functions |
| manage many dependent jobs in an Airflow-style DAG | MWAA |
| alert operators after final failure | SNS |
| decouple producers from slower consumers | SQS |
A data platform must start jobs on a schedule, branch based on validation results, retry failed steps, and alert operators only if the run still fails after retries. What is the strongest reading first?
Correct answer: A. DEA-C01 expects you to separate triggering, orchestration, and notification instead of forcing one service to do all three jobs.