English | MP4 | AVC 1920×1080 | AAC 44KHz 2ch | 273 lectures (21h 15m) | 7.00 GB
AWS DEA-C01 certification prep course with exercises. S3, Glue, Kinesis, Redshift, Lambda, Athena, EventBridge, and more
The AWS Certified Data Engineer Associate Exam is one of the most challenging associate-level certification exams you can take from Amazon Web Services, and even among the most challenging overall. Passing it tells employers in no uncertain terms that your knowledge of data pipelines is wide and deep. But, even experienced technologists need to prepare heavily for this exam. This course sets you up for success, by covering all of the data ingestion, transformation, and orchestration technologies on the exam and how they fit together.
Best-selling Udemy instructors Frank Kane and Stéphane Maarek have teamed up to deliver the most comprehensive and hands-on prep course we’ve seen. Together, they’ve taught over 2 million people around the world. This course combines Stéphane’s depth on AWS with Frank’s experience in wrangling massive data sets, gleaned during his 9-year career at Amazon itself.
The world of data engineering on AWS includes a dizzying array of technologies and services. Just a sampling of the topics we cover in-depth are:
- Streaming and transforming data with Amazon Kinesis and Amazon Managed Streaming for Apache Kafka (MSK)
- Queuing messages with Simple Queue Service (SQS)
- Orchestrating data pipelines with Amazon AppFlow, Amazon EventBridge, AWS Step Functions, and Amazon Managed Workflows for Apache Airflow (MWAA)
- Transitioning from small to big data with the AWS Database Migration Service (DMS), AWS DataSync, Snow Family, Transfer Family, and more
- Storing massive data lakes with the Simple Storage Service (S3) and managing data lifecycles
- Optimizing transactional queries with DynamoDB, DocumentDB, Keyspaces, and MemoryDB
- Tying your big data systems together with AWS Lambda
- Making unstructured data query-able with AWS Glue, Glue DataBrew, and Lake Formation
- Processing data at unlimited scale with Elastic MapReduce, including Apache Spark
- Applying advanced machine learning algorithms at scale with Amazon SageMaker
- Searching and analyzing petabyte-scale data with Amazon Opensearch (formerly Elasticsearch) Service
- Querying S3 data lakes with Amazon Athena
- Hosting massive-scale data warehouses with Redshift and Redshift Spectrum
- Integrating smaller data with your big data, using the Relational Database Service (RDS)
- Visualizing your data interactively with Quicksight
- Keeping your data secure with encryption, KMS, Macie, Secrets Manager, IAM, and more
- Managing and governing your systems with CloudFormation, CloudTrail, CloudWatch, AWS Config, and
- more
Throughout the course, you’ll have lots of opportunities to reinforce your learning with hands-on demos and practice questions. We’ll also arm you with some valuable test-taking tips and strategies along the way.
Although this is an associate-level exam, it is one of the more challenging ones. AWS recommends having a few years of both data engineering experience and AWS experience before tackling it. This exam is not intended for AWS beginners.
You want to go into the AWS Certified Data Engineer Associate Exam with confidence, and that’s what this course delivers. Hit the enroll button, and we’re excited to see you in the course… and ultimately to see you get your certification!
What you’ll learn
- Maximize your odds of passing the AWS Certified Data Engineer – Associate (DEA-C01) exam
- Design and implement data pipelines with AWS to ingest, store, and transform data
- Choose and design data stores, data models, data schemas, and data lifecycles.
- Maintain, operationalize, and orchestrate data pipelines with EventBridge, Airflow, AWS Step
- Functions,, and more
- Apply security, governance, and privacy best practices to your AWS data pipelines.
- Create data lakes with S3, Glue, Redshift and more
- Process batch and streaming data with Kinesis, EMR, containers, Lambda, and more
Table of Contents
Introduction
1 Course Overview Services we will Cover
2 Get the Course Materials
3 Udemy 101
Data Engineering Fundamentals
4 Intro Data Engineering Fundamentals
5 Types of Data Structured Unstructured SemiStructured
6 Properties of Data Volume Velocity Variety
7 Data Warehouses vs Data Lakes and Lakehouses
8 Managing and Orchestrating ETL Pipelines
9 Common Data Sources and Data Formats
10 Quick Review of Data Modeling Data Lineage and Schema Evolution
11 Database Performance Optimization
12 Data Sampling Techniques
13 Data Skew Mechanisms
14 Data Validation and Profiling
15 SQL Review Aggregations Grouping Sorting Pivoting
16 SQL JOIN types
17 Git review architecture and commands
Storage
18 Intro Storage
19 Amazon S3
20 Amazon S3 Hands On
21 Amazon S3 Security Bucket Policy
22 Amazon S3 Security Bucket Policy Hands On
23 Amazon S3 Versioning
24 Amazon S3 Versioning Hands On
25 Amazon S3 Replication
26 Amazon S3 Replication Notes
27 Amazon S3 Replication Hands On
28 Amazon S3 Storage Classes
29 Amazon S3 Storage Classes Hands On
30 Amazon S3 Lifecycle Rules
31 Amazon S3 Lifecycle Rules Hands On
32 Amazon S3 Event Notifications
33 Amazon S3 Event Notifications Hands On
34 Amazon S3 Performance
35 Amazon S3 Select Glacier Select
36 Amazon S3 Encryption
37 About DSSEKMS
38 Amazon S3 Encryption Hands On
39 Amazon S3 Default Encryption
40 Amazon S3 Access Points
41 Amazon S3 Object Lambda
42 Amazon EBS
43 Amazon EBS Hands On
44 Amazon EFS
45 Amazon EFS Hands On
46 Amazon EFS vs Amazon EBS
47 AWS Backup
48 AWS Backup Hands On
Database
49 Intro Database
50 Amazon DynamoDB
51 Amazon DynamoDB Hands On
52 Amazon DynamoDB in Big Data
53 Amazon DynamoDB Throughput RCU WCU
54 Amazon DynamoDB Throughput RCU WCU Hands On
55 Amazon DynamoDB Basic APIs
56 Amazon DynamoDB Basic APIs Hands On
57 Amazon DynamoDB Indexes LSI GSI
58 Amazon DynamoDB Indexes LSI GSI Hands On
59 Amazon DynamoDB PartiQL
60 Amazon DynamoDB Accelerator DAX
61 Amazon DynamoDB Accelerator DAX Hands On
62 Amazon DynamoDB Streams
63 Amazon DynamoDB Streams Hands On
64 Amazon DynamoDB Time To Live TTL
65 Amazon DynamoDB Patterns with S3
66 Amazon DynamoDB Security
67 Amazon RDS
68 Shared and exclusive locks in RDS
69 Amazon RDS Best Practices
70 Amazon DocumentDB
71 Amazon MemoryDB for Redis
72 Amazon Keyspaces for Apache Cassandra
73 Amazon Neptune
74 Amazon Redshift Intro Architecture
75 Redshift Spectrum and Performance Tuning
76 Redshift Durability and Scaling
77 Redshift Distribution Styles
78 Redshift Sort Keys
79 Redshift Data Flows and the COPY command
80 Redshift Integration WLM Vacuum
81 Redshift Resizing Newer Features
82 Redshift AQUA Redshift ML
83 Redshift Security
84 Redshift Serverless
85 Redshift Materialized Views
86 Redshift Data Sharing Data Shares
87 Redshift Lambda UDF
88 Redshift Federated Queries
89 Redshift Hands On
Migration and Transfer
90 Intro Migration and Transfer
91 Application Discovery Service Application Migration Service
92 AWS Database Migration Service AWS DMS
93 AWS Database Migration Service AWS DMS Hands On
94 AWS DataSync
95 AWS Snow Family
96 AWS Snow Family Hands On
97 AWS Transfer Family
Compute
98 Intro Compute
99 EC2 in Big Data
100 AWS Lambda
101 Lambda Integration Part 1
102 Lambda Integration Part 2
103 AWS Lambda File Systems Mounting
104 AWS SAM
105 AWS SAM CLI Installation
106 AWS SAM Create Project
107 AWS SAM Deploy Project
108 AWS SAM with API Gateway
109 AWS SAM with DynamoDB
110 AWS Batch
Containers
111 Intro Containers
112 What is Docker
113 Amazon ECS
114 Amazon ECS Create Cluster Hands On
115 Amazon ECS Create Service Hands On
116 Amazon ECR
117 Amazon EKS
118 Amazon EKS Hands On
Analytics
119 Intro Analytics
120 AWS Glue
121 Glue Hive and ETL
122 Modifying the Glue Data Catalog from ETL Scripts
123 Glue ETL Developer Endpoints Running ETL Jobs with Bookmarks
124 Glue Costs and AntiPatterns
125 AWS Glue Studio
126 AWS Glue Data Quality
127 AWS Glue DataBrew
128 Handling PII in DataBrew Transformations
129 AWS Lake Formation
130 AWS Lake Formation Data Filters
131 Amazon Athena
132 Athena and Glue Costs and Security
133 Athena Performance
134 Athena ACID Transactions
135 Athena FineGrained Access to AWS Glue Data Catalog
136 Apache Spark
137 Athena Glue and S3 Data Lakes Hands On
138 Spark Integration with Kinesis and Redshift
139 Spark Integration with Athena
140 Amazon EMR
141 EMR AWS integration and Storage
142 EMR Promises Intro to Hadoop
143 EMR Serverless EMR on EKS
144 Amazon Kinesis Data Streams
145 Amazon Kinesis Data Streams Producers
146 Amazon Kinesis Data Streams Consumers
147 Amazon Kinesis Data Streams Hands On
148 Amazon Kinesis Data Streams Enhanced Fan Out
149 Amazon Kinesis Data Streams Scaling
150 Amazon Kinesis Data Streams Handling Duplicates
151 Amazon Kinesis Data Streams Security
152 Amazon Kinesis Data Firehose
153 Amazon Kinesis with CloudWatch Subscription Filters
154 Kinesis Data Stream Troubleshooting and Performance Tuning
155 Kinesis Data Analytics Amazon Managed Service for Apache Flink MSAF
156 Kinesis Analytics Costs RANDOMCUTFOREST
157 Amazon MSK
158 Amazon MSK Connect
159 Amazon MSK Serverless
160 Amazon Kinesis vs Amazon MSK
161 Amazon OpenSearch Service
162 Amazon OpenSearch Service Pt 2
163 OpenSearch Index Management and Designing for Stability
164 Amazon OpenSearch Service Performance
165 Amazon OpenSearch Serverless
166 Amazon QuickSight
167 QuickSight Pricing and Dashboards ML Insights
Application Integration
168 Intro Application Integration
169 Amazon SQS
170 Amazon Kinesis Data Streams vs Amazon SQS
171 Amazon SQS Dead Letter Queues
172 Amazon SQS Dead Letter Queues Hands On
173 Amazon SNS
174 Amazon SNS with SQS Fan Out
175 Amazon SNS Hands On
176 AWS Step Functions
177 Amazon AppFlow
178 Amazon EventBridge
179 Amazon EventBridge Hands On
180 Amazon Managed Workflows for Apache Airflow Amazon MWAA
181 Full Data Engineering Pipelines
Security Identity and Compliance
182 Intro Security Identity and Compliance
183 Principle of Least Privilege
184 Data Masking and Anonymization
185 Key Salting
186 Preventing Backups or Replication to Disallowed AWS Regions
187 IAM Introduction Users Groups Policies
188 IAM Users Groups Hands On
189 IAM Policies
190 IAM Policies Hands On
191 IAM MFA
192 IAM MFA Hands On
193 IAM Roles
194 IAM Roles Hands On
195 Encryption 101
196 AWS KMS
197 AWS KMS Hands On
198 Amazon Macie
199 AWS Secrets Manager
200 AWS Secrets Manager Hands On
201 AWS WAF
202 AWS Shield
203 AWS Services Security Deep Dive Part 1
204 AWS Services Security Deep Dive Part 2
205 AWS Services Security Deep Dive Part 3
Networking and Content Delivery
206 Intro Networking and Content Delivery
207 VPC Subnets Internet Gateway NAT Gateway
208 NACL Security Groups VPC Flow Logs
209 VPC Peering Endpoints VPN Direct Connect
210 VPC Cheat Sheet Closing Comments
211 AWS PrivateLink
212 What is DNS
213 Amazon Route 53
214 Amazon Route 53 Registering Domains Hands On
215 Amazon Route 53 Creating DNS Records Hands On
216 Amazon CloudFront
217 Amazon CloudFront S3 as Origin Hands On
218 Amazon CloudFront ALB as Origin
219 Amazon CloudFront Cache Invalidation
Management and Governance
220 Intro Management and Governance
221 Amazon CloudWatch Metrics
222 Amazon CloudWatch Logs
223 Amazon CloudWatch Logs Hands On
224 Amazon CloudWatch Logs Unified Agent
225 Amazon CloudWatch Alarms
226 Amazon CloudWatch Alarms Hands On
227 Amazon CloudTrail
228 Amazon CloudTrail Hands On
229 AWS CloudTrail Lake
230 AWS Config
231 AWS Config Hands On
232 CloudWatch vs CloudTrail vs Config
233 AWS CloudFormation
234 AWS CloudFormation Hands On
235 SSM Parameter Store
236 SSM Parameter Store Hands On
237 SSM Parameter Store Lambda Integration
238 AWS WellArchitected Framework Tool
239 Amazon Managed Grafana
Machine Learning
240 Intro Machine Learning
241 Amazon SageMaker
242 SageMaker Feature Store
243 SageMaker ML Lineage Tracking
244 SageMaker Data Wrangler
Developer Tools
245 Intro Developer Tools
246 AWS Access Keys CLI SDK
247 AWS CLI Setup on Windows
248 AWS CLI Setup on Mac OS X
249 AWS CLI Setup on Linux
250 AWS CLI Hands On
251 AWS Cloud9
252 AWS Cloud9 Hands On
253 AWS CDK
254 AWS CDK Hands On
255 AWS CodeDeploy
256 AWS CodeCommit
257 AWS CodeBuild
258 AWS CodePipeline
Everything Else
259 Intro Everything Else
260 AWS Budgets
261 AWS Budgets Hands On
262 AWS Cost Explorer
263 Amazon API Gateway
264 Amazon API Gateway Hands On
Wrapping Up
265 Intro Wrapping Up
266 Reviewing the Exam Guide and other AWS resources
267 General AWS Certification Exam Tips
268 Exam Walkthrough and Signup
269 Save 50 on your AWS Exam Cost
270 Get an Extra 30 Minutes on your AWS Exam Non Native English Speakers Only
271 AWS Certification Paths
272 Thank you
273 BONUS Lecture
Resolve the captcha to access the links!