Amazon Web Services (AWS)
Data Engineering on AWS
Design and build the data platforms modern analytics depends on.
3 daysIntermediate13 modules
About this course
Design and build the data platforms modern analytics depends on. You will implement and secure data lakes and warehouses, build batch and streaming pipelines and apply governance best practices across AWS data services.
What you'll learn
- Design and implement scalable data lakes and data warehouses on AWS.
- Build, optimize, and secure batch data processing pipelines.
- Develop and manage streaming data solutions.
- Apply best practices for data governance and security.
- Automate data engineering workflows by using AWS services.
- Implement access control and security measures for data solutions.
Curriculum
13 modules
- The role of a data engineer
- Data discovery for a data analytics system
- AWS services for data workflows
- Continuous integration and continuous delivery
- Networking considerations
- Data lake introduction
- Data lake storage
- Ingest data
- Catalog data
- Transform data
- Serve data for consumption
- Optimizing performance
- Security using Lake Formation
- Setting permissions with Lake Formation
- Security and governance
- Troubleshooting
- Introduction to data warehouses
- Amazon Redshift overview
- Ingesting data into Amazon Redshift
- Processing data
- Serving data for consumption
- Monitoring and optimization options
- Data optimization in Amazon Redshift
- Query optimization in Amazon Redshift
- Data orchestration
- Authentication and access control in Amazon Redshift
- Data security in Amazon Redshift
- Introduction to batch data pipelines
- Designing a batch data pipeline
- Ingesting batch data
- Processing and transforming data
- Transforming data formats
- Integrating your data
- Cataloging data
- Serving data for consumption
- Optimizing the batch data pipeline
- Orchestrating the batch data pipeline
- Securing the batch data pipeline
- Introduction to streaming data pipelines
- Ingesting data from stream sources
- Storing streaming data
- Processing streaming data
- Analyzing streaming data
- Optimizing a streaming data solution
- Securing a streaming data pipeline
- Compliance considerations
- Cost optimization tools
13Course Wrap-Up
Who it's for
Data engineers and architects building analytics on AWS.
Before you start
- Basic understanding of AWS services
- Familiarity with database concepts
- Basic programming or scripting knowledge
- Understanding of data processing fundamentals
Related courses
More in Amazon Web Services (AWS) →Advanced
Advanced Architecting on AWS
Amazon Web Services (AWS)
View course →Advanced
Advanced Developing on AWS
Amazon Web Services (AWS)
View course →Advanced
Advanced Generative AI Development on AWS
Amazon Web Services (AWS)
View course →Advanced
Architecting on AWS
Amazon Web Services (AWS)
View course →Foundation
AWS Agentic AI Foundations
Amazon Web Services (AWS)
View course →Intermediate
AWS Cloud Financial Management for Builders
Amazon Web Services (AWS)
View course →Let's plan your next step together.
Tell us the course or certification you have in mind and we'll send the outline, upcoming dates, fees and private-team options.