Data Engineering on AWS - A Data Lake Solution (Includes Labs) (日本語)

Overview

Dive into AWSでのデータレイク構築に必要な実践的スキルを習得。Amazon S3、Lake Formation、AWS Glueを活用し、データの取り込みから変換、セキュリティ管理まで、包括的なソリューションを実装。

Syllabus

- Introduction to Data Engineering on AWS -- Overview of Data Engineering Principles -- Introduction to AWS Services for Data Lake Solutions - Amazon S3 for Data Lakes -- Understanding Amazon S3 as a Storage Solution -- Best Practices for S3 Data Organization -- Lab: Setting Up and Configuring Amazon S3 Buckets - AWS Lake Formation -- Introduction to AWS Lake Formation -- Data Lake Security and Access Management -- Lab: Creating a Data Lake using Lake Formation - Data Ingestion and ETL with AWS Glue -- Overview of AWS Glue -- ETL Process Design and Implementation -- Lab: Building ETL Pipelines with AWS Glue - Data Transformation and Processing -- Transforming Data with AWS Glue Jobs -- Handling Streaming Data and Batch Processing -- Lab: Data Transformation Scenarios - Data Security and Governance -- Implementing Security Best Practices -- Data Encryption and Compliance -- Lab: Managing Security Policies and Permissions - Performance Optimization -- Optimizing Data Storage and Retrieval -- Tuning ETL Processes for Efficiency - Capstone Project -- Designing and Implementing a Complete Data Lake Solution -- Presenting and Reviewing Solutions

Taught by

Tags