Data Engineering with AWS Nanodegree v4.0.1

Nanodegree key: nd027

Version: 4.0.1

Locale: en-us 更多精品新课扫一扫上面👆的二维码

Learn to design data models, build data warehouses and data lakes, automate data pipelines, and work with massive datasets.

Content

Part 01 : Welcome to the Nanodegree Program

Module 01: Welcome
- Lesson 01: Welcome to the Data Engineering Nanodegree Program
  
  Learn to design data models, build data warehouses and data lakes, automate data pipelines, and work with massive datasets.
- Lesson 02: Introduction to Data Engineering
  
  What does it mean to be a Data Engineer?

Part 02 : Intro to Python

Learn Python programming fundamentals such as data types and structures, variables, loops, and functions.

Module 01: Lessons
- Lesson 01: Why Python Programming
  
  Welcome to Introduction to Python! Here's an overview of the course.
  - Concept 01: Welcome to the Course!
  - Concept 02: Programming in Python
- Lesson 02: Data Types and Operators
  
  Familiarize yourself with the building blocks of Python! Learn about data types and operators, built-in functions, type conversion, whitespace, and style guidelines.
- Lesson 03: Data Structures
  
  Use data structures to order and group different data types together! Learn about the types of data structures in Python, along with more useful built-in functions and operators.
- Lesson 04: Control Flow
  
  Build logic into your code with control flow tools! Learn about conditional statements, repeating code with loops and useful built-in functions, and list comprehensions.
- Lesson 05: Functions
  
  Learn how to use functions to improve and reuse your code! Learn about functions, variable scope, documentation, lambda expressions, iterators, and generators.
- Lesson 06: Scripting
  
  Setup your own programming environment to write and run Python scripts locally! Learn good scripting practices, interact with different inputs, and discover awesome tools.
- Lesson 07: NumPy
  
  Learn the basics of NumPy and how to use it to create and manipulate arrays.
- Lesson 08: Pandas
  
  Learn the basics of Pandas Series and DataFrames and how to use them to load and process data.
- Lesson 09: Advanced Topics
  
  In this lesson we cover some advanced topics of iterators and generators. You are not required to complete this but we have provided these to give you a taste of these.
- Module 02: Project
  - Lesson 01: Explore US Bikeshare Data
    
    Use Python to understand U.S. bikeshare data. Calculate statistics and build an interactive environment where a user chooses the data and filter for a dataset to analyze.
    
    Project Description - Explore US Bikeshare Data
    
    Project Rubric - Explore US Bikeshare Data

Part 03 : Data Modeling

Learn to create relational and NoSQL data models to fit the diverse needs of data consumers. Use ETL to build databases in PostgreSQL and Apache Cassandra.

Module 01: Data Modeling Lessons and Projects
- Lesson 01: Introduction to Data Modeling
  
  In this lesson, students will learn the basic difference between relational and non-relational databases, and how each type of database fits the diverse needs of data consumers.
- Lesson 02: Relational Data Models
  
  In this lesson, students understand the purpose of data modeling, the strengths and weaknesses of relational databases, and create schemas and tables in Postgres
- Lesson 03: Project: Data Modeling with Postgres
  
  Students will model user activity data to create a database and ETL pipeline in Postgres for a music streaming app. They will define Fact and Dimension tables and insert data into new tables.
  
  Project Description - Data Modeling with Postgres
  
  Project Rubric - Data Modeling with Postgres
- Lesson 04: NoSQL Data Models
  
  Students will understand when to use non-relational databases based on the data business needs, their strengths and weaknesses, and how to creates tables in Apache Cassandra.
- Lesson 05: Project: Data Modeling with Apache Cassandra
  
  Students will model event data to create a non-relational database and ETL pipeline for a music streaming app. They will define queries and tables for a database built using Apache Cassandra.
  
  Project Description - Data Modeling with Apache Cassandra
  
  Project Rubric - Data Modeling with Apache Cassandra

**Part 08 (Elective) :** SQL for Data Analysis

Learn SQL language fundamentals such as building basic queries and advanced functions like Window Functions, Subqueries and Common Table Expressions.

Module 01: Lessons
- Lesson 01: Basic SQL
  
  In this section, you will gain knowledge about SQL basics for working with a single table. You will learn the key commands to filter a table in many different ways.
- Lesson 02: SQL Joins
  
  In this lesson, you will learn how to combine data from multiple tables together.
- Lesson 03: SQL Aggregations
  
  In this lesson, you will learn how to aggregate data using SQL functions like SUM, AVG, and COUNT. Additionally, CASE, HAVING, and DATE functions provide you an incredible problem solving toolkit.
- Lesson 04: SQL Subqueries & Temporary Tables
  
  In this lesson, you will be learning to answer much more complex business questions using nested querying methods - also known as subqueries.
- Lesson 05: SQL Data Cleaning
  
  Cleaning data is an important part of the data analysis process. You will be learning how to perform data cleaning using SQL in this lesson.
- Lesson 06: SQL Window Functions
  
  Compare one row to another without doing any joins using one of the most powerful concepts in SQL data analysis: window functions.
- Lesson 07: SQL Advanced JOINS & Performance Tuning
  
  Learn advanced joins and how to make queries that run quickly across giant datasets. Most of the examples in the lesson involve edge cases, some of which come up in interviews.

**Part 09 (Elective) :** Command Line Essentials

The Unix shell is a powerful tool for developers of all sorts. In this lesson, you'll get a quick introduction to the very basics of using it on your own computer.

Module 01: Command Line Essentials
- Lesson 01: Shell Workshop
  
  The Unix shell is a powerful tool for developers of all sorts. In this lesson, you'll get a quick introduction to the very basics of using it on your own computer.

**Part 10 (Elective) :** Git and Github

Learn how to use version control to save and share your projects with others.

Module 01: Git and GitHub
- Lesson 01: What is Version Control?
  
  Version control is an incredibly important part of a professional programmer's life. In this lesson, you'll learn about the benefits of version control and install the version control tool Git!
- Lesson 02: Create a Git Repo
  
  Now that you've learned the benefits of Version Control and gotten Git installed, it's time you learn how to create a repository.
- Lesson 03: Review A Repo's History
  
  Knowing how to review an existing Git repository's history of commits is extremely important. You'll learn how to do just that in this lesson.
- Lesson 04: Add Commits to A Repo
  
  A repository is nothing without commits. In this lesson, you'll learn how to make commits, write descriptive commit messages, and verify the changes you're about to save to the repository.
- Lesson 05: Tagging, Branching, and Merging
  
  Being able to work on your project in isolation from other changes will multiply your productivity. You'll learn how to do this isolated development with Git's branches.
- Lesson 06: Undoing Changes
  
  Help! Disaster has struck! You don't have to worry, though, because your project is tracked in version control! You'll learn how to undo and modify changes that have been saved to the repository.
- Lesson 07: Working With Remotes
  
  You'll learn how to create remote repositories on GitHub and how to get and send changes to the remote repository.
- Lesson 08: Working On Another Developer's Repository
  
  In this lesson, you'll learn how to fork another developer's project. Collaborating with other developers can be a tricky process, so you'll learn how to contribute to a public project.
- Lesson 09: Staying In Sync With A Remote Repository
  
  You'll learn how to send suggested changes to another developer by using pull requests. You'll also learn how to use the powerful git rebase command to squash commits together.

Content

Part 01 : Welcome to the Nanodegree Program

Part 02 : Intro to Python

Part 03 : Data Modeling

Part 04 : Cloud Data Warehouses

Part 05 : Data Lakes with Spark

Part 06 : Data Pipelines with Airflow

Part 07 : Capstone Project

Part 08 (Elective) : SQL for Data Analysis

Part 09 (Elective) : Command Line Essentials

Part 10 (Elective) : Git and Github

**Part 08 (Elective) :** SQL for Data Analysis

**Part 09 (Elective) :** Command Line Essentials

**Part 10 (Elective) :** Git and Github