Data Science & Engineering
Data Engineering Fundamentals
How data gets from where it is created to where it is used: storage, formats, pipelines and orchestration.
- Intermediate
- About 10 hours
- 3 modules
- 12 lessons
- Free
This course is not released yet. We publish courses one at a time, each one complete. The full syllabus is below.
What you will learn
- FoundationsWhat Data Engineers Do, Databases vs Data Lakes vs Warehouses, File Formats: CSV, JSON, Parquet and more
- PipelinesAnatomy of a Pipeline, Orchestration With Airflow, Data Quality Checks and more
- Modelling DataSchemas, Partitioning, Data Lineage and more
Course syllabus
Not released yet · full syllabus below
- 1
Foundations
4 lessons- 1What Data Engineers DoSoon
- 2Databases vs Data Lakes vs WarehousesSoon
- 3File Formats: CSV, JSON, ParquetSoon
- 4Batch vs StreamingSoon
- 2
Pipelines
4 lessons- 5Anatomy of a PipelineSoon
- 6Orchestration With AirflowSoon
- 7Data Quality ChecksSoon
- 8Idempotency and RetriesSoon
- 3
Modelling Data
4 lessons- 9SchemasSoon
- 10PartitioningSoon
- 11Data LineageSoon
- 12Data for ML SystemsSoon