Velamuvi AIAcademy
Data Science & Engineering

Data Engineering Fundamentals

How data gets from where it is created to where it is used: storage, formats, pipelines and orchestration.

  • Intermediate
  • About 10 hours
  • 3 modules
  • 12 lessons
  • Free

This course is not released yet. We publish courses one at a time, each one complete. The full syllabus is below.

What you will learn

  • FoundationsWhat Data Engineers Do, Databases vs Data Lakes vs Warehouses, File Formats: CSV, JSON, Parquet and more
  • PipelinesAnatomy of a Pipeline, Orchestration With Airflow, Data Quality Checks and more
  • Modelling DataSchemas, Partitioning, Data Lineage and more

Course syllabus

Not released yet · full syllabus below

  1. 1

    Foundations

    4 lessons
    1. 1What Data Engineers DoSoon
    2. 2Databases vs Data Lakes vs WarehousesSoon
    3. 3File Formats: CSV, JSON, ParquetSoon
    4. 4Batch vs StreamingSoon
  2. 2

    Pipelines

    4 lessons
    1. 5Anatomy of a PipelineSoon
    2. 6Orchestration With AirflowSoon
    3. 7Data Quality ChecksSoon
    4. 8Idempotency and RetriesSoon
  3. 3

    Modelling Data

    4 lessons
    1. 9SchemasSoon
    2. 10PartitioningSoon
    3. 11Data LineageSoon
    4. 12Data for ML SystemsSoon

Recommended next