Data Science & Engineering
Working with Large Datasets
What to do when data does not fit in memory: chunking, efficient formats, Polars, Dask and sampling.
- Advanced
- About 6 hours
- 2 modules
- 8 lessons
- Free
This course is not released yet. We publish courses one at a time, each one complete. The full syllabus is below.
What you will learn
- Staying in MemoryMeasuring Memory Use, Efficient Data Types, Chunked Processing and more
- Scaling OutPolars, Dask, DuckDB and more
Course syllabus
Not released yet · full syllabus below
- 1
Staying in Memory
4 lessons- 1Measuring Memory UseSoon
- 2Efficient Data TypesSoon
- 3Chunked ProcessingSoon
- 4Parquet and ArrowSoon
- 2
Scaling Out
4 lessons- 5PolarsSoon
- 6DaskSoon
- 7DuckDBSoon
- 8Smart SamplingSoon