Back

Data Warehousing

95-797

Units: 6

Description

Data warehouses are the central component of a modern data stack. They have solved the problem of analyzing massive amounts of structured & semi-structured data and are cost-effective, performant and easy to use. Data warehouses are the foundation for reporting, ad hoc analysis, business intelligence and machine learning, and enable collaboration among a diversity of users and stakeholders across organizations of all sizes.

This class will provide students with the conceptual background and hands on keyboard skills needed to utilize a data warehouse effectively. Throughout the course, students will work on an end-to-end development project, building a working data platform for New York City transit data. Using actual taxi, rideshare, bike share and weather data, students will answer real-world analytics questions, such as "How does location and time of day affect trip length?" and "How does weather affect transit preferences?". By the end, students will be empowered with the tools and techniques needed to take a real-world data project from problem statement to prototype to production.

MSIM Students: this is a coding intensive class in a language you may be unfamiliar with, during a time when you will be working on your capstone project and applying for jobs. Please carefully consider your availability and other obligations before registering for this class.

AI Policy: this class teaches foundational skills and the allowed uses of AI assistance will be restricted.

Learning Outcomes

  • Implement data ingest techniques (ETL)
  • Write advanced SQL for data analytics, including geographic and time series
  • Transform data using dbt
  • Compare modern and classic strategies of data modeling
  • Understand data warehouse architecture
  • Maintain data quality
  • Integrate a data warehouse in a broader data platform

Prerequisites Description

  • 95–703 A: Database Management (required)
  • 95-829: Software Design for Data Scientists (strongly recommended or equivalent industry experience)

Syllabus