FIT5137
Advanced Database Technology
Topics
Data Engineering and Geospatial Databases
Part I: Data Engineering (Week 1-6)
- Introduction to Data Engineering
- Data Transformation and Data Warehousing
- Data Cleaning and Data Preparation
- Data Granularity
Part II: Geospatial Data Processing (Week 7-12)
- Overview of Spatial Databases
- Spatial Querying and Functions
- Maps, Roads and Trajectories
Week 1: Overview
- Introduction to data engineering
- Data transformation and data warehousing
- SQL revision
Week 2: Data Transformation and Data Warehousing
- Star schema modelling and implementation
- More advanced dimension modelling
Week 3: Data Warehousing and Data Cleaning
- Case studies of data cleaning in data warehousing
- Pre and post data warehousing
- Extended fact tables and pivot tables
Week 4: Bridge Tables and Hierarchies
- Concepts of bridge tables in data warehousing
- Snowflake schemas
- Hierarchy dimension modelling
Week 5: Multi-Fact and Multi-Input
- How to use multi-fact schema modelling
- How to use multi-input data warehousing
Week 6: Data Architecture and Granularity
- Concepts of granularity in data warehousing
- Designing high and low granularity data warehousing
Week 7: Introduction to Spatial Databases
- Spatial DBMS (PostGIS)
- Spatial concepts
- Spatial objects
Week 8: Spatial Functions
- Spatial SQL
- Spatial functions
- Spatial distances
Week 9: Spatial queries
- Spatial SQL
- KNN and Range Queries
Week 10: Import objects
- Spatial data formats
- QGIS visualization
Week 11: Big Spatial Data
- Spatial query optimization
- Spatial data pre-processing
Week 12: Roads and trajectories
- Roads structure
- Trajectories and Trajectory tracker apps