Advanced E-Commerce Data Warehousing and Management with Snowflake
Designed and implemented a robust data warehousing system capable of handling complex E-commerce data stored in various formats, such as JSON, XML, and Parquet files, totaling up to 10k records. The system included comprehensive data cleansing processes to ensure data accuracy before loading it into tables, incremental loading for seamless data ingestion, and Snowflake stream functions for data transformation and maintaining aggregate tables. Furthermore, I enabled time travel functionality to facilitate update, delete, and insert operations on data, and to retrieve previous data versions.