S

snowflake

Open-source project for managing Snowflake permissions and roles through YAML configuration

The project use traffic data from automatic measurement and corresponding weather data in order to support analyses aimed at answering the question: Do weather conditions impact traffic?

The aim of the project is to design and implement entire data data flow using ETL/ELT tools and methods. The steps include: csv data extract and initial processing (Python), load to AWS S3 Data Lake (Python boto3, AWS CLI), staging (Snowflake) and transformation (dbt core), data warehousing (Snowflake), data prep and EDA (Python, pandas) and visualisation (Streamlit).

https://public.tableau.com/app/profile/shayne.lussier/viz/ClothingStore-Dashboard/Dashboard

A Qt based SnowFlakeID for resonable readable 128bits IDs. Converts to string or QVariantHash for easy JSON handling and back.

A Streamlit+Snowflake app for automatically loading uploaded CSV files to brand new tables in a staging area.

Example repository using dbt and Snowflake

A Snowflake Java UDF implementation prototype to demonstrate parsing of excel file

Kito Delveloper Task As a geeky Christmas fan I want to generate ASCII shapes of stars and trees in three different sizes so that I can decorate my office nicely for Christmas.