Position Title: Lead Data Engineer
Location: Boston MA
Long term job duration
Minimum 10 years of experience in Data Warehousing (DWH)
Strong handson SQL skills including stored procedures and writing complex queries
Good knowledge of data warehousing concepts
Experience in Data Ingestion from various sources
4 years of experience with Snowflake cloud data warehouse and AWS S3
Implementation of SCD Techniques (type1 type2 type3)
Experience in AWS S3 and Snowflake cloud data warehouse
Knowledge of Snowflake Cloud Architecture SnowSQL and SNOWPIPE for continuous data ingestion
Ability to handle large and complex data sets (JSON ORC PARQUET CSV) from sources like AWS S3
Experience in bulk loading and unloading data into Snowflake tables
Ability to write complex SQL scripts using statistical aggregate functions and analytical functions to support ETL in Snowflake cloud data warehouse
Experience with performance tuning of Snowflake data warehouse with Query Profiler Caching and Virtual data warehouse scaling
Knowledge of Redshift is a plus
Familiarity with AWS EC2 Lambda
Python skills are a bonus.