The goal is to create an efficient system for collecting processing analyzing and visualizing large amounts of data from various sources
- Lay down the foundation and model the data
- Develop a platform for building and maintaining data pipelines that collect data from different sources
- Create Data Warehouse
- Analyze and prepare domain descriptions in collaboration with Business analytics
- Create Data Marts
- Design a permission model with flexible control over vertical and horizontal access to data
Qualifications :
- Conceptual knowledge of data analytics fundamentals e.g. dimensional modeling ETL/ELT reporting tools data governance data warehousing structured and unstructured data
- Strong SQL knowledge and experience with RDBMS confident knowledge of database fundamentals
- Experience in database development and data modeling ideally with Databricks/Spark
- Experience with Python
- Experience with Azure
- Working knowledge of serialization formats and their tradeoffs (columnar vs. rowbased)
- Experience debugging and optimizing Spark jobs
- Strong written and verbal communication skills
- At least an UpperIntermediate level of English
- BS in Computer Science or a related field
WOULD BE A PLUS
- Experience with a Business Intelligence tool
Remote Work :
Yes
Employment Type :
Fulltime