Senior Data Warehouse Engineer India based 100 Remote
Senior Data Warehouse Engineer India based 100 Remote
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Overview
Key Responsibilities
- According to the companys data warehouse specifications and business understanding build a universal and flexible data warehouse system that can quickly support the needs and reduce repetitive development work efforts.
- Data model design development testing deployment online data job monitoring and the ability to quickly solve complex problems especially the optimization of complex calculation logic and performance tuning etc.
- Participate in Data governance including the construction of the company s metadata management system and data quality monitoring system.
- Participate in technical team building and learning growth and contribute to the team s overall knowledge accumulation and skill improvement.
Required Qualifications
- 6 years experiences of data lake and data warehouse design and development experience.
- Deeply understanding of data warehouse modeling and data governance.
- Solid knowledge of data warehouse development methodology including dimensional modeling information factory and one data etc.
- Proficient in Java / Scala / Python (at least one language) and Hive & Spark SQL programming languages.
- Familiar with OLAP technology (such as: kylin impala presto druid etc.).
- Proficient in Big Data batch pipeline development.
- Familiar with Big Data components including but not limited to Hadoop Hive Spark Delta lake Hudi Presto Hbase Kafka Zookeeper Airflow Elasticsearch Redis etc.
- Experiences with AWS Big Data services are a plus.
- Clear mind with good business requirement understanding analysis abstraction and system design capabilities.
- Those who have experienced data volume above PB level in Internet companies and solve difficult production issues are preferred.
hive,delta lake,dimensional modeling,scala,data,data lake,data modeling,presto,zookeeper,hadoop,aws big data services,data warehousing,hudi,design,data governance,java,airflow,spark sql,python,kafka,data warehouse design,olap technology,olap,big data,elasticsearch,redis,hbase
Employment Type
Full Time
Company Industry
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
