Job Description:
- Skillset: Azure Scala Spark Pyspark Hadoop Hive
- Location: Remote
- Experience: 6 Years
- Job Title: Data Engineering Developer & Tester
Role Overview:
We are looking for a highly experienced Big Data Developer with expertise in Spark Scala and SQL.
The ideal candidate will have strong handson experience and a passion for data and data engineering.
This role involves working with large datasets and building insights via data enrichment modelling and visualization dashboards or thirdparty tools.
MustHave Skills:
- Proven experience as a Big Data Engineer with a focus on datadriven projects.
- Handson experience with Hadoop Hive Scala Druid and optionally Python.
- Extensive experience with Big Data Lakehouse platforms like Databricks.
- Solid understanding of Big Data platforms tools and technologies (e.g. Hadoop ecosystem).
- Experience with largescale data extraction enrichment and export processes.
- Strong knowledge of MapReduce and other big data algorithms.
- Database development expertise with a deep understanding of relational database design (ODS DWH).
- Proven track record in peer reviews unit testing and deployment to production environments.
- Finance Big Data project experience will be a strong advantage.
Skills
Azure, Scala, Spark, Pyspark, Hadoop, Hive