Qualifications:
Bachelors degree in Engineering Computer Science or relevant field.
5 years of experience in a Data Engineer role.
3 years experience with Apache Spark and solid understanding of the fundamentals.
Deep understanding of Big Data concepts and distributed systems.
Strong coding skills with Scala Python Java and/or other languages and the ability to
quickly switch between them with ease.
Advanced working SQL knowledge and experience working with a variety of relational
databases such as Postgres and/or MySQL.
Cloud Experience with DataBricks
Experience working with data stored in many formats including Delta Tables Parquet
CSV and JSON.
Comfortable working in a linux shell environment and writing scripts as needed.
Comfortable working in an Agile environment
Machine Learning knowledge is a plus.
Must be capable of working independently and delivering stable efficient and reliable
software.
Excellent written and verbal communication skills in English.
Experience supporting and working with crossfunctional teams in a dynamic
environment.
data lakes,cloud,cloud experience,python,parquet,agile,big data,us process,computerized system validation (csv),delta tables,csv,scala,postgres,linux shell,json,mysql,apache spark,databricks,machine learning,data engineering,cross-functional teams,sql,java,postgresql