Azure Data Engineer

Position: Data Engineer Location: Chicago IL Duration: 612 Months 5 years of experience in a Data Engineer role with a Graduate degree in Computer Science Statistics Informatics Information Systems or another quantitative field. Very good knowledge in o SQL (7 out of 10) o Databricks on Azure (7 out of 10) o PySpark (7 out of 10) o SparkSQL (7 out of 10) o Azure/ADLS (7 out of 10) Advanced working SQL knowledge and experience working with relational databases query authoring (SQL) as well as working familiarity with a variety of databases. Great numerical and analytical skills Data engineering certifications/Azure is a plus Create and maintain optimal data pipeline architecture Analyze and organize raw data Write pseudo code Combine raw information from different sources Explore ways to enhance data quality and reliability Working with stakeholders including data design product and executive teams and assisting them with datarelated technical issues Identify design and implement internal process improvements: automating manual processes optimizing data delivery redesigning infrastructure for greater scalability etc. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Experience supporting and working with crossfunctional teams in a dynamic environment. Build processes supporting data transformation data structures metadata dependency and workload management