Job Title: Azure Data Engineer
Location: Houston, TX (Initially Remote)
Experience: 8+ Years
- Experience building complex, highly scalable and reliable data pipelines using technologies like Databricks, spark, Kafka, Hive, Parquet, Avro
- Software development experience with High level languages like Python, Scala, Java, SQL, No-SQL
- Experience working with pipeline orchestration tools to automate data flows like Azure Data Factory,
- Airflow, Perfect
- Experienced in Establishing and promoting high standards in DevOps, Security, CI/CD, Monitoring, data
- validation, testing
- Experience with cloud platforms (preferably Azure) and experience building enterprise level data lakes
- Experience with Microservices and RESTful APIs
- Understanding Data Catalog, Data Governance, Data Lineage
- Experience with integration of data from multiple data sources
- Bachelor's Degree or above (Computer Science, Bio Engineering, Electronics and Electrical Engineering or any related field)
- 5+ years of experience in data engineering