Job Title : Azure Data Engineer
Location: Louisville, KY
Type: Full Time
Job Description:
- Strong Data Engineering Experience
- Working knowledge of structured and un-structured data
- Working knowledge of Compute requirements (Spark, Dataproc, Databricks, etc)
- Strong Scripting skills with Python or Scala
- Good understanding of cloud concepts including resource management, monitoring and debugging.
- Data pipeline experience, preferably in a Cloud toolkit like StreamSets, Azure Data Factory, etc.
- Experience in a DevOps (CI/CD) environment
- Experience deploying applications to Cloud using Azure Repos and CI/CD Pipelines
- Knowledge with containers such as Kubernetes or Docker (good to have)
- Knowledge of spinning up infrastructure via Terraform (good to have)
- Experience with SQL/NoSQL databases
- Oracle, MySQL, SQL Server, Netezza, Hive, etc
- MongoDB
- Experience with real time use cases using streaming technologies
- Kafka, Google PubSub, etc
- Experience writing and executing unit test cases
- Must be able to coordinate with offshore/onshore team on development activities