Data Engineer
Data Engineer
Posted on :
28-12-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Job Description:
1. Work closely with source data application teams and product owners to design implement and support analytics
solutions that provide insights to make better decisions
2. Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake
Storage Azure Data Factory Azure Functions Event Hub Azure Stream Analytics Azure Databricks etc.) and
traditional data warehouse tools
3. Perform multiple aspects involved in the development lifecycle design cloud engineering (Infrastructure
network security and administration) ingestion preparation data modeling testing CICD pipelines
performance tuning deployments consumption BI alerting prod support
4. Provide technical leadership and collaborate within a team environment as well as work independently
5. Be a part of a DevOps team that completely owns and supports their product (including prod support on rotation basis)
6. Implement batch and streaming data pipelines using cloud technologies
7. Leads development of coding standards best practices and privacy and security guidelines
8. Mentors others on technical and domain skills to create multifunctional teams
Preferred Qualifications Education & Prior Job Experience:
1. 5 years software solution development using agile dev ops product model that includes designing
developing and implementing largescale applications or data engineering solutions
2. 5 years data analytics experience using SQL
3. 3 years Spark/Databricks development experience preferably in Azure
4. 3 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub Azure Data Factory Azure Functions ADX ASA Azure Databricks Azure DevOps Azure Blob Storage Azure Data Lake Azure Power Apps and Power BI
1. Work closely with source data application teams and product owners to design implement and support analytics
solutions that provide insights to make better decisions
2. Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake
Storage Azure Data Factory Azure Functions Event Hub Azure Stream Analytics Azure Databricks etc.) and
traditional data warehouse tools
3. Perform multiple aspects involved in the development lifecycle design cloud engineering (Infrastructure
network security and administration) ingestion preparation data modeling testing CICD pipelines
performance tuning deployments consumption BI alerting prod support
4. Provide technical leadership and collaborate within a team environment as well as work independently
5. Be a part of a DevOps team that completely owns and supports their product (including prod support on rotation basis)
6. Implement batch and streaming data pipelines using cloud technologies
7. Leads development of coding standards best practices and privacy and security guidelines
8. Mentors others on technical and domain skills to create multifunctional teams
Preferred Qualifications Education & Prior Job Experience:
1. 5 years software solution development using agile dev ops product model that includes designing
developing and implementing largescale applications or data engineering solutions
2. 5 years data analytics experience using SQL
3. 3 years Spark/Databricks development experience preferably in Azure
4. 3 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub Azure Data Factory Azure Functions ADX ASA Azure Databricks Azure DevOps Azure Blob Storage Azure Data Lake Azure Power Apps and Power BI
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
