AZURE DATA ENGINEER
AZURE DATA ENGINEER
Posted on :
29-09-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Azure Data Engineer Job Description
Main Roles and Responsibilities
- Design develop and implement ETL pipelines for the continuous deployment and integration.
- Collaborate with other data engineers and data scientists to understand data requirements and optimize data solution processes.
- Assure that data is cleansed mapped transformed and otherwise optimised for storage and use according to business and technical requirements
- The ability to automate tasks and deploy production standard code (with unit testing continuous integration versioning etc.)
- Load transformed data into storage and reporting structures in destinations including data warehouse high speed indexes realtime reporting systems and analytics applications
- Build data pipelines to collectively bring data together
- Other responsibilities include extracting data troubleshooting and maintaining the data warehouse
- Implement best practices for pipeline building and governance.
- Troubleshoot and resolve issues related to pipeline deployment and performance.
- Ensure compliance with security and data privacy standards
- Solution design using Microsoft Azure services and other tools
Required skills and experience
- 23 years of experience in Azure Data Analytics Synapse DevOps.
- Proficiency in programming languages such as Python SQL PySpark SparkSQL.
- Experience with Azure: ADLS Synapse Stream Analytics SQL DW Analysis Services Serverless Architecture ARM Templates
- Experience with cloud platforms like Azure AWS or and their respective services.
- Knowledge of CI/CD pipelines automation tools and version control systems like Git.
- Strong problemsolving skills and ability to troubleshoot complex issues.
- Experience with monitoring tools.
- Ability to work collaboratively in crossfunctional teams.
Nice to have:
- Should have Data Engineer certification from any discipline Azure AWS.
- Azure Synapse Studio Data bricks Fabric
- Familiarity with agile software development lifecycle (SCRUM Kanban etc.)
Remote Work :
No
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
