Job Title: Data Engineer
Location: Nacharam
Tenure: 1 year to begin with extension possibility as per performance and business requirement
Experience: 57 years
Job Description:
We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in setting up data lakes and data factories primarily on the Azure platform. This role involves designing implementing and maintaining scalable data solutions to support our business needs.
Key Responsibilities:
- Design develop and maintain data pipelines and architectures for data processing and integration.
- Set up and manage Azure Data Lake Storage (ADLS) and Azure Data Factory (ADF) to ensure efficient data flow and storage.
- Implement data ingestion transformation and loading processes using Azure services.
- Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver solutions.
- Ensure data quality integrity and security across all data platforms.
- Monitor and optimize data pipelines for performance and costefficiency.
- Troubleshoot and resolve datarelated issues and provide technical support
- Knowledge of MLOps & Azure DevOps is must
Requirements
Qualifications:
- Proven experience as a Data Engineer or in a similar role.
- 57 years of software development experience. Must have delivered minimum 5 end to end projects
- Strong expertise in Azure Data Lake Storage (ADLS) and Azure Data Factory (ADF).
- Proficiency in SQL Python and other relevant programming languages.
- Experience with ETL processes data modeling and data warehousing.
- Familiarity with big data technologies such as Hadoop Spark or Databricks is a plus.
- Excellent problemsolving skills and attention to detail.
- Strong communication and collaboration skills.
Preferred Qualifications:
- Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect.
- Experience with other Azure services like Azure Synapse Analytics Azure Databricks and Azure Stream Analytics.
- Knowledge of Power BI will be added benefit
- Knowledge of data governance and compliance standards.
Benefits
- Opportunity to define your career path and not as enforced by a manager
- A great consulting environment with a chance to work with Fortune 500 companies and startups alike.
- A dynamic but relaxed and supportive working environment that encourages personal development.
- Be part of One Extended Family. We bond beyond work sports gettogethers common interests etc. Work in a very enriching environment with Open Culture Flat Organization and Excellent Peer Group.
- Be part of the exciting Growth Story of Thoucentric!
Data Engineer, Azure