Data Engineer Gen AI
Data Engineer Gen AI
Posted on :
21-09-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Overview:
The role of a Data Engineer at Gen AI is crucial for the organizations data infrastructure and analytics capabilities. The Data Engineer will be responsible for designing and developing scalable data pipelines integrating data from various sources and optimizing data flow and collection for crossfunctional teams. This position plays a key role in shaping the data architecture and ensuring efficient data management for the organizations datadriven decisionmaking processes.
Key Responsibilities:
- Design construct install test and maintain data management systems
- Develop and maintain scalable data pipelines for data analytics and processing
- Implement ETL processes to move data from various sources to data warehouses
- Collaborate with data scientists and analysts to understand data needs and deliver appropriate solutions
- Assess and develop data architecture strategies for the organizations data ecosystem
- Optimize and improve existing data pipelines and infrastructure
- Perform data modeling and schema design for various application requirements
- Ensure data quality and integrity by implementing best practices and data governance processes
- Automate data processes and monitor system performance and reliability
- Work closely with crossfunctional teams to understand data requirements and provide technical solutions
- Troubleshoot and resolve datarelated issues and provide technical support as needed
- Stay updated with the latest trends in data engineering and technologies
- Contribute to the continuous improvement of data engineering best practices and standards
Required Qualifications:
- Strong experience in Python programming language Must.
- Experience in REST APIs Fast APIs Graph APIs SQL Alchemy.
- Good experience in Azure Services like DataLake Azure SQL Function App Azure Cognitive Search.
- Good Understanding on Chunking Embeddings vectorization indexing Prompting Hallucinations RAG.
- Hands on experience in DevOps create pull PRs and maintain code repositories.
- Strong communication skills and ability to collaborate effectively with team members.
graph apis,rest apis,azure services,fast apis,python,data modeling,embeddings,rag,azure sql,chunking,hallucinations,python programming language,prompting,indexing,datalake,code repositories,sql,vectorization,azure,sql alchemy,azure cognitive search,devops,function app,etl,communication skills,collaboration
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
