SeniorLead Data Engineer RD AI Engineering
SeniorLead Data Engineer RD AI Engineering
Posted on :
04-03-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
This role is all about handson technical prowess. Youll be in the drivers seat working with autonomy accountability and technical brilliance. Your mission includes:
- Identify HighValue Data Opportunities: Spot highvalue data opportunities within our product offerings and translate raw data into powerful features and reusable data assets.
- Guide Data Technology Trends: Serve as our data whisperer guiding us towards the latest and greatest data technology and platform trends. Provide expertise on data processing estimates and data platform evolution.
- Develop and Integrate Data Projects: Craft and integrate data projects from the ground up. From framing problems and experimenting with new data sources and tools to the grand finale of data pipeline implementation and deployment ensuring scalability and toptier performance.
- Collaborate with CrossFunctional Teams: Work closely with ML Engineers Data Scientists Software Engineers Solution Architects and Product/Program Managers to define create deploy monitor and document data pipelines to power advanced analytics and AI solutions.
- Evangelize Data Technology: Become a data technology evangelist. Shine on the conference stage host webinars and pen compelling white papers and blogs. Share your discoveries with clients and internal stakeholders offering actionable insights that drive change.
Qualifications :
- Experience: 3 years in data engineering for Senior 5 years in data engineering for Lead with a strong track record of delivering scalable data solutions.
- Data Solutions: Skilled in scalable solutions like Data Lakes Graph and Vector Databases (e.g. ADLS neo4j Elasticsearch).
- Data Pipelines: Proficient in designing and managing data pipelines across cloud and onpremises environments using Azure and other technologies.
- Data Workflow Orchestration: Proven ability in orchestrating data workflows and Kubernetes clusters on AKS using tools like Airflow Kubeflow Argo and Dagster.
- Data Ingestion: Skilled with data ingestion tools such as Airbyte and Fivetran for diverse data sources.
- LargeScale Data Processing: Expert in largescale data processing with Spark or Dask.
- Programming Skills: Strong programming skills in Python Scala C# or Java with experience in cloud SDKs and APIs.
- AI/ML Expertise: Familiarity with AI/ML frameworks and tools including TensorFlow PyTorch AutoML and MLOps practices (e.g. MLflow Kubeflow).
- DevOps and CI/CD: Solid experience in DevOps and CI/CD automation with tools like Bitbucket Pipelines Azure DevOps and GitHub.
- Automation: Proficient in automating the deployment of data pipelines and applications using Bash PowerShell Azure CLI Terraform and Helm Charts.
- Search Technologies: Proven ability to leverage advanced search technologies (e.g. Azure AI Search Elasticsearch) for content analysis and indexing with a focus on creating advanced RAG (Retrieval Augmented Generation) services using Langchain.
- IoT Data Pipelines: Proficiency in building IoT data pipelines encompassing realtime data ingestion transformation security scalability and seamless integration with IoT platforms.
- Streaming Data Applications: Experience in designing developing and monitoring streaming data applications using Kafka and related technologies.
- Data Governance: Implement and enforce data governance policies and standards across the data platform.
- Soft Skills: A resultsdriven attitude a passion for innovation strategic thinking and excellent organizational skills. Ability to juggle multiple tasks and a proactive selfstarting nature.
Additional Information :
We embrace flexibility and hybrid work opportunities to support diverse needs and lifestyles while also valuing inclusive workplace experiences. By fostering a sense of community we drive innovation strengthen connections and nurture belonging. Our commitment ensures you can work in a way that suits you best while also engaging with colleagues to share ideas and build meaningful relationships.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
