Sr Engineer ytics Streaming
Sr Engineer ytics Streaming
Posted on :
17-09-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Job Summary:
Role: Sr. Engineer Analytics (Streaming)
Location: Remote
Duration: Fulltime
Involved in designing building and maintaining realtime analytics infrastructure
Works with data scientists product managers and other engineers to develop and deploy data pipelines
Responsibilities:
Design build and maintain largescale data pipelines using technologies such as Apache Beam Kafka Kinesis Google Cloud Pub/Sub and DataFlow
Develop and implement streaming data processing jobs using Java or Python
Collaborate with data scientists and product managers to develop and deploy realtime analytics applications
Collaborate with other engineers to integrate data pipelines with data warehouse and data lake
Work with cloud providers such as Google Cloud Platform (GCP) Amazon Web Services (AWS) or Microsoft Azure
Monitor and troubleshoot streaming pipelines to ensure high availability and performance
Implement DevOps principles for efficient and reliable deployment of batch processing systems
Knowledge of containerization technologies such as Docker and Kubernetes
Requirements:
Bachelors degree in computer science or a related field
Minimum of 5 years of experience in software engineering with focus on data pipelines and analytics
Proficient in Java or Python programming
Experience with a public cloud provider preferably GCP
Experience with messaging/stream processing systems such as Apache Kafka Apache Kinesis Google Cloud Pub/Sub and Google Cloud DataFlow
Experience with data warehousing and data lake technologies
Strong understanding of data modeling data governance and data security
Excellent problemsolving skills and can work independently and collaboratively
Excellent communication skills ability to explain complex technical concepts to nontechnical stakeholders
Experience with machine learning and data science technologies is a plus
Certification in a public cloud provider or a relevant technology is a plus.
Role: Sr. Engineer Analytics (Streaming)
Location: Remote
Duration: Fulltime
Involved in designing building and maintaining realtime analytics infrastructure
Works with data scientists product managers and other engineers to develop and deploy data pipelines
Responsibilities:
Design build and maintain largescale data pipelines using technologies such as Apache Beam Kafka Kinesis Google Cloud Pub/Sub and DataFlow
Develop and implement streaming data processing jobs using Java or Python
Collaborate with data scientists and product managers to develop and deploy realtime analytics applications
Collaborate with other engineers to integrate data pipelines with data warehouse and data lake
Work with cloud providers such as Google Cloud Platform (GCP) Amazon Web Services (AWS) or Microsoft Azure
Monitor and troubleshoot streaming pipelines to ensure high availability and performance
Implement DevOps principles for efficient and reliable deployment of batch processing systems
Knowledge of containerization technologies such as Docker and Kubernetes
Requirements:
Bachelors degree in computer science or a related field
Minimum of 5 years of experience in software engineering with focus on data pipelines and analytics
Proficient in Java or Python programming
Experience with a public cloud provider preferably GCP
Experience with messaging/stream processing systems such as Apache Kafka Apache Kinesis Google Cloud Pub/Sub and Google Cloud DataFlow
Experience with data warehousing and data lake technologies
Strong understanding of data modeling data governance and data security
Excellent problemsolving skills and can work independently and collaboratively
Excellent communication skills ability to explain complex technical concepts to nontechnical stakeholders
Experience with machine learning and data science technologies is a plus
Certification in a public cloud provider or a relevant technology is a plus.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
