Data Infrastructure Engineer
Data Infrastructure Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Role Senior Data Infrastructure Engineer
Experience 5 years
Notice period Immediate
Location
Duration Remote 3 6 months
Job Description
Title: Senior Data Infrastructure Engineer
About the role
As a Senior Data Infrastructure engineer you will be working with Data Engineering Analyst and Operations teams to build and maintain a secure scalable and reliable data platform that powers our Enterprise Data Hub. The position requires thorough working knowledge of public cloud big data fundamentals excellent programming skills experience with relational & nonrelational databases containerization IAM & networking security and troubleshooting.
What You’ll Do
.
Responsible for building and managing our cloud infrastructure (AWS) with code first mindset.
.
Design and architect ETL/ELT pipelines running on AWS EMR and Snowflake
.
Performance tune data pipelines using technologies such as Apache Spark Hive and Trino
.
Write and maintain highquality code and participate in design discussions and code reviews.
.
Implement data storage solutions such as S3 ERDS and NoSQL databases.
.
Automate workflows using orchestration systems like airflow oozie etc.
.
Build monitoring and observability dashboards.
.
Cost optimization and management.
.
Enforce security (create and maintain users and roles assign privileges) establish procedures to ensure data integrity and availability.
.
Perform oncall duties to keep the lights up 24x7.
.
Setup and maintain documentation and standards.
About you
.
BS degree in Computer Science or equivalent
.
5 years experience on public cloud such as AWS (preferred) Azure or GCP
.
Solid programming skills in Java or Python and Shell
.
Handson with Infrastructure as Code tools like Terraform or CloudFormation
.
Experience with performance diagnostics debugging and performance tuning.
.
Familiarity with container software & platforms like Kubernetes ECS etc.
.
Excellent verbal written and interpersonal communication skills.
Employment Type
Full Time
