Role: Staff Data Engineer
Location: Austin TX (Day 1 Onsite and need only local candidates to TX)
Duration: 12 Months
Experience: 12 Years
Note: AWS Certification is mandatory for this role
Responsibilities:
- Data Architecture: Design develop and maintain scalable data architectures and pipelines on AWS to support data analytics and business intelligence.
- ETL Processes: Build and manage ETL processes to extract transform and load data from various sources into data warehouses and data lakes.
- Data Integration: Integrate data from multiple sources ensuring data quality consistency and security.
- Performance Optimization: Optimize data processing workflows for performance scalability and costefficiency.
- Collaboration: Work closely with data scientists analysts and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Monitoring: Implement monitoring and alerting systems to ensure data pipeline reliability and performance.
- Documentation: Maintain comprehensive documentation of data architectures pipelines and processes.
Qualifications:
- Education: Bachelor/Masters degree in computer science Engineering or a related field.
- Experience:
- 10 years of experience in data engineering with a focus on AWSbased solutions.
- Proven experience in designing and implementing data pipelines and architectures.
- Technical Skills:
-
- AWS Services: Proficiency in AWS services such as S3 Redshift Glue Lambda EMR and RDS.
- Programming Languages: Strong programming skills in Python.
- Big Data Technologies: Experience with big data technologies like Hadoop Spark and Kafka.
- Database Management: Proficiency in SQL and NoSQL databases.
- Data Modeling: Strong understanding of data modeling data warehousing and data lake concepts.
- DevOps: Familiarity with DevOps practices and tools (e.g. Docker Kubernetes Jenkins).
- Security: Knowledge of data security best practices and compliance requirements.
- Certifications:
-
- AWS Certified Data Engineer Associate
- AWS Certified Data Analytics Specialty
-
Soft Skills:
- ProblemSolving: Strong analytical and problemsolving skills.
- Communication: Excellent communication and interpersonal skills to interact with various stakeholders.
- Teamwork: Ability to work effectively in a collaborative team environment.
- Adaptability: Flexibility to adapt to changing business requirements and technologies.