About Client:
Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84000 entrepreneurial professionals across more than 30 countries it caters to over 700 clients with its extensive domain and technology expertise to help drive superior competitive differentiation customer experiences and business outcomes.
Job Description:
- Develop AWS data pipelines in AWS cloud environment.
- Strong knowledge in writing understanding and debugging complex SQL and PG/ PLSQL scripts.
- Use transformation logics in AWS Glue/Pyspark with dataframes handling structured data/semi structured data.
- Good working knowledge in Snowflake data warehouse.
- Knowledge of DBT will be a plus.
- Experienced in debugging diagnosing and troubleshooting Medium/complex production code.
- Develop various AWS services such as Glue RDSRedshift Lambda etc. services.
- Strong handson experience in native AWS Glue ETL engineering S3 Redshift Database integration with other native AWS services and CICD using Python pyspark and AWS APIs.
- Handson experience in any User defined functions in Lambda EC2 Instances type & Details Secret Manager Ids Roles and policies (Inline policies) Lifecycle Policies at bucket level and S3 Glacier details Code commit repositories SNS system etc.
- Good to have knowledge in developing and maintaining data pipelines using AWS Cloud formation.
- Guide Team to ensure success in building and migrating applications software and services following the principles of the AWS WellArchitected Framework.
- Experience building and optimizing AWS data pipelines architectures and data sets.
- Experience in automation and provisioning services on AWS.
- Capture and share bestpractice knowledge among the AWS solutions architecture community
- AWS solutions architect and/or AWS developer certification is preferred.
- Strong communication skills
- Should have worked on at least 34 EndtoEnd Implementations/ Projects.