Responsibilities:
- Assist in the design and implementation of Snowflakebased analytics solution (data lake and data warehouse) on AWS
- Requirements definition source data analysis and profiling the logical and physical design of the data lake and data warehouse as well as the design of data integration and publication pipelines
- Develop Snowflake deployment and usage best practices
- Help educate the rest of the team members on the capabilities and limitations of Snowflake
- Build and maintain data pipelines adhering to suggested enterprise architecture principles and guidelines
- Design build test and maintain data management systems
- Work in sync with internal and external team members like data architects data scientists data analysts to handle all sorts of technical issue
- Act as technical leader within the team
- Working in Agile/Lean model
- Deliver quality deliverables on time
- Translating complex functional requirements into technical solutions.
EXPERTISE AND QUALIFICATIONS
Essential Skills Education and Experience
- Should have a B.E. / B.Tech. / MCA or equivalent degree along with 47 years of experience in Data Engineering
- Creation and maintenance of optimum data pipeline architecture for ingestion processing of data
- Creation of necessary infrastructure for ETL jobs from a wide range of data sources using Talend DBT S3 Snowflake.
- Experience in Data storage technologies like Amazon S3 SQL NoSQL
- Data modeling technical awareness
- Experience in working with stakeholders working in different time zones
Good to have
- AWS data services development experience.
- Working knowledge on using Bigdata technologies.
- Experience in collaborating data quality and data governance team.
- Exposure to reporting tools like Tableau
- Apache Airflow Apache Kafka (nice to have)
- Payments domain knowledge
- CRM Accounting etc. in depth understanding
- Regulatory reporting exposure
Other skills
- Good Communication skills
- Team Player
- Problem solver
- Willing to learn new technologies share your ideas and assist other team members as needed
- Strong analytical and problemsolving skills; ability to define problems collect data establish facts and draw conclusions.
data engineering,nosql,data quality,problem solver,bigdata technologies,crm,data lake,data warehouse,etl,tableau,analytical skills,aws data services,data,apache kafka,talend,big data technologies,communication skills,sql,data integration,aws,s3,snowflake,data governance,apache airflow,dbt,data modeling,team player,apache