REQUIREMENTS:
- Total experience 10 years.
- Excellent knowledge and experience in Big data engineer.
- Strong working experience with architecture and development in Spark Scala AWS (EMR EC2 Lambda Glue S3 etc) Architecture and Designing SQL Server/NoSQL.
- Hands on experience in Hadoop Spark Scala SQL and Kafka.
- Expertise in AWS and Snowflake procedures in snowflake orchestrated through Airflow hence working knowledge on Python and Airflow.
- Experience with building and maintaining a cloud system.
- Familiarity with data modeling data warehousing and building distributed systems.
- Expertise in Spanner for highavailability scalable database solutions.
- Knowledge of data governance and security practices in cloudbased environments.
- Problemsolving mindset with the ability to tackle complex data engineering challenges.
- Strong communication and teamwork skills with the ability to mentor and collaborate effectively.
RESPONSIBILITIES:
- Writing and reviewing great quality code.
- Understanding the clients business use cases and technical requirements and be able to convert them in to technical design which elegantly meets the requirements.
- Mapping decisions with requirements and be able to translate the same to developers.
- Identifying different solutions and being able to narrow down the best option that meets the clients requirements.
- Defining guidelines and benchmarks for NFR considerations during project implementation.
- Writing and reviewing design document explaining overall architecture framework and highlevel design of the application for the developers.
- Reviewing architecture and design on various aspects like extensibility scalability security design patterns user experience NFRs etc. and ensure that all relevant best practices are followed.
- Developing and designing the overall solution for defined functional and nonfunctional requirements; and defining technologies patterns and frameworks to materialize it.
- Understanding and relating technology integration scenarios and applying these learnings in projects.
- Resolving issues that are raised during code/review through exhaustive systematic analysis of the root cause and being able to justify the decision taken.
- Carrying out POCs to make sure that suggested design/technologies meet the requirements.
Qualifications :
Bachelors or masters degree in computer science Information Technology or a related field.
Remote Work :
Yes
Employment Type :
Fulltime