Big Data Developer

• Design develop and maintain largescale data processing systems leveraging Hadoop Spark and other Big Data technologies.
• Implement scalable and highperformance data pipelines for processing transforming and storing large volumes of data.
• Collaborate with crossfunctional teams to understand data requirements and design appropriate solutions.
• Optimize and tune data processing workflows for improved performance and efficiency.
• Develop and maintain documentation for data pipelines processes and systems.
• Monitor and troubleshoot data processing jobs to ensure reliability and availability.
• Stay updated with the latest developments in Big Data technologies and recommend best practices for implementation.
• Work closely with data scientists and analysts to support their data needs and provide actionable insights.

• Bachelors or Masters degree in Computer Science Engineering or related field.
• 47 years of handson experience in software development with expertise in Java Scala and Big Data technologies (Hadoop Spark).
• Proficiency in designing and building largescale distributed systems for data processing and analytics.
• Solid understanding of data structures algorithms and software engineering principles.
• Experience with cloud platforms (e.g. AWS Azure GCP) and containerization technologies (e.g. Docker Kubernetes) is a plus.
• Strong problemsolving skills and ability to work independently as well as part of a team.
• Excellent communication and interpersonal skills.
• Ability to thrive in a fastpaced and dynamic work environment.

data engineering,java,spark,hadoop,scala,python,big data technologies,data processing,amazon redshift,aws,airflow,azure,gcp,sql,athena,etl,machine learning,artificial intelligence,data modeling,data analysis,kafka,aws lambda,glue