Location : Remote (USA)
Job Title: Big Data Developer
Experience: 7+ Years
Responsibilities:
Design and develop scalable big data solutions utilizing Hadoop, Spark, and other relevant big data technologies.
Create and maintain data models and schemas to support the storage and processing of large data sets.
Optimize and manage data production pipelines to ensure high data quality and reliability.
Collaborate with cross-functional teams to understand data requirements and design appropriate solutions.
Develop data processing frameworks to extract insights and generate actionable reports.
Implement and maintain real-time data processing solutions and frameworks.
Troubleshoot data-related issues and provide timely resolution.
Stay up-to-date with the latest industry trends and technologies related to big data development.
Mentor and provide guidance to junior developers in the team.
Qualifications and Skills:
Bachelor's degree in Computer Science, Information Technology, or a related field.
Proven experience as a Big Data Developer or similar role.
Strong programming skills in languages like Java, Scala, or Python.
In-depth knowledge of Hadoop ecosystem and related big data technologies (HDFS, MapReduce, Hive, Pig, etc.).
Experience with distributed computing frameworks like Apache Spark.
Proficiency in SQL and NoSQL databases.
Familiarity with real-time data processing, streaming platforms, and event-driven architectures.