Spark Engineer
Spark Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Description
We are seeking a talented and motivated Spark Engineer with expertise in CouchDB to join our dynamic team. As a Spark Engineer you will play a pivotal role in the development and maintenance of our data processing pipelines which leverage Apache Spark for efficient data analytics and integration. Your deep understanding of CouchDB will be essential in ensuring that our NoSQL data storage solutions are optimized for performance scalability and reliability. You will work closely with data scientists analysts and other engineers to design and implement robust solutions that drive business insights and support datadriven decisionmaking. In this role you will be responsible for converting complex data requirements into practical architectures while ensuring high levels of data integrity and quality. Your ability to solve complex problems and your passion for leveraging big data technologies will contribute significantly to our mission of delivering cuttingedge analytical solutions to our clients. If you thrive in a fastpaced environment enjoy collaborating with diverse teams and are looking for an exciting opportunity to advance your career we encourage you to apply for this position. Join us in transforming business through innovative data solutions.
Responsibilities
- Design and develop data processing pipelines using Apache Spark.
- Integrate CouchDB with Spark for efficient data storage and retrieval.
- Collaborate with crossfunctional teams to gather data requirements.
- Optimize data flows for maximum performance and reliability.
- Monitor and troubleshoot data processing jobs to ensure they run smoothly.
- Implement data quality checks and maintain data integrity across systems.
- Stay updated with the latest technologies in big data and NoSQL databases.
Requirements
- Proven experience as a Spark Engineer or similar role in data engineering.
- Strong knowledge of CouchDB and NoSQL database principles.
- Handson experience with Apache Spark and its ecosystem including Spark SQL and Spark Streaming.
- Proficiency in programming languages such as Java Scala or Python.
- Experience with data modeling ETL processes and data warehousing concepts.
- Excellent problemsolving skills and attention to detail.
- Strong communication and collaboration skills to work effectively in a team environment.
Employment Type
Full Time
