Technical Architect Spark Streaming Architect
Technical Architect Spark Streaming Architect
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Title: Technical Architect Spark Streaming Architect (Postgres SQL Kafka)
Duration: 6 Months (C2H)
Location: 100% Remote (NYC NY)
Responsibilities:
- 10 years Design and implement efficient data handling system based off Postgres or Spark tech stack.
- Experience investigating/troubleshooting & resolving PostgreSQL performance issues SQL query tuning and optimization.
- Experience in Database Administration specifically in PostgreSQL.
- Perform and oversee tasks such as writing scripts calling APIs and writing SQL queries.
- Implement data stores that support the scalable processing and storage of our highfrequency data.
- Handson experience with data cleaning visualization and reporting
- At least 4 years of relevant experience with realtime data stream platforms such as Kafka and Spark Streaming
- Experience working in an agile environment.
- Familiarity with the Hadoop ecosystem
- Experience with platforms such as MapReduce Spark Hive
- Experience with AWS is required.
Spark,Apache Kafka,Kafka,AWS,Hive,MapReduce,PostgreSQL,Hadoop,API
Employment Type
Full Time
