Big Data Architect

Job Title: Big Data Architect
Role: Migrate from On-prem Hadoop Physical servers to On-prem Kubernetes Hadoop cluster + Object storage
Duration: 1+ Year
Location: St. Louis, MO (Onsite)
Work schedule: Hybrid


Resources will be working closely with the architects. On the solution and development team. Working with them to come up with a solution using Kubernetes and Object Storage like Minio/ Ceph/Apache Ozone etc..

Project:
What will they be working on? Separating compute and storage - moving from Hadoop to Kubernetes based cluster. Need someone to do research analysis, need clear guidance and a roadmap to complete this. Client wants to start moving the applications mid next year. There are a lot of servers that are nearing end of life and going to be out of support by mid to end of next year.
Need this person to already have experience doing this. Very fast-tracked.


Technical skills:
2-3 years of Platform experience working on a project like this
Hadoop
Kubernetes
Kafka
Spark
Object storage experience

Preferred skills/nice to have - adds more value:
Minio or Ceph
Apache ozone
Object storage technologies - S3
Spark, Scala, Hive, Base, Kudu