Urgent Requirement :: Data Engineer :: Charlotte NC (Hybrid Work)
We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have a proven track record in data migration particularly from Teradata to Hadoop or from onpremises systems to the cloud. This role requires expertise in advanced data engineering tools and platforms as well as a solid understanding of modern cloudbased architectures. Experience in the finance domain is a strong plus.
Key Responsibilities:
- Lead data migration initiatives focusing on transitioning largescale datasets from Teradata to Hadoop/GCP or other onpremises systems to cloudbased platforms.
- Develop and maintain scalable data pipelines and ETL processes using technologies like Spark Hadoop and Dataproc.
- Design build and manage data integration workflows and orchestration using Kubernetes.
- Collaborate with crossfunctional teams to ensure efficient data architecture that meets business needs.
- Monitor and optimize performance of big data systems ensuring scalability and reliability.
- Provide technical guidance on best practices for data processing and migration strategies.
Qualifications:
- 5 years of experience in data engineering with a focus on data migration and big data platforms.
- Handson experience with Java Kubernetes Spark Hadoop and Dataproc.
- Experience in data migration from Teradata to Hadoop/GCP is highly preferred.
- Experience with Google Cloud Platform (GCP) is desired but not required.
- Strong knowledge of onpremises to cloud data migration strategies and tools.
- Familiarity with the finance domain is a plus.
- Excellent problemsolving skills and ability to work in a fastpaced environment.