Job Title: Data Engineer
Location: Franklin, TN
client : Schneider Electric Job Grade: LTIM Grade P3
Experience: 10 years of relevant experience
Salary: $55-$60/Hr
Job Description:
- We are seeking an experienced Data Engineer to join our team at Franklin and Immplimentation. In this role, you will play a crucial part in managing and optimizing data pipelines and ensuring data availability, accuracy, and performance. The ideal candidate will have a proven track record with at least 10 years of experience in data engineering and the skills required to excel in this role.
Key Responsibilities:
- Develop and maintain data pipelines using Databricks and SparkSQL to process and analyze large datasets efficiently.
- Collaborate with cross-functional teams to understand data requirements and design data solutions.
- Write and optimize code in one or more of the following programming languages: Scala, Python, or Java.
- Implement data quality checks and ensure data integrity throughout the pipeline.
- Work with cloud-based data storage solutions, such as AWS S3 or Azure Data Lake.
- Performance tuning of data pipelines to meet business requirements.
- Troubleshoot and resolve data-related issues in a timely manner.
- Stay up-to-date with industry best practices and emerging data engineering technologies.