Data Engineer Charlotte NC
Data Engineer Charlotte NC
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Data Engineer
Charlotte NC Hybrid
Responsibilities:
- Develop and maintain robust data pipelines and ETL processes to facilitate seamless data integration across various platforms.
- Utilize Microsoft SQL Server and SSIS stack for data management and transformation tasks.
- Design and manage cloudbased data solutions on Azure or Google Cloud to ensure scalable and efficient data storage and processing.
- Leverage Apache tools including Airflow Spark and Hadoop for orchestrating data workflows and processing large datasets.
- Write and maintain highquality code in programming languages such as Java Python or C#.
- Implement realtime data streaming and eventdriven architectures using technologies like Apache Kafka or Azure Service Bus.
- Mentor and guide a team of data engineers fostering a culture of collaboration and continuous improvement.
- Ensure adherence to data governance and data quality best practices to maintain data integrity and reliability.
- Analyze and optimize current database architecture to enhance performance and scalability.
- Tune SQL queries and ETL processes to improve data performance and efficiency.
- Collaborate with crossfunctional teams to understand data requirements design scalable data solutions and ensure data security.
- Implement DevOps practices and tools for CI/CD in data engineering to streamline development and deployment processes.
- Demonstrate strong analytical and problemsolving skills while paying attention to detail.
You are:
- Bachelors degree in computer science Data Engineering or a related field.
- 5 years of experience in data engineering with a strong focus on developing and maintaining data pipelines and ETL processes.
- Proficient in Microsoft SQL Server and SSIS stack for data management tasks.
- Expertise in designing and managing cloudbased data solutions on Azure or Google Cloud.
- Experience with Apache tools including Airflow Spark and Hadoop.
- Strong programming skills in Java Python or C#.
- Experience with realtime data streaming and eventdriven architecture such as Apache Kafka or Azure Service Bus.
- Strong leadership skills with a demonstrated ability to mentor and guide a team of engineers.
- Knowledge of data governance and data quality best practices.
- Proven ability to optimize current database architecture for enhanced performance and scalability.
- Excellent analytical and problemsolving skills with a keen attention to detail.
- Strong communication skills to convey technical concepts effectively to nontechnical stakeholders.
It would be great if you also had:
- Experience with machine learning and data analytics tools is a plus.
- Familiarity with data visualization tools (e.g. Tableau Power BI) for presenting data insights.
- Knowledge of Agile methodologies and experience working in an Agile environment.
Employment Type
Full Time
Company Industry
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
