Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are seeking a highly skilled Data Engineer with a strong background in SQL Python coding and experience with tools such as Airflow PySpark and AWS services including EMR and Athena as well as Hadoop. In this role you will be instrumental in designing building and maintaining our data architecture which supports the data needs of our organization. You will work closely with data scientists analysts and other engineers to ensure that our data pipelines are robust efficient and scalable. You will be responsible for implementing data ingestion processes optimizing data storage and enabling seamless access to data for analysis and reporting. Our ideal candidate is an analytical thinker with an ability to solve complex data problems and who is comfortable working in a fastpaced collaborative environment. As a Data Engineer you will have the opportunity to leverage cuttingedge technologies and contribute to projects that have a significant impact on datadriven decisionmaking across the company. If you are passionate about data engineering and have a track record of successful data integration and manipulation we would love to hear from you.
Responsibilities- Design and implement scalable data pipelines to support analytical and operational processes.
- Collaborate with data scientists and analysts to define data requirements and ensure data availability.
- Monitor and maintain the performance of existing data pipelines identifying and resolving bottlenecks.
- Develop and maintain ETL processes using tools such as Airflow and AWS services.
- Write efficient SQL queries to extract transform and load data from various sources.
- Implement data quality checks and validation procedures to ensure accuracy and reliability of data.
- Stay uptodate with new technologies and data engineering techniques to continuously improve data management practices.
- Bachelors degree in Computer Science Engineering or a related field.
- Proven experience as a Data Engineer or in similar roles with a strong portfolio of projects.
- Proficiency in SQL and experience with relational databases.
- Strong programming skills in Python with knowledge of data processing libraries such as Pandas and PySpark.
- Experience working with data orchestration tools like Airflow.
- Handson experience with cloud platforms particularly AWS services like EMR and Athena.
- Familiarity with big data technologies such as Hadoop and understanding of distributed computing frameworks.
Employment Type
Full Time
