Data Engineer

Overview:

Key Responsibilities:

• Design construct install test and maintain highly scalable data management systems.
• Develop and maintain ETL processes for data integration and migration.
• Create and maintain optimal data pipeline architecture.
• Identify design and implement internal process improvements automating manual processes and optimizing data delivery.
• Build the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources using SQL and big data technologies.
• Collaborate with data science team to design missioncritical data models.
• Optimize and secure the organizations data infrastructure.
• Troubleshoot complex data issues and perform root cause analysis.
• Proactively identify and address performance bottlenecks.
• Document and communicate standard methods and best practices for data engineering.
• Participate in an oncall rotation to support critical data infrastructure.
• Ensure compliance and adherence to data management and security standards.
• Stay current with advancements and changes in data engineering technologies.
• Effectively prioritize and execute tasks in a highpressure environment.

Required Qualifications:

• Bachelors degree in Computer Science Information Technology or related field.
• Proven work experience as a Data Engineer or similar role.
• Indepth understanding of database management systems ETL framework and big data technologies.
• Proficiency in Python SQL and other programming languages.
• Experience with data modeling data warehousing and building ETL pipelines.
• Handson experience working with cloud services such as AWS.
• Familiarity with distributed computing and parallel processing.
• Experience with big data tools such as Apache Spark Hadoop etc.
• Strong analytical and problemsolving skills.
• Ability to work in a fastpaced collaborative and agile environment.
• Excellent communication and interpersonal skills.
• Detailoriented with strong organizational skills.
• Ability to thrive in a dynamic and rapidly changing environment.
• Certifications in relevant technologies is a plus.

data warehousing,cloud services,big data technologies,etl,interpersonal skills,sql,communication,problem-solving,python,organizational skills,aws,apache spark,etl processes,distributed computing,data pipeline architecture,data modeling,big data