Data Engineer

Overview:

Key Responsibilities:

• Develop construct test and maintain data architectures such as databases and largescale processing systems
• Design and maintain scalable data pipelines for data integration and transformation
• Create and maintain optimal data pipeline architecture
• Identify design and implement internal process improvements: automating manual processes optimizing data delivery redesigning infrastructure for greater scalability etc.
• Collaborate with data scientists and other team members on datarelated projects
• Build the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources using SQL and big data technologies
• Work with stakeholders including the Executive Product Data and Design teams to assist with datarelated technical issues and support their data infrastructure needs
• Keep our data separated and secure across national boundaries through multiple data centers and cloud providers
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader
• Provide support to the data science team in the development and deployment of machine learning models
• Work towards reducing data redundancy and maintaining data integrity
• Troubleshoot datarelated problems and author technical documentation
• Stay current with industry best practices and emerging technologies and recommend when and where they can be implemented
• Ensure data quality and integrity and performance of our data systems
• Proactively monitoring and improving system performance and dependability

Required Qualifications:

• Bachelors or Masters degree in Computer Science Information Technology or a related field
• Proven experience as a Data Engineer or in a similar role
• Experience with relational SQL and NoSQL databases
• Experience with ETL tools
• Experience with big data tools such as Hadoop Spark etc.
• Experience with cloud platforms such as AWS Azure or Google Cloud
• Experience with data modeling data warehousing and building ETL pipelines
• Strong programming skills in languages such as Python Java or Scala
• Experience with data visualization tools like Tableau Power BI etc.
• Ability to work in a team and possess strong problemsolving skills
• Excellent communication and collaboration skills
• A strong understanding of data privacy and security concerns
• Experience in implementing machine learning models will be a plus
• Ability to conduct performance tuning and troubleshooting of data systems
• Continuous learning and staying updated with the latest technologies and tools in the industry

python,sql,data modeling,etl,big data,data warehousing,data visualization