This is a remote position.
We are seeking a Senior Data Engineer (Scala) to join our team.
Responsibilities:
Manage and optimize the healthcare clinical data pipeline.
Collaborate with data scientists data integration specialists analysts and other stakeholders to understand data requirements and design efficient data pipelines.
Develop maintain and optimize data pipelines for collecting processing and storing healthcare clinical data.
Implement data validation cleansing and transformation processes to ensure data accuracy and consistency.
Monitor and troubleshoot data pipeline performance addressing any issues or bottlenecks proactively.
Ensure data security and compliance with industry regulations including HIPAA.
Work closely with the DevOps team to deploy and manage data pipeline infrastructure in our Azure cloud environment.
Stay updated on industry trends emerging technologies and advancements in healthcare data management.
Requirements
A minimum of 6 years handson experience in data engineering with an emphasis on healthcare clinical data.
Proficient use of Databricks for building and optimizing data pipelines.
Skilled in programming languages such as Python Scala or Java for data processing.
Exposure to big data technologies such as Apache Spark Hadoop or Kafka.
Familiarity with cloudbased data platforms (e.g. AWS Azure Google Cloud) and related services.
Strong SQL skills for data manipulation querying and performance optimization.
Strong understanding of data modeling and ETL design principles.
Aptitude for troubleshooting intricate datarelated challenges and devising solutions.
Strong communication skills to collaborate with crossfunctional teams and present technical concepts effectively.
Relevant certifications in data engineering cloud platforms such as Databricks or healthcare data management.
Understanding of machine learning concepts and their application to healthcare data.
Sound familiarity with healthcare data standards and exposure to clinical data systems.
Effective communication skills with the ability to convey technical concepts to nontechnical stakeholders.
Meticulous attention to detail crucial for maintaining data quality and accuracy in healthcare contexts.
Strong problemsolving capabilities essential for navigating complex healthcare data scenarios.
Collaborative mindset adept at working with diverse stakeholders and contributing to crossfunctional projects.
Eagerness for continuous learning to stay current in the evolving realms of data engineering and healthcare.
Leadership and mentorship acumen enabling guidance of junior team members and effective project leadership.
Innovative outlook open to exploring novel strategies for leveraging data to foster innovation.
Adaptability embracing change and remaining receptive to new tools and techniques.
Benefits
- Work Location: Remote
- 5 days working
A minimum of 6 years hands-on experience in data engineering, with an emphasis on healthcare clinical data. Proficient use of Databricks for building and optimizing data pipelines. Skilled in programming languages such as Python, Scala, or Java for data processing. Exposure to big data technologies such as Apache Spark, Hadoop, or Kafka. Familiarity with cloud-based data platforms (e.g., AWS, Azure, Google Cloud) and related services. Strong SQL skills for data manipulation, querying, and performance optimization. Strong understanding of data modeling and ETL design principles. Aptitude for troubleshooting intricate data-related challenges and devising solutions. Strong communication skills to collaborate with cross-functional teams and present technical concepts effectively. Relevant certifications in data engineering, cloud platforms such as Databricks, or healthcare data management. Understanding of machine learning concepts and their application to healthcare data. Sound familiarity with healthcare data standards and exposure to clinical data systems. Effective communication skills, with the ability to convey technical concepts to non-technical stakeholders. Meticulous attention to detail, crucial for maintaining data quality and accuracy in healthcare contexts. Strong problem-solving capabilities, essential for navigating complex healthcare data scenarios. Collaborative mindset, adept at working with diverse stakeholders and contributing to cross-functional projects. Eagerness for continuous learning to stay current in the evolving realms of data engineering and healthcare. Leadership and mentorship acumen, enabling guidance of junior team members and effective project leadership. Innovative outlook, open to exploring novel strategies for leveraging data to foster innovation. Adaptability, embracing change and remaining receptive to new tools and techniques.