A leading finance and tech firm in Africa is hiring a GCPskilled Data Engineer to join its team. This role focuses on for designing developing and maintaining scalable data pipelines and architectures.The company renowned for its innovative lending solutions offers a dynamic and supportive work environment.
Position Overview:
As a Data Engineer you will be responsible for designing building and maintaining the infrastructure and systems that enable efficient data processing storage and retrieval. You will work closely with data scientists analysts and other stakeholders to ensure the availability and reliability of data for analysis and decisionmaking. Your expertise in data architecture ETL processes and database design will be essential in ensuring the integrity and quality of data throughout its lifecycle.
Your daily adventures include:
Data Governance Strategy and Framework:
- Develop and implement a comprehensive data governance strategy aligned with the organisations goals and objectives.
- Define data governance frameworks policies and procedures to ensure the consistent and proper use of data across the organisation.
- Collaborate with stakeholders to establish data governance roles responsibilities and accountability.
- Utilising GCP technologies such as Dataflow Big Query Pub/Sub and Cloud Storage while staying upto date with the latest trends and developments in GCP and data engineering.
Data Architecture Design and Implementation:
- Collaborate with business stakeholders data scientists and engineers to design and implement data architectures supporting data governance requirements.
- Define data standards models and integration patterns to ensure data solutions consistency interoperability and scalability.
- Conducted data architecture assessments and provided recommendations for improvement.
Data Quality and Compliance:
- Develop and implement data quality standards metrics and processes to ensure data accuracy completeness and consistency.
- Monitor data quality and compliance with regulatory requirements industry standards and data governance policies.
- Collaborate with data teams to establish data quality rules data profiling techniques and data cleansing strategies.
Metadata Management:
- Establish and maintain metadata management processes and tools to capture document and track data assets lineage and relationships.
- Define and enforce metadata standards to ensure consistency and usability of metadata across the organisation.
- Collaborate with data stakeholders to enhance metadata capabilities and facilitate data discovery and lineage.
Data Security and Privacy:
- Collaborate with cybersecurity and privacy teams to establish and enforce data security and privacy policies standards and procedures.
- Ensure compliance with data privacy regulations such as GDPR or CCPA and implement appropriate data protection measures.
- Monitor data access sharing and usage to mitigate security risks.
Stakeholder Collaboration and Communication:
- Engage with organisational stakeholders to understand their data needs requirements and challenges.
- Provide guidance and support to stakeholders on data governance principles data management best practices and data architecture standards.
- Communicate data governance strategies initiatives and progress to senior leadership and stakeholders through reports presentations and meetings.
- Collaborate with data scientists and analysts to understand their data requirements and develop solutions to support their needs.
Requirements
What it takes to succeed:
- Bachelors or masters degree in a relevant field (e.g. Computer Science Information Systems Data Management).
- Proven experience in data governance data architecture or a related role with a minimum 5 years of experience
- Proficiency in tools such as GCP (Google Cloud Platform) Data Flow Big Query Pub/Sub and Cloud Storage.
- Strong understanding of data governance frameworks data management principles and data architecture design.
- Knowledge of data privacy regulations data security best practices and compliance requirements.
- Proficiency in data modelling metadata management and data quality management.
- Familiarity with data integration data warehousing and data governance tools.
- Excellent communication collaboration and stakeholder management skills.
- Strong analytical and problemsolving abilities.
- Ability to work effectively in a fastpaced environment and manage multiple priorities.