Job Title: Cloud Engineer
Location: Remote
Job Type: Contract
Overview
Bright Tier Solutions is seeking a highly skilled Cloud Engineer with a strong background in cloud platforms like AWS Azure and GCP. The ideal candidate will be proficient in designing implementing and maintaining scalable ETL pipelines and data lakes using a variety of cloudnative tools. This role demands expertise in data platforms like Redshift Snowflake Databricks and Synapse with a focus on optimizing data ingestion and transformation processes. Familiarity with data extraction from SAP or ERP systems is a plus.
Key Responsibilities:
Design and Development:
Design develop and maintain scalable ETL pipelines using cloudnative tools such as AWS DMS AWS Glue Kafka Azure Data Factory and GCP Dataflow.
Architect and implement data lakes and data warehouses on platforms such as AWS Azure and GCP.
Develop and optimize data ingestion transformation and loading processes using platforms like Databricks Snowflake Redshift BigQuery and Azure Synapse.
Implement ETL processes with tools like Informatica SAP Data Intelligence and others.
Data Integration and Management:
Integrate various data sources including relational databases APIs unstructured data and ERP systems into the data lake.
Ensure data quality and integrity through rigorous testing and validation.
Perform data extraction from SAP or ERP systems when necessary.
Performance Optimization:
Monitor and optimize the performance of data pipelines and ETL processes.
Implement best practices for data governance security and compliance.
Collaboration:
Collaborate with data scientists analysts and crossfunctional teams to understand data requirements and design data solutions.
Partner with stakeholders to deliver highquality efficient cloud data solutions aligned with business needs.
Documentation and Maintenance:
Document all technical solutions processes and workflows.
Maintain troubleshoot and optimize existing ETL pipelines and data integrations.
Required Qualifications:
Education: Bachelors degree in Computer Science Information Technology or a related field (Advanced degrees are a plus).
Experience:
7 years of experience in a Data Engineer or Cloud Engineer role.
Extensive experience with cloud platforms like AWS Azure and GCP.
Handson experience with cloudnative ETL tools such as AWS DMS AWS Glue Kafka Azure Data Factory GCP Dataflow etc.
Proficiency in data platforms like Redshift Snowflake Databricks BigQuery and Azure Synapse.
Experience with SAP or ERP systems data extraction is a plus.
Strong experience with Spark and Scala for data processing.
Key Skills:
Strong programming skills in Python Java or Scala.
Proficient in SQL and query optimization techniques.
Familiarity with data modeling ETL/ELT processes and data warehousing concepts.
Knowledge of data governance security and compliance best practices.
Excellent problemsolving analytical and communication skills.
Preferred Qualifications:
Experience with additional data tools and technologies such as Apache Spark or Hadoop.
Certifications in cloud platforms (e.g. AWS Certified Data Analytics Specialty Google Professional Data Engineer Microsoft Certified: Azure Data Engineer Associate).
Experience with CI/CD pipelines and DevOps practices for data engineering.
gcp,platforms,data modeling,compliance,sql,data warehousing,erp systems,security,data,aws dms,cloud,redshift,snowflake,devops,databricks,hadoop,kafka,ci/cd pipelines,java,data lakes,pipelines,apache spark,azure,gcp dataflow,azure data factory,scala,python,data governance,sap,aws,etl,synapse,etl/elt processes,aws glue,informatica,sap data intelligence
Cloud Data Engineer
