Sr Data Engineer - AR
Sr Data Engineer - AR
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
5-9years
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Decision Minds is a leader in Data Cloud Big Data Cloud Analytics AI/ML and MultiCloud deployments. We are a team of passionate thought leaders and industry experts who strive for excellence and clarity in creating innovative solutions and products. Our goal is to revolutionize Data Analytics Artificial Intelligence Cloud Computing and Robotic Process Automation and make a positive impact on peoples lives.
Know more about us at LinkedIn
Years of experience:
Data Engineer: 5 years
Senior Data Engineer: 7 to 9 years
Job Description:
We are seeking a highly skilled and experienced GCP Cloud Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering with a focus on Google Cloud Platform (GCP) services. You will be responsible for designing building and maintaining scalable data pipelines and infrastructure on GCP ensuring data is accessible reliable and available for business use.
Key Responsibilities:
Data Pipeline Development: Design develop and maintain data pipelines using GCP services such as Dataflow Dataproc BigQuery and Cloud Storage.
Data Integration: Work on integrating data from various sources (structured semistructured and unstructured) into GCP environments.
Data Modeling: Develop and maintain efficient data models in BigQuery to support analytics and reporting needs.
Data Warehousing: Implement data warehousing solutions on GCP optimizing performance and scalability.
ETL/ELT Processes: Build and manage ETL/ELT processes using tools like Apache Airflow Data Fusion and Python.
Data Quality & Governance: Implement data quality checks data lineage and data governance best practices to ensure high data integrity.
Automation: Automate data pipelines and workflows to reduce manual effort and improve efficiency.
Collaboration: Work closely with data scientists analysts and other stakeholders to understand data requirements and deliver data solutions that meet business needs.
Optimization: Continuously monitor and optimize the performance of data pipelines and queries for cost and efficiency.
Security: Ensure data security and compliance with industry standards and best practices.
Required Skills & Qualifications:
Education: Bachelor s degree in Computer Science Information Technology Engineering or a related field.
Experience: 5 years of experience in data engineering with at least 2 years working with GCP.
Technical Skills:
o Proficiency in GCP services: BigQuery Dataflow Dataproc Cloud Storage Pub/Sub and Cloud Functions.
o Strong programming skills in Python SQLPyspark and familiarity with Java/Scala.
o Experience with orchestration tools like Apache Airflow.
o Knowledge of ETL/ELT processes and tools.
o Experience with data modeling and designing data warehouses in BigQuery.
o Familiarity with CI/CD pipelines and version control systems like Git.
o Understanding of data governance security and compliance.
Soft Skills:
o Excellent problemsolving and analytical skills.
o Strong communication and collaboration abilities.
o Ability to work in a fastpaced environment and manage multiple priorities.
Preferred Qualifications:
Certifications: GCP Professional Data Engineer or GCP Professional Cloud Architect certification.
Domain Knowledge: Experience in the finance ecommerce healthcare domain is a plus.
GCP, Azure, Python, Pyspark, SQL
Education
Any technical graduation
Employment Type
Full Time
Company Industry
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
