Lead Data Engineer DBT
Lead Data Engineer DBT
Posted on :
20-12-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
We are seeking a talented and enthusiastic Lead Data Engineers with 5 years of experience to join our data engineering team. The ideal candidate will have a strong background in ETL processes data warehousing and big data technologies and will play a key role in building and maintaining our data infrastructure to support analytics and business intelligence needs.
Designation Lead Data Engineer
Work Location Hyderabad
Experience 6 10 years
Key Responsibilities:
- ETL Development:
- Design develop and maintain efficient ETL pipelines to process and transform large volumes of data from various sources.
- Implement data transformation and cleansing processes to ensure highquality data.
- Data Warehouse Development:
- Assist in building and optimizing scalable data warehouse solutions using Snowflake Data bricks Redshift or similar technologies.
- Ensure that data models are efficient scalable and support the needs of analytics teams.
- Big Data & Cloud Technologies:
- Utilize AWS Glue and PySpark for processing and transforming large datasets in the cloud.
- Implement data pipelines using Apache Airflow for scheduling and orchestration.
- Database Management:
- Manage and optimize relational databases (RDBMS) to support both transactional and analytical workloads.
- Write efficient SQL queries to support data extraction reporting and analytics.
- Collaboration:
- Work closely with your lead and other stakeholders to understand data requirements and deliver reliable data solutions.
- Contribute to the design and architecture of data systems ensuring alignment with business needs and technical best practices.
- Data Quality & Governance:
- Ensure data integrity accuracy and availability through rigorous testing validation and monitoring of ETL processes.
- Support data governance initiatives by implementing best practices for data management and security.
Required Skills & Qualifications:
- Education: Bachelor s degree in Computer Science Information Systems Engineering or a related field.
- Experience:
- 6 years of experience in data engineering with a strong focus on ETL processes and data warehousing.
- Handson experience with ETL tools and frameworks as well as Python and PySpark for data processing.
- Experience with cloudbased data platforms such as AWS Glue Snowflake Databricks or Redshift.
- Proficiency in SQL and experience with RDBMS platforms (e.g. MySQL PostgreSQL Oracle).
- Familiarity with data orchestration tools like Apache Airflow.
- Must have experience in DBT
- Technical Skills:
- Strong understanding of data warehousing concepts and best practices.
- Experience in building and optimizing data pipelines and workflows.
- Knowledge of cloud infrastructure (AWS Azure GCP) and data processing technologies.
snowflake,etl processes,aws,data,glue,big data technologies,pyspark,data bricks,redshift,apache airflow,sql,rdbms,data governance,python,data warehousing,aws glue
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
