JD :
Client looking for Senior/ Lead DBT Developer.
Good AWS experience.
Should have some DBT Admin experience.
Senior DBT developer:
Technical Skills:
DBT Proficiency:
o model development:
Experience in creating complex DBT models including incremental models snapshots and documentation
Ability to write and maintain DBT macros for reusable code
o Testing and documentation:
Proficiency in implementing DBT tests for data validation and quality checks
Familiarity with generating and maintaining documentation using DBTs built in features
o Version control:
Experience in managing DBT projects using git including implementing CI/CD process from the scratch
AWS Expertise:
o Data STORAGE solutions:
In depth understanding of AWS S3 for data storage including best practices for organization and security
Experience with AWS redshift for data warehousing and performance optimization
o Data Integration:
Familiarity with Aws glue for ETL processes and orchestration Nice to have
Experience with AWS lambda for serverless data processing tasks
o Workflow Orchestration:
Proficiency in using Apache Airflow on AWS to design schedule and monitor complex data flows
Ability to integrate Airflow with AWS services and DBT models such as triggering a DBT model or EMR or reading from s3 writing to redshift
o Data Lakes and Data warehousing:
Understanding the architecture of data lakes vs data warehouses and when to use each
Experience with amazon Athena for querying data directly in s3 using SQL
o Monitoring and Logging:
Familiarity with AWS cloud watch for monitoring the pipelines and setting up alerts for workflow failures
o Cloud Security:
Knowledge of AWS security best practices including IAM roles encryption DBT profiles access configurations
Programming Skills:
Python:
o Proficiency in Pandas and NumPy for data analysis and manipulation
o Ability to write scripts for automating ETL processes and scheduling jobs using airflow
o Experience in creating custom DBT macros using jinja and Python allowing for reusable components within dbt models
o Knowledge on how to implement conditional logic in DBT through python
SQL:
o Advanced SQL skills including complex joins window functions CTE s and subqueries
o Experience in optimizing SQL queries for performance and optimization
aws s3,aws lambda,dbt,python,amazon athena,aws glue,data analysis,pandas,sql azure,aws redshift,sql,apache airflow,numpy
DBT Developer
