DBT Developer

JD :

• Client looking for Senior/ Lead DBT Developer. 

• Good AWS experience.

• Should have some DBT Admin experience. 

 

 Senior DBT developer:

Technical Skills:

DBT Proficiency: 

o model development: 

 Experience in creating complex DBT models including incremental models, snapshots and documentation

 Ability to write and maintain DBT macros for reusable code

o Testing and documentation: 

 Proficiency in implementing DBT tests for data validation and quality checks

 Familiarity with generating and maintaining documentation using DBT's built in features

o Version control: 

 Experience in managing DBT projects using git ,including implementing CI/CD process from the scratch

• AWS Expertise: 

o Data STORAGE solutions: 

 In depth understanding of AWS S3 for data storage, including best practices for organization and security

 Experience with AWS redshift for data warehousing and performance optimization

o Data Integration: 

 Familiarity with Aws glue for ETL processes and orchestration -Nice to have

 Experience with AWS lambda for serverless data processing tasks

o Workflow Orchestration: 

 Proficiency in using Apache Airflow on AWS to design ,schedule and monitor complex data flows

 Ability to integrate Airflow with AWS services and DBT models such as triggering a DBT model or EMR or reading from s3 writing to redshift

o Data Lakes and Data warehousing: 

 Understanding the architecture of data lakes vs data warehouses and when to use each

 Experience with amazon Athena for querying data directly in s3 using SQL

o Monitoring and Logging: 

 Familiarity with AWS cloud watch for monitoring the pipelines and setting up alerts for workflow failures

o Cloud Security: 

 Knowledge of AWS security best practices ,including IAM roles, encryption, DBT profiles access configurations

Programming Skills:

• Python: 

o Proficiency in Pandas and NumPy for data analysis and manipulation

o Ability to write scripts for automating ETL processes and scheduling jobs using airflow

o Experience in creating custom DBT macros using jinja and Python allowing for reusable components within dbt models

o Knowledge on how to implement conditional logic in DBT through python

• SQL: 

o Advanced SQL skills, including complex joins ,window functions, CTE’s and subqueries

o Experience in optimizing SQL queries for performance and optimization