Position Overview:
Our client has an immediate opening for a Senior Data Engineer. The ideal candidate will be pivotal in designing, developing, and maintaining our data infrastructure. This role emphasizes not on building machine learning models but on integrating and deploying these models into our data pipelines to enhance our capabilities in advanced analytics and machine learning processes. The successful candidate will contribute expertise to improve and scale our data engineering practices, ensuring the seamless incorporation of machine learning models into our operational workflows.
This position is hybrid, with some remote and some in-office days in Kirkland, WA.
Key Responsibilities:
Data Pipeline Development:
- Design, implement, and maintain scalable data pipelines to collect, process, and store data from various sources.
- Ensure data quality, accuracy, and consistency throughout the pipeline.
Data Modeling Integration:
- Design and implement existing data models for predictive analytics, machine learning, and data exploration.
- Optimize data structures and storage to support predictive analytics/machine learning processes.
Data Integration:
- Work closely with cross-functional teams to integrate data from diverse sources, including databases, APIs, and external data providers.
- Develop and maintain ETL processes to transform and enrich raw data into actionable insights.
Performance Tuning:
- Monitor and optimize the performance of data pipelines and databases to meet business requirements.
- Identify and resolve bottlenecks and performance issues.
Continuous Learning and mentoring:
- Stay up-to-date with the latest advancements in data engineering and data science technologies.
- Share knowledge and mentor junior team members.
Requirements
Experience:
- 5+ years experience in SQL Query Design, SQL Performance Tuning and Query Optimization
- 5+ years of relevant experience in Data Warehouse Design, Data Warehouse Technical Architectures, Development and Implementation
- 5+ years of relevant experience in ETL Development, ETL Implementation, Unit Testing, Troubleshooting and Support of ETL Processes
Knowledge and Skills:
- Proficiency in SQL Query Design and Implementation
- Strong Experience with Relational Data Warehouse Systems
- Data Warehouse Management Systems
- Optimization by Indexing, Partitioning and Denormalization
- Strong ability to build and optimize data sets, βbig dataβ data pipelines and architecture
- Programming skills in Python required, C# is a bonus
- Strong analytical and problem-solving skills
- Cloud experience: AWS (experience with GCP, or Azure would be a bonus)
- BONUS FOR:
- Experience with Personally Identifiable Information (PII) data experience
- Experience in the Marketing audience determination space
- Experiences with Apache Spark, Amazon Elastic MapReduce (EMR) and Trino
Benefits:
- Compensation: $140,000-160,000 base pay
- Paid Vacation Time and Paid Holidays
- Medical/Vision/Dental Insurance, Voluntary Life & AD&D Insurance, Short-Term & Long-Term Disability, Critical Illness & Accident Insurance
- 401(k) with employer matching
- Hybrid/remote with flexible work schedule