King & Spalding is a leading global law firm with a commitment to excellence, innovation, and the seamless delivery of legal services. We harness innovative technology and exceptional talent to meet the complex needs of our clients in a fast-paced and dynamic legal landscape.
We are seeking a highly skilled and experienced Senior Microsoft Azure Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and managing data solutions on the Microsoft Azure platform. Your expertise will be crucial in building robust data pipelines, optimizing data storage, and ensuring data availability and integrity.
KEY RESPONSIBILITIES:
Design and develop scalable data solutions using Azure Data Services, including Azure Data Factory, Azure SQL Database, and Azure Data Lake Storage.
Implement data integration and ETL processes to ingest, transform, and store data from various sources.
Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver effective data solutions.
Optimize data storage and retrieval, ensuring high performance and cost-efficiency.
Monitor and maintain data pipelines, addressing any issues or bottlenecks promptly.
Ensure data security and compliance with industry standards and best practices.
Provide technical guidance and mentorship to junior data engineers.
Stay updated with the latest advancements in Azure data technologies and recommend improvements to existing systems.
Create data transformation pipeline using Azur
Perform source data profiling and analysis
Design, develop and test data mapping from source to target with transformation rules.
Assist in defining and enforcing processes and procedures to ensure the quality and reliability of data ingestion pipeline, transformation rules, audit logging requirements
Create and maintain documentation for data integration and ETL solutions
Develop code and build data integration solutions on Azure cloud within Application Architecture guidelines.
Develop integration solutions by leveraging appropriate technology to implement business requirements as technical solution
Design and Develop complex data modeling, data tagging, transformations, automated data quality validation routines.
Design and Develop Data Ingestions, ETL strategy, ETL flow implementations
Present solutions and represent development team in code reviews
Represent development team in broader technical reviews and agile ceremonies around requirements grooming, planning, design, code, test cases, or other project artifacts
Oversee and enforce documentation of all code changes (including inline comments) with leading agile practices
Collaborate with Application/ Integration Architect in the design and development of proof of concept and prototype application environments
Develop and maintain code repositories according to established version management approaches and methods as defined
Develop and refresh code construction fundamentals for coding practices, guideline for use of data, control-related concepts, and error-detection practices
Collaborate with IT Project Management team to identify and evaluate risks; participate in mitigation and control activities
Provide on-call support in support of systems and applications in production including incident and problem management, code corrections, upgrades and patches
Support the development of metrics to measure and demonstrate Health Data Exchange value
Support business stakeholders before and during project delivery (e.g. t-shirt sizing, scoping, requirements gathering, testing)
QUALIFICATIONS:
Bachelor's or master's degree in computer science, Information Technology, or a related field.
At least 8 years of proven experience as a Data Engineer, with a focus on Microsoft Azure.
Strong proficiency in Azure Data Services, including Azure Data Factory, Azure SQL Database, and Azure Data Lake Storage.
Experience with data integration, ETL processes, and data warehousing.
Proficient in programming languages such as SQL, Python, and PowerShell.
Knowledge of data modeling, data governance, and data security best practices.
Excellent problem-solving skills and the ability to work independently and as part of a team.
Hands-on experience designing, building, and supporting high-performing, high-throughput data ingestion pipelines and data consumption endpoints
Proven experience with building data pipelines in Azure
Familiarity with clinical data standards like Hl7
Strong execution experience on developing with and leveraging:
Typical Integration Connectors (APIs, File, SFTP/FTPS, Streaming Data, DB Connectors, SOAP, REST)
Databases - Relational, Object Oriented, and Graph databases
File Formats - XML, JSON, CSV, Fixed Length Flat, Unstructured Content, EDI, HL7
Demonstrated knowledge of securing communications between endpoints.
Demonstrated knowledge of Agile Software Development Life Cycle (SDLC) methodologies and tools.
Strong communication and interpersonal skills.
Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Expert) are a plus.
Microsoft SQL Server in Azure.
Excellent problem-solving skills and ability to handle complex technical challenges.
Strong communication and collaboration skills.
Expert integration experience (Mulesoft experience is a plus).
Expert Azure Certifications
The firm offers a generous total compensation package with bonuses and raises awarded in recognition of individual merit-based performance. All full-time Business Services employees may participate in King & Spalding’s comprehensive benefit program including health and wellness plan, life and disability insurance, flexible spending accounts and a health savings account, a 401(k) plan, profit sharing plan, and a substantial Paid Time Off (PTO) program.
King & Spalding LLP (K&S) is committed to providing equal employment opportunity to all applicants and employees in full compliance with all state, federal, and local laws prohibiting discrimination on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, genetic information, age, disability or any other status protected by applicable law.
We are proud of our remarkably cohesive culture, which now encompasses more than 2,500 lawyers and business professionals worldwide. We seek to attract and develop the very best talent to work with us.
