A Taleo Client located in downtown Houston is initiating new initiatives within their Enterprise Data Engineering team and are looking to add an experienced Azure Data Engineer. This is a contract to hire position and will be required to work in office 3 days a week.
Position Summary:
Reporting to the Data Engineering Manager, the Sr Data Engineer will be a software engineer role responsible for leading the technical direction of a delivery team. This individual will ensure alignment of technical deliverables with both business requirements and enterprise architecture principles, functioning as a domain single point of contact for technical coordination across Strategy, Architecture, IS Operations, Infrastructure, and third-party providers (AMS/Outsource Service providers).Providing strong technical direction involves establishing a technical vision and standards, resolving technical disagreements, and managing the technical quality of team deliverables.
Effective technical engineer ensures the team uses appropriate software development practices, driving continual improvements to tooling or technical debt and ensuring that systems evolve to meet changing business needs. The Snr. Data Engineer understands broader business and team goals and establishes appropriate technical vision and practices, working with the delivery team and counterparts accordingly.
This role emphasizes an entrepreneurial spirit, creative and critical thinking.
Core Focus Areas:
Development – The Sr Data Engineer will work closely with data architects and stakeholders to design and develop scalable and efficient data solutions on the Azure platform. This includes data ingestion, transformation, storage, and visualization. They should be able to help their team with any technical challenges they have, even when they are not necessarily the resident expert.
Job Responsibilities:
· Data Integration and ETL: Develop and maintain Extract, Transform, Load (ETL) processes using Spark, Python, Scala, Databricks, Azure Data Factory and other relevant tools to integrate data from various sources.
· Azure Service Implementation: Implement and configure Azure services such as Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, and Azure Cosmos DB to build and manage data pipelines and data processing workflows.
· Data Modeling and Optimization: Design and implement data models to optimize data storage, querying, and retrieval. Utilize best practices for data modeling and indexing to ensure optimal performance and scalability.
· Data Security and Compliance: Oversee the implementation of data security measures and ensure compliance with data privacy regulations and industry standards. This includes implementing encryption, access controls, and monitoring mechanisms to protect sensitive data.
· Performance Tuning and Monitoring: Monitor and optimize the performance of data solutions by identifying and addressing bottlenecks, fine-tuning queries, and ensuring efficient resource utilization.
· Troubleshooting and Support: Provide support in troubleshooting data-related issues, identifying root causes, and implementing solutions to maintain data integrity and availability.
· Provide architectural and design direction to development and AMS teams in alignment with principles defined by Architecture team.
· Support identifying and resolving critical support issues or technical challenges.
· Establish software development standards and processes for code reviews. Oversee code standards and technical execution for all development staff including AMS team members.
· Responsible for high level and detailed technical design and explores solution alternatives in collaboration with technical standards defined by architecture group.
· Translate business requirements to design specifications.
· Participate in designing solutions to effectively and efficiently fulfill functional and non-functional requirements.
· Ensures quality integration between various systems.
· Design and implement standards, best practices, and accountable for technical delivery of data solutions.
· Promote collaboration and engagement.
· Own the technical design and have domain decision rights in alignment with Enterprise Architecture.
· Acts as technical escalations point of contact in respective Delivery Team for technical coordination across IS Operations, Infrastructure, and integrations teams.
Position Requirements:
· Bachelor’s degree in Math, Computer Science, Engineering, Business Administration, or relevant practical experience preferred.
· Proven technology experience in a complex enterprise environment
· Strong communication skills, both written and spoken
· Proficiency in Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure SQL Database
· Experience in data modeling, data warehousing, and data lake design and implementation.
· Experience with programming languages such as SQL, Python, or Scala for data manipulation and scripting.
· Knowledge of data integration techniques, ETL processes, and data pipeline orchestration.
· Knowledge of software engineering best practices such as code reviews, testing frameworks, maintainability and readability would be an asset.
· Knowledge of AI and ML is a plus.
· Experience with agile delivery frameworks
