Description
We’re looking for an experienced Data Engineer to join our growing team focused on building, supporting and enhancing the Oracle Hardware Division’s (OHD) big data and analytics platform. This platform is at the heart of driving hardware quality, reliability, and efficiency as well as providing operational insights for impact and root cause analysis. We’re strongly focused on supporting the high scale use cases of Oracle Cloud Infrastructure (OCI). We provide self service tools to enable data discovery, data processing, data mining and research, reporting, and machine learning/AI, all built using OCI services and industry standard open source distributed computing tools.
The Data Engineer will get to work with data at scale. This includes ingesting and processing large data volumes of hardware telemetry from every machine in our Cloud data centers, both in batch and near-real time. This enables us to provide measurement & alerting on key hardware quality KPI trends, as well as using machine learning to predict hardware failures before they happen and improve the OCI service offerings and customer experience. We are looking for engineers who are creative, passionate about data and its application in building solutions, and are excited to work at scale to solve customer problems.
A day in the life…
- Support the development and evolution of our Data Platform.
- Understand, leverage and apply engineering best practices effectively. Lead by example and improve our coding standards and best practices.
- Build robust, highly available, performant, scalable and reliable data services.
- Collaborate with cross-functional teams, engineers, and program/product management on building optimized and forward looking data tools, insights and reporting mechanisms that drive the business forward.
- Deliver quality features on-time and on-budget.
- Anticipate system/application challenges and propose solutions.
- Contribute innovative & new ideas to the product/program Roadmap.
- Mentor junior resources and drive end to end design, implementation and delivery of engineering components.
- Work with team members to manage the day-to-day development activities, participate in designs, design reviews, code reviews and implementation.
- Adjust positively to quickly changing priorities and shifting goals.
- Strive for continuous improvement of code quality and development practices.
Required Qualifications
- 5-7 years of professional experience in practice area.
- Excellent leadership, verbal and written communication skills.
- Proven high level of expertise in any or all of the programming languages Python, Java, Scala, SQL and related technology stacks.
- Deep proficiency in engineering best practices for the full software development lifecycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Proven ability to take a project from scoping requirements through actual launch of the project.
- Experience with cloud computing fundamentals and building applications using cloud managed services.
- Willingness to adapt to and self learn new technologies and deliver on them.
- Technical depth and vision to perform POC’s and evaluate different technologies.
Additional Qualifications (not required, but each is a plus)
- Experience with big data technologies (Hadoop, Hive, Presto, Pig, Spark, etc.)
- Knowledge & experience in data streaming technologies such as Apache Kafka.
- Knowledge & experience of containerization technologies such as Docker/Kubernetes.
- Prior experience building self service data platforms.
- Prior experience building/working with ML platforms/frameworks.
- Proven proficiency in API development (REST).
Design, develop, troubleshoot and debug software programs for databases, applications, tools, networks etc.
As a member of the software engineering division, you will take an active role in the definition and evolution of standard practices and procedures. You will be responsible for defining and developing software for tasks associated with the developing, designing and debugging of software applications or operating systems.
Work is non-routine and very complex, involving the application of advanced technical/business skills in area of specialization. Leading contributor individually and as a team member, providing direction and mentoring to others. BS or MS degree or equivalent experience relevant to functional area. 7 years of software engineering or related experience.