Platform Software Engineering Architect
Pleasanton, CA - USA
Department:
Job Summary
We are seeking a visionary deeply technical and hands-on Principal Data Lakehouse Architect to spearhead the migration and evolution of our enterprise data this role you will lead the architectural design and execution of shifting our massive petabyte-scale monolithic enterprise data warehouse into a modern open and decoupled data lakehouse architecture.
This is not a purely advisory roleyou will balance high-level strategic architecture with active hands-on engineering layout design and performance tuning. You will be responsible for building a highly scalable cloud-native platform capable of processing hundreds of millions of daily streaming ingestion rows (including high-volume metered usage data) while implementing robust resource guardrails for multi-tenant enterprise workloads.
Responsibilities
Core Responsibilities
- Architecture & Migration Strategy: Lead the end-to-end architectural design and migration path from legacy monolithic relational data warehouses (e.g. Oracle Exadata) to an open data lakehouse model on cloud infrastructure.
- Storage & Table Format Engineering: Design optimize and maintain open table formats using Apache Iceberg over cloud object storage (such as OCI Object Storage). Manage advanced Iceberg features including hidden partitioning partition evolution schema evolution (via unique field IDs) snapshot management and compaction strategies.
- Metadata & Catalog Management: Establish secure enterprise-grade metadata management and access control systems utilizing centralized catalogs and metastores like OCI Data Catalog or Apache Polaris.
- Distributed Compute & Query Engines: Architect and fine-tune distributed compute frameworksspecifically Apache Spark for heavy ETL/ELT pipelines and Trino for high-concurrency low-latency analytical query execution.
- Hybrid Application Development: Build and review core infrastructure tools using a highly performant combination of Java (for infrastructure robustness and concurrency) and Python/PL/SQL (for data processing pipelines and semantic integrations).
- Workload Isolation & Multi-Tenancy: Implement hard resource guardrails and compute clusters isolated by line-of-business (LOB) to ensure intense quarter-end financial workloads and concurrent analytics processing do not suffer from resource contention.
- Semantic Layer & Analytics Integration: Collaborate with functional architects to design scalable data structures business ontologies and trusted centralized datasets that interface seamlessly with enterprise reporting layers like Oracle Analytics Cloud (OAC) and next-generation conversational AI agents.
Required Technical Skills & Qualifications
- Experience: Minimum 810 years of experience in data architecture enterprise data warehousing and large-scale distributed systems with a proven track record of delivering production-grade data lakehouses.
- Hands-on Expertise: Deep production-tested experience with Apache Iceberg including internal metadata hierarchy navigation (manifest lists manifest files metadata JSON evolution).
- Distributed Engines: Advanced operational engineering knowledge of Apache Spark and Trino/Presto including query optimization memory management and cost-based optimizers.
- Languages: Strong programming fluency in Java Python and advanced SQL/PL/SQL. Comfort navigating low-level performance considerations (e.g. concurrency JVM tuning and optimizing file storage formats like Apache Parquet).
- Data Scale: Experience managing and processing massive datasets exceeding 1 Petabyte in size with daily ingestion pipelines handling 100M rows.
- Education: Bachelors or Masters degree in Computer Science Software Engineering or a related technical field.
Preferred Qualifications
- Strong understanding of building semantic layers entity-resolution pipelines or business ontologies supporting NLP and conversational analytical interfaces.
- Experience deploying and scaling data architecture within Oracle Cloud Infrastructure (OCI) or related enterprise cloud environments.
- Background in refactoring complex financial analytics multi-tenant resource scheduling and managing intense data workloads during tight corporate close cycles.
Qualifications
Disclaimer:
Certain U.S. based or U.S. customer or client-facing roles may be required to comply with applicable requirements such as immunization/occupational health mandates and/or drug testing requirements.
Range and benefit information provided in this posting are specific to the stated locations only
US: Hiring Range in USD from: $163500 to $355400 per annum. May be eligible for bonus equity and compensation deferral.
Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge skills experience market conditions and locations as well as reflect Oracles differing products industries and lines of business.
Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.
Oracle US offers a comprehensive benefits package which includes the following:
1. Medical dental and vision insurance including expert medical opinion
2. Short term disability and long term disability
3. Life insurance and AD&D
4. Supplemental life insurance (Employee/Spouse/Child)
5. Health care and dependent care Flexible Spending Accounts
6. Pre-tax commuter and parking benefits
7. 401(k) Savings and Investment Plan with company match
8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
9. 11 paid holidays
10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
11. Paid parental leave
12. Adoption assistance
13. Employee Stock Purchase Plan
14. Financial planning and group legal
15. Voluntary benefits including auto homeowner and pet insurance
The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.
As part of Oracles onboarding process and consistent with applicable law US-based employees are required to complete identity verification which involves the collection and processing of their biometric information. Accommodations to this requirement may be granted following an individualized assessment.
Required Experience:
Staff IC
About Company
As a world leader in cloud solutions, Oracle uses tomorrow’s technology to tackle today’s challenges. We’ve partnered with industry-leaders in almost every sector—and continue to thrive after 40+ years of change by operating with integrity. We know that true innovation starts when eve ... View more