Sr. Staff Software Engineer
Job description
About the role
This role centers on the architecture and execution of ManagedTables intelligence features. You will own the full lifecycle of systems that transform complex data workloads into reliable, high-speed outcomes. Partnership with product teams is central, as you translate ambitious concepts into production services that serve thousands of concurrent users. Your daily work directly influences how customers optimize exabytes and reduce costs through autonomous optimization.
The ManagedTables team is responsible for the DataIntelligence initiatives that underpin the Unity Catalog ManagedTables offering. This encompasses products such as Predictive Optimization, Liquid Clustering, and control plane services facilitating Unity Catalog and Iceberg Rest Catalog API-based access to ManagedTables. The team is accountable for optimizing exabytes of data and saving millions of dollars annually for our customers through the Data Intelligence offerings. You will be a key contributor within this team, shaping next generation autonomous analytical datasystems designed to ensure the best performance out-of-the-box.
You will design and implement systems that leapfrog state-of-the-art performance and reliability. This involves storage lifecycle management and additional background optimizations for a knob-free experience delivered via Predictive Optimization. You will also focus on efficient storage structures and innovations to power storage layout solutions tailored for the ML world. also, you will influence the Data format and Catalog interface unification efforts to enable strong ecosystem interoperability for ManagedTables.
Your impact will be visible in solving real business needs at large scale by applying deep software engineering experience and driving strong collaboration with Product partners. You will deliver a highly scalable, available, and inter-operable architecture for Managed Tables. The role requires low level systems debugging, performance measurement, and optimization on large production clusters. You will be expected to build architecture design, influence product roadmap, and take ownership and responsibility over new projects. Introducing tools to allow greater automation and operability of services is a core duty. You will use your deep experience to help prevent and investigate production issues. Planning and leading complicated technical projects that work with several teams within the company is also part of this position. You will mentor and up-level engineers on the team, elevating engineering practices across the group.
This position requires fifteen plus years of industry experience building and supporting large-scale distributed systems in production. A passion for database systems, storage systems, distributed systems, language design, or performance optimization is essential. You must demonstrate experience working towards a multi-year vision with incremental deliverables. Motivation by delivering customer value and impact is a core requirement. A strong foundation in algorithms and data structures and their real-world use cases is mandatory. You must hold a BS, MS, or PhD in Computer Science or a related field, or possess equivalent experience.
The role operates from Mountain View, California. Engagement is onsite at Databricks. Compensation is provided as base salary within the specified range. Additional details regarding pay range transparency are available Nice to have experience includes Iceberg, Unity Catalog, and data intelligence platforms that span storage and compute layers. Core skills and tools relevant to the role include Predictive Optimization, Liquid Clustering, managed tables, and related data platform components.
Practical notes confirm that candidates review the official apply page for the most current requirements and application procedures. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on these factors, Databricks anticipates utilizing the full width of the range. For more information regarding which range applies to your location, visit the provided documentation page.