Data and AI Lead, Finance

About the role

This position sits within the Finance organization, reporting to the Senior Manager of Finance Data and AI. You will act as the primary technical authority for data pipelines and AI systems that support internal accounting and financial operations.

Key facts

What you'll do

• Develop ETL pipelines using Python, PySpark, and Databricks SQL to automate financial processes like revenue, expenses, commissions, and tax.
• Architect complex data pipelines using Databricks Jobs and Lakeflow Declarative Pipelines with integrated reconciliation and validation.
• Create AI use cases for finance, including anomaly detection, forecasting automation, and natural language interfaces.
• Build internal applications using Databricks Apps, Genie Agents, and AI/BI dashboards for non-technical stakeholders.
• Implement Unity Catalog governance, row-level security, and data access policies for financial datasets.
• Establish CI/CD workflows, Git-based version control, and coding standards to meet SOX change management requirements.
• Serve as the technical lead during financial close periods and provide mentorship to junior and mid-level engineers.

Requirements

• 12+ years of professional experience in analytics engineering, data engineering, or finance systems.
• Proven ability to manage production-grade pipelines from end to end.
• Proficiency in Python, SQL, Apache Spark, and the Databricks platform.
• Experience integrating financial source systems such as NetSuite, Salesforce, Stripe, or Zuora into a data lake.
• Understanding of accounting principles including revenue recognition, financial reporting, chart of accounts, and close processes.
• Experience building self-service BI products and executive-level dashboards.

Nice to have

• Background in a high-growth SaaS or cloud infrastructure environment.
• Hands-on experience with LLM-powered applications, Genie, or AI/BI tools.
• Familiarity with Declarative Automation Bundles or CI/CD for data pipelines.
• Formal finance or accounting credentials such as a CPA or CFA.

Skills & tools

• Databricks SQL, Python, PySpark, Databricks Jobs, Lakeflow, Unity Catalog, Git, GitHub Actions, NetSuite, Salesforce, Stripe, Zuora, AI/BI, Genie.

Practical notes

• Databricks may require a U.S. government license for roles involving access to export-controlled technology or source code; the company reserves the right to decline applicants based on this requirement.