Senior Staff Data Engineer
Job description
About the role
We are seeking a Senior Staff Data Engineer to join our team at BILL. This position plays a crucial role in enhancing our data architecture and engineering practices. You will collaborate with cross-functional teams to design and implement data solutions that support our financial operations platform. The role requires deep expertise in building reliable data infrastructure that empowers analytics and decision-making. You will own the end-to-end lifecycle of data products from conception to production deployment. This position is instrumental in establishing best practices for data quality and reliability across the organization. You will work closely with data scientists and analysts to ensure that data assets are accessible and trustworthy. Your contributions will directly impact the scalability and performance of our core billing and financial systems.
Key facts
What you'll do
- Architect and construct robust data pipelines that ingest, process, and deliver high-volume financial data efficiently.
- Partner with product managers and stakeholders to define data requirements and translate complex business needs into scalable technical solutions.
- Establish and enforce data governance frameworks, ensuring compliance with security policies and regulatory standards.
- Conduct in-depth performance tuning and optimization of data workflows to reduce latency and improve resource utilization.
- Lead code reviews and technical design sessions to maintain high standards of software engineering practices.
- Develop and maintain comprehensive documentation for data models, pipelines, and operational procedures.
- Implement monitoring and alerting strategies to ensure data pipeline reliability and rapid incident response.
- Collaborate with data science teams to prepare experimental datasets and support advanced analytical initiatives.
- Mentor junior data engineers through code reviews, pair programming, and technical guidance to elevate team capabilities.
- Evaluate emerging data technologies and tools to identify opportunities for innovation and improvement.
Requirements
- A minimum of 8 years of hands-on experience in data engineering roles building and maintaining data platforms.
- Demonstrated proficiency in programming languages such as Python, Java, or Scala for developing production-grade data applications.
- Extensive experience designing and managing data warehousing solutions such as Snowflake or Redshift in cloud environments.
- Strong understanding of ETL processes, batch and streaming data pipelines, and the tools that orchestrate them.
- Familiarity with major cloud platforms such as AWS or Azure, including their core data services and architectural patterns.
- Excellent problem-solving skills with the ability to diagnose complex data issues and implement effective solutions independently.
- Bachelor's degree in Computer Science, Engineering, or a closely related discipline from an accredited institution.
- Proven track record of working in fast-paced environments where data requirements evolve rapidly.
- Experience working with distributed systems and handling large-scale datasets in a reliable manner.
- Commitment to writing clean, maintainable, and well-tested code that adheres to industry best practices.
Nice to have
- Experience with machine learning frameworks and AI technologies to build intelligent data products.
- Knowledge of data visualization tools such as Tableau or Looker to create interactive dashboards.
- Familiarity with containerization technologies such as Docker and orchestration platforms like Kubernetes.
- Understanding of data cataloging and lineage tools to enhance metadata management.
- Experience with real-time streaming technologies such as Kafka or similar platforms.
Practical notes
This position is open to candidates who require visa sponsorship in the United States. We offer competitive salaries and comprehensive benefits packages, including health insurance, retirement plans, and ongoing professional development opportunities. The successful candidate will be expected to work full-time during standard business hours. Interested applicants must submit their resumes by the posted application deadline to be considered for this role. Relocation assistance may be discussed for qualified candidates upon request. This role requires the ability to work collaboratively in a fully remote or hybrid environment as needed by the business.