Data Platform Engineer
Job description
About the role
As a , you will play a crucial role in assisting clients to deploy and manage sophisticated data workflows that drive their business success. You will work closely with customer teams, providing technical guidance and solutions to help them leverage Astronomer's platform effectively. This position offers an exciting opportunity to work with cutting-edge data orchestration technology, influence product development through client feedback, and grow your expertise in workflow automation and Apache Airflow. The role is ideal for someone passionate about data engineering, eager to solve real-world data challenges, and interested in contributing to a leading DataOps platform used by major enterprises.
Key facts
Location: USA
Engagement: Full-time
The estimated total compensation for this role ranges from $200,000 to $250,000, including an equity component. This compensation range is an estimate and may vary depending on the candidate's skills, experience, and qualifications. The role is on-site in San Francisco, emphasizing the importance of working at the company's physical office location. Astronomer values diversity and is committed to providing an inclusive work environment.
What you'll do
- Design, develop, and implement proof-of-concept solutions that address specific data challenges faced by clients, guiding them from initial idea to production deployment.
- Conduct product demonstrations and technical presentations to engineering teams, showcasing how Astronomer's platform can optimize and automate their data workflows.
- Serve as a trusted advisor by providing expert guidance on best practices for workflow orchestration, data pipeline management, and platform integration.
- Contribute to the Apache Airflow community by creating technical content, sharing best practices, and participating in community discussions to position Astronomer as a thought leader in workflow orchestration.
- Gather insights from client interactions and field experiences, providing valuable feedback to the product team to influence future platform features and improvements.
- Develop and deepen your expertise in Airflow, data engineering, and workflow automation, collaborating across departments on impactful projects.
- Support clients in deploying, configuring, and maintaining data workflows using Astronomer's platform, ensuring reliable and scalable operations.
- Assist in integrating various data tools and platforms such as Snowflake, Databricks, Fivetran, and Tableau to create seamless data pipelines.
- Stay informed about industry trends, emerging technologies, and best practices in data engineering, orchestration, and analytics.
- Build strong relationships with clients through ongoing technical support, troubleshooting, and consultative engagement to ensure their success.
- Contribute to the creation of technical documentation, tutorials, and community content to help users maximize the platform's capabilities.
- Collaborate with internal teams to improve platform features based on customer feedback and field insights.
- Participate in training sessions, webinars, and workshops to promote platform adoption and knowledge sharing.
- Assist in troubleshooting complex technical issues, providing timely solutions to ensure client satisfaction.
- Support sales and customer success teams by providing technical expertise during client onboarding and product demonstrations.
- Help develop new use cases and solutions that showcase the platform's flexibility and power in various data environments.
- Engage with open-source communities and industry forums to stay connected with the broader data engineering ecosystem.
Requirements
- Hands-on experience with data engineering concepts, including orchestration, ELT, Git, and Role-Based Access Control (RBAC).
- Practical experience working with Apache Airflow in a customer-facing or production environment.
- At least 2 years of experience in a Sales Engineering, Solutions Engineering, Consulting, or similar technical role within the data space.
- Familiarity with modern data tools such as Snowflake, Databricks, Fivetran, or Tableau.
- Strong verbal and written communication skills, capable of explaining complex technical concepts to diverse audiences.
- Demonstrated curiosity and a customer-centric mindset, with the ability to empathize and support client needs effectively.
- Ability to learn new technologies quickly and adapt to evolving technical landscapes.
- Experience working with command line interfaces (CLI) is a plus.
- Knowledge of open-source data tools and workflows is advantageous.
- Prior experience designing, deploying, and managing data workflows in production environments.
- Customer-facing experience in a technical or consultative role is highly desirable.
- Ability to work collaboratively across teams and communicate effectively with both technical and non-technical stakeholders.
- Strong problem-solving skills and the ability to troubleshoot complex issues efficiently.
- A proactive attitude and eagerness to stay current with industry trends and innovations.
Nice to have
- Python scripting skills for developing and supporting data pipelines.
- Experience with open-source data tools beyond Airflow, such as Kafka, Spark, or Dask.
- Background in designing scalable, reliable data workflows in production settings.
- Prior experience working directly with clients in a technical support or consulting capacity.
- Familiarity with command line interfaces (CLI) for managing data workflows and platform configurations.
- Knowledge of additional data visualization or analytics tools beyond Tableau.
Skills & tools
- Python
- Apache Airflow
- Snowflake
- Data Engineering
- Git
- Fivetran
- Tableau
- ELT processes
- Workflow orchestration
Practical notes
This position is based on-site in San Francisco and involves full-time engagement. The compensation package includes salary and equity, with a focus on candidates who have a strong background in data engineering, workflow automation, and client support. The company values diversity and is committed to equal opportunity employment, welcoming applicants from various backgrounds. Candidates should be prepared to work in a collaborative environment, engaging directly with clients and internal teams to deliver impactful data solutions. The role offers opportunities for professional growth, technical development, and active participation in the broader data engineering community.
About the company
Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications.