Senior R&D Data Engineer

About the role

Lydian is at the forefront of developing sustainable aviation fuels by transforming waste CO2, water, and renewable electricity into low-emission alternatives. We are on the lookout for a seasoned data engineer to build and oversee our technical data infrastructure as we move from pilot-scale operations to full-scale commercial production. This role is pivotal in ensuring that our data systems are robust, efficient, and capable of supporting our innovative R&D efforts.

Key facts

What you'll do

• Design and oversee the architecture of data storage systems across various platforms, including Nominal and Notion, to ensure that experimental, manufacturing, and quality data is systematically organized and easily accessible.
• Create tailored visualization tools and automated dashboards that enhance the tracking of performance metrics for our engineering and scientific teams.
• Set up and maintain data acquisition software such as DAQ Factory or Ignition, ensuring reliable data streaming from laboratory equipment.
• Conduct statistical and regression analyses to uncover correlations between manufacturing processes and experimental results, enabling data-driven decision-making.
• Work closely with mechanical and process engineers to optimize data workflows and manage the internal server and software infrastructure effectively.
• Collaborate with cross-functional teams to ensure data integrity and consistency across various projects and initiatives.
• Develop and implement data governance policies to maintain high standards of data quality and security.
• Provide training and support to team members on data tools and best practices, fostering a culture of data literacy within the organization.

Requirements

• A Bachelor's or Master's degree in engineering, physical sciences, computer science, or data science is required.
• At least 5 years of hands-on experience in data management within a hardware, laboratory, or physical science R&D environment.
• Strong expertise in SQL and Python, including experience with schema design, query optimization, and proficiency in libraries such as pandas and NumPy.
• Proven experience in processing time-series and sensor data, with skills in managing schema drift and ensuring data alignment.
• Familiarity with at least one data acquisition platform, such as LabVIEW, DAQ Factory, or Ignition, is essential.
• Ability to perform statistical analyses and effectively communicate findings through clear visual reports.
• Experience utilizing AI coding assistants for the development and debugging of data pipelines, with a focus on validating output.

Nice to have

• A background in chemical, materials, or mechanical engineering would be advantageous.
• Knowledge of modern data stack tools, including Airflow, Dagster, dbt, Snowflake, DuckDB, or Iceberg, is a plus.
• Experience with automated testing frameworks, such as Great Expectations, would be beneficial.
• Previous use of tools like JMP, Notion, or Nominal is desirable.
• Basic IT and networking skills would be an asset in this role.

Skills & tools

• Proficient in Python, SQL, and data manipulation libraries such as pandas and NumPy
• Experienced with data acquisition platforms including DAQ Factory, Ignition, and LabVIEW
• Familiar with organizational tools like Nominal and Notion
• Skilled in statistical and regression analysis techniques
• Knowledgeable in data pipeline architecture and management

Practical notes

• Our benefits package includes comprehensive coverage of medical, vision, and dental premiums for employees, with 80% coverage for dependents.
• Employees have access to a 401(k) plan with company matching contributions and flexible paid time off (PTO) policies.
• We are committed to fostering a diverse and inclusive workplace, welcoming applicants from all backgrounds to apply for this exciting opportunity.
• This position is based in Boston, and candidates must be able to work on-site.
• We offer competitive compensation, including equity options, to attract top talent in the field.

About the company

Lydian is developing the lowest cost sustainable fuels from waste CO2, water, and renewable electricity to decarbonize the aviation industry. Our breakthrough technology replaces oil and gas refining with fully electrified, modular, and flexible reactor systems that produce fuel with 95% lower emissions than traditional jet fuel.