Software Engineer II (Python)

About the role

Kpler helps clients understand complex global markets by simplifying trade information and providing key insights. This role contributes to the Commodities Tribe, specifically enhancing the Supply & Demand platform. You will help expand the platform beyond crude oil to support a wider range of commodities like refined products and metals.

Key facts

What you'll do

• Manage a commodity balance from initial blending rules through computation, validation, and production release on Airflow, including on-call support.
• Resolve critical bugs and incidents in pipelines, databases, and distribution APIs, creating runbooks and prevention strategies.
• Improve the anomaly detection and data quality system (Prophet-based) to catch bad data before publication, reducing false positives.
• Generalize the Supply & Demand data model and ETL framework to allow easy addition of new commodities.
• Design and deliver project milestones, writing and reviewing Architectural Decision Records (ADRs) and participating in design reviews.
• Build and evolve data distribution APIs (Oil and Grains TypeScript services) for web applications and external clients.
• Onboard and mentor junior engineers (P1, P2), providing pairing, reviews, and fostering independence.
• Collaborate with Research, Product, and Data teams to transform data needs into well-defined engineering tasks.
• Identify and address gaps in observability and monitoring for DAGs and services, managing escalations.
• Participate in hiring interviews.

Requirements

• 2+ years of experience as a software engineer, delivering production systems.
• Experience owning a significant feature or service end-to-end in production (design, ship, monitor, fix).
• Strong Python skills for data-intensive work (e.g., pandas/polars, SQLAlchemy or similar ORM, relational databases with schema evolution).
• Comfortable debugging and operating production data pipelines, with experience in on-call or first-responder duties.
• Proven ability to take an undefined problem and shape it into a delivered solution independently.

Nice to have

• Experience with workflow orchestration (Airflow/Astronomer or similar) and batch/ETL data pipelines.
• TypeScript/Node API experience (NestJS, Express, tsoa, TypeORM) for distribution APIs.
• Exposure to commodities, energy, or domains with complex, multi-provider data requiring reconciliation.
• Experience mentoring junior engineers or onboarding new team members.
• Familiarity with anomaly detection/forecasting (Prophet, scikit-learn) or data quality tools.

Skills & tools

• Python
• pandas/polars
• SQLAlchemy
• Relational databases
• Airflow
• TypeScript
• Node.js
• Prophet
• scikit-learn

Practical notes

Kpler is committed to a fair, inclusive, and diverse work environment. They welcome people of different backgrounds, experiences, abilities, and perspectives.