Data Engineer II
Job description
Data Engineer II at DriveWealth.
About the role
DriveWealth is transforming global investing by making financial markets accessible to everyone through an API-based platform. We seek a Data Engineer to join our Data Platform Engineering team, focusing on building and maintaining data pipelines and curated datasets. This role involves collaborating with various teams to deliver reliable, high-impact data solutions.
Key facts
What you'll do
- Design, build, and maintain data pipelines for analytics, reporting, and compliance, including batch, streaming, and replication methods.
- Translate business requirements into data solutions by working with product managers, engineering teams, and business stakeholders.
- Monitor data systems proactively to identify and address potential scaling, performance, and quality issues.
- Uphold and promote best practices for documentation, code reviews, data modeling, orchestration, and tooling.
- Participate in code reviews and knowledge sharing to enhance data engineering practices and team capabilities.
- Support the creation of self-service data products, offering curated datasets and semantic layers to data consumers.
Requirements
- 2-3 years of professional experience in data engineering or related fields, with a history of contributing to data pipelines and platforms.
- Proficiency in Python and SQL.
- Familiarity with Spark (PySpark and SparkSQL) and distributed data processing.
- Familiarity with orchestration and transformation tools like Airflow or DBT.
- Familiarity with Databricks and cloud platforms, with AWS preferred.
- Familiarity with infrastructure as code, such as Terraform.
- Working knowledge of shell scripting and command line tools, including Databricks CLI.
- Proven ability to work independently and collaboratively with product, engineering, and business teams.
- Experience working in teams that use CI/CD pipelines, Git-based workflows, and Agile methodologies.
- Curiosity, accountability, and a drive to improve data quality, scalability, and usability.
- Bachelor of Science degree in Computer Science or equivalent field.
Nice to have
- Experience in Fintech or capital markets.
- Familiarity with regulatory and compliance reporting (e.g., FINRA, GDPR).
- Experience supporting or mentoring junior team members.
Skills & tools
- Python
- SQL
- Spark (PySpark, SparkSQL)
- Airflow
- DBT
- Databricks
- AWS
- Terraform
- Shell scripting
- Git
- CI/CD
- Agile methodologies
Practical notes
Applicants must be authorized to work for any employer in the U.S. DriveWealth does not sponsor or take over sponsorship of employment visas at this time. The role requires being in the New York office 2-3 days per week. Benefits include competitive compensation, equity, 401(k) match, medical, dental, vision, disability insurance, paid parental leave, wellness reimbursement, company phone, personal development allowance, generous PTO, and observed holidays.