Senior Data Engineer
TripadvisorUK1w ago
Engineeringremotecurated-jd
Job description
Senior Data Engineer at Tripadvisor
About the role
Join Tripadvisor to build and refine the data infrastructure that powers our global travel platform. You will contribute to creating high-quality data products used across the company, from product teams to executive leadership. This role involves working with large-scale data and modern cloud technologies in a dynamic environment.
Key facts
What you'll do
- Prepare and consolidate data from diverse, large-scale sources to ensure data consumers receive high-quality datasets.
- Construct and enhance data pipelines and ETL processes that handle terabytes of information on platforms like Snowflake and BigQuery.
- Develop and improve enterprise data marts by designing efficient and scalable data models for organizational use.
- Collaborate with analytics, data science, CRM, and machine learning teams to deliver data solutions.
- Maintain the integrity, validation, and documentation of enterprise data marts.
- Manage data pipeline service level agreements (SLAs) and dependencies.
- Produce technical documentation for data solutions and present them during design reviews.
- Address data pipeline failures and implement anomaly detection systems.
- Work with various teams, including analytics and product owners, on tracking solutions and resolving technical challenges.
- Lead medium to large projects, including technical specification writing and project planning.
- Provide guidance and mentorship to less experienced team members.
Requirements
- Hold a Bachelor's or Master's degree in Computer Science or a related technical field.
- Possess 6 or more years of experience in data engineering or general software development.
- Have experience working with large datasets, measured in terabytes, and familiarity with database and big data technologies.
- Demonstrate comprehensive experience in data design and data modeling.
- Show solid experience in developing complex ETL processes from inception to completion, including defining SLAs, performance metrics, and monitoring.
- Exhibit advanced query language and data exploration skills, with a proven ability to write complex SQL queries on extensive datasets.
- Possess experience in systems performance and optimization, understanding how architecture impacts performance and scalability.
- Be proficient in functional programming using Python or a comparable language.
- Adhere to strong software engineering principles.
- Be self-motivated, organized, detail-oriented, and have a strong sense of ownership.
- Communicate effectively with both business and technical stakeholders.
- Thrive in a fast-paced and evolving work environment.
- Show a history of technical leadership in planning and executing medium to large projects under challenging deadlines.
- Have strong interpersonal skills, a curious mindset, and enthusiasm for tackling complex problems.
- Be able to simplify intricate problems into manageable solutions.
- Comfortably manage the entire data lifecycle and work independently.
Nice to have
- Experience or interest in machine learning and data science for innovative problem-solving.
- Familiarity with task orchestration tools like Airflow.
- Comfort using a Linux command-line interface.
- Experience designing high-scale, fault-tolerant, and performant distributed applications.
- Experience developing and managing real-time data pipelines.
- Experience with programming languages such as Java.
- Experience in data governance practices.
Skills & tools
- Big Data platforms (e.g., Hadoop, Hive, BigQuery, Snowflake)
- Relational Databases (e.g., MS SQL, PostgreSQL, MySQL)
- Python
- SQL
Practical notes
- Competitive compensation, including base salary and annual bonus.
- Flexible work arrangements with remote and hybrid options.
- Generous benefits package including tuition assistance, lifestyle benefits, travel perks, and health benefits.
- Donation matching for charitable contributions.
- Employee assistance program.
- Referral bonuses for successful candidate referrals.