Data Engineer - Insurance Domain

About the role

As a Data Engineer specializing in the insurance sector at Billigence, you will play a pivotal role in transforming raw data into actionable insights that drive decision-making and enhance operational efficiency. This position requires a strong foundation in data engineering principles, along with a keen understanding of the insurance industry's unique challenges and opportunities. You will collaborate with cross-functional teams to design, implement, and maintain robust data pipelines that support analytical and reporting needs.

Key facts

What you'll do

• Design and develop scalable data pipelines to facilitate the extraction, transformation, and loading (ETL) of data from various sources into data warehouses and lakes.
• Collaborate with data analysts and business stakeholders to understand data requirements and translate them into technical specifications for data solutions.
• Implement data quality checks and monitoring processes to ensure the integrity and accuracy of data throughout the data lifecycle.
• Optimize existing data processes to improve performance and reduce latency, ensuring timely access to critical business information.
• Work closely with data scientists to provide clean, structured data sets that support advanced analytics and machine learning initiatives.
• Utilize cloud platforms such as AWS or Azure to deploy data solutions, ensuring scalability and reliability in data management.
• Document data engineering processes, architectures, and workflows to facilitate knowledge sharing and onboarding of new team members.
• Stay updated with industry trends and advancements in data engineering and the insurance domain to continuously enhance skills and methodologies.
• Participate in code reviews and contribute to best practices in data engineering to maintain high standards of code quality and maintainability.
• Troubleshoot and resolve data-related issues in a timely manner, ensuring minimal disruption to business operations.
• Engage in agile methodologies, participating in sprint planning and retrospectives to align with team goals and deliverables.
• Foster a culture of collaboration and innovation within the team, encouraging the exploration of new tools and technologies that can enhance data capabilities.

Requirements

• A minimum of 3 years of experience in data engineering or a related field, preferably within the insurance or financial services sector.
• Proficiency in programming languages such as Python, Java, or Scala, with a strong emphasis on data manipulation and analysis.
• Experience with data warehousing solutions like Snowflake, Redshift, or Google BigQuery, including schema design and optimization.
• Familiarity with ETL tools such as Apache NiFi, Talend, or Informatica, and experience in building data pipelines.
• Strong understanding of database technologies, including SQL and NoSQL databases, and their application in data engineering.
• Knowledge of data modeling techniques and best practices for data governance and compliance, particularly in the insurance industry.

Nice to have

• Experience with big data technologies such as Hadoop, Spark, or Kafka, and their application in processing large datasets.
• Familiarity with machine learning frameworks and libraries, enabling collaboration with data science teams.
• Understanding of cloud-native data architecture and services, particularly within AWS or Azure ecosystems.
• Previous experience working in an agile environment, contributing to iterative development processes.

Skills & tools

• Programming Languages: Python, Java, Scala
• Data Warehousing: Snowflake, Redshift, Google BigQuery
• ETL Tools: Apache NiFi, Talend, Informatica
• Databases: SQL, NoSQL (MongoDB, Cassandra)
• Big Data Technologies: Hadoop, Spark, Kafka
• Cloud Platforms: AWS, Azure

Practical notes

• This is a contract position based in London, Greater London, offering competitive compensation.
• Candidates must be eligible to work in the UK and may require sponsorship depending on their visa status.
• The role may involve occasional remote work, but candidates should be prepared for in-office collaboration as needed.
• Interested applicants can apply through the Billigence careers page at [Billigence Careers](https://billigence.bamboohr.com/careers/630).

META

Company: Billigence

Title: Data Engineer - Insurance Domain

Listed

location: London, Greater London

Job type: Contract