Senior Data Engineer

About the role

Blanc Labs is seeking a highly skilled Senior Data Engineer to join our dynamic team on a contract basis. In this role, you will be responsible for designing, developing, and maintaining data pipelines and architectures that support our data-driven initiatives. The ideal candidate will have a strong background in data engineering, a passion for solving complex problems, and the ability to work collaboratively in a fast-paced environment. You will play a crucial role in ensuring data quality, availability, and accessibility across the organization.

Key facts

What you'll do

• Design and implement scalable data pipelines that efficiently process large volumes of data from various sources, ensuring high availability and reliability.
• Collaborate with data scientists and analysts to understand their data requirements and translate them into technical specifications for data models and pipelines.
• Develop and maintain ETL (Extract, Transform, Load) processes to ensure data is accurately transformed and loaded into our data warehouses and lakes.
• Optimize existing data workflows and pipelines for performance, scalability, and cost-effectiveness, leveraging cloud technologies where applicable.
• Monitor and troubleshoot data pipeline performance, implementing necessary adjustments to ensure optimal operation and minimal downtime.
• Ensure data governance and compliance by implementing best practices for data management, security, and privacy.
• Document data architecture, processes, and workflows to facilitate knowledge sharing and onboarding of new team members.
• Participate in code reviews and contribute to the development of best practices for data engineering within the team.
• Stay current with industry trends and emerging technologies in data engineering and analytics, recommending improvements and innovations to enhance our data capabilities.
• Collaborate with cross-functional teams to support data-driven decision-making and contribute to the overall success of Blanc Labs.
• Assist in the evaluation and selection of new data technologies and tools that align with our strategic goals.
• Provide mentorship and guidance to junior data engineers, fostering a culture of continuous learning and improvement within the team.

Requirements

• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field.
• A minimum of 5 years of experience in data engineering or a related role, with a proven track record of delivering high-quality data solutions.
• Proficiency in programming languages such as Python, Java, or Scala, with experience in data manipulation and analysis.
• Strong knowledge of SQL and experience with relational databases (e.g., PostgreSQL, MySQL) as well as NoSQL databases (e.g., MongoDB, Cassandra).
• Experience with data warehousing solutions such as Snowflake, Amazon Redshift, or Google BigQuery.
• Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services, including data lakes and data pipelines.
• Understanding of data modeling concepts and best practices for data architecture.
• Excellent problem-solving skills and the ability to work independently as well as part of a team.
• Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

Nice to have

• Experience with big data technologies such as Apache Hadoop, Spark, or Kafka.
• Knowledge of machine learning concepts and experience working with data scientists to support model development.
• Familiarity with data visualization tools (e.g., Tableau, Power BI) and their integration with data pipelines.
• Experience with CI/CD practices and tools for data engineering workflows.
• Understanding of data privacy regulations (e.g., GDPR, CCPA) and their implications for data management.

Skills & tools

• Programming Languages: Python, Java, Scala
• Databases: SQL, PostgreSQL, MySQL, MongoDB, Cassandra
• Data Warehousing: Snowflake, Amazon Redshift, Google BigQuery
• Cloud Platforms: AWS, Azure, GCP
• Big Data Technologies: Apache Hadoop, Spark, Kafka
• Data Visualization: Tableau, Power BI

Practical notes

• This position is remote, allowing for flexibility in your work environment.
• As a contract role, the duration and specific terms will be discussed during the interview process.
• Salary details are based on experience and qualifications.
• Visa sponsorship is not available for this position, so candidates must be eligible to work in their respective locations.

Join Blanc Labs and be part of a team that values innovation, collaboration, and excellence in data engineering. If you are ready to take on new challenges and contribute to exciting projects, we encourage you to apply for the Senior Data Engineer position today!