Lead Data Engineer - Visa Sponsorship & Relocation to Australia

About the role

Billigence is seeking a highly skilled Lead Data Engineer to join our dynamic team in North Sydney, New South Wales. This position offers an exciting opportunity for professionals looking to advance their careers in data engineering while enjoying the benefits of visa sponsorship and relocation to Australia. As a Lead Data Engineer, you will play a pivotal role in shaping our data architecture, driving innovative solutions, and leading a team of talented data engineers. Your expertise will be crucial in enhancing our data capabilities and delivering high-quality insights to our clients.

Key facts

What you'll do

• Design and implement robust data pipelines and architectures that support the collection, storage, and processing of large datasets.
• Lead a team of data engineers, providing mentorship and guidance to foster their professional growth and technical skills.
• Collaborate with cross-functional teams, including data scientists, analysts, and product managers, to understand data requirements and deliver effective solutions.
• Evaluate and integrate new data technologies and tools to enhance our data processing capabilities and improve efficiency.
• Ensure data quality and integrity by implementing best practices for data governance and management.
• Develop and maintain documentation for data processes, architectures, and workflows to ensure clarity and consistency across the team.
• Monitor and optimize data performance, identifying bottlenecks and implementing solutions to improve system efficiency.
• Conduct code reviews and provide constructive feedback to team members to maintain high coding standards and best practices.
• Participate in strategic planning sessions to align data initiatives with business objectives and drive data-driven decision-making.
• Stay up-to-date with industry trends and advancements in data engineering, sharing insights with the team to foster a culture of continuous learning.
• Engage with clients to understand their data needs and provide tailored solutions that meet their business challenges.
• Contribute to the development of data models and analytics frameworks that support business intelligence initiatives.

Requirements

• A minimum of 5 years of experience in data engineering or a related field, with a strong focus on building data pipelines and architectures.
• Proficiency in programming languages such as Python, Java, or Scala, with a solid understanding of data processing frameworks like Apache Spark or Hadoop.
• Extensive experience with cloud platforms such as AWS, Google Cloud, or Azure, particularly in data storage and processing services.
• Strong knowledge of database technologies, including SQL and NoSQL databases, and experience with data warehousing solutions.
• Familiarity with data visualization tools and techniques, enabling effective communication of insights to stakeholders.
• Excellent problem-solving skills and the ability to work independently as well as part of a collaborative team environment.

Nice to have

• Experience with machine learning frameworks and libraries, such as TensorFlow or PyTorch, to support data science initiatives.
• Knowledge of data governance frameworks and best practices for data management and compliance.
• Familiarity with containerization technologies like Docker and orchestration tools such as Kubernetes.

Skills & tools

• Proficient in data modeling and ETL (Extract, Transform, Load) processes.
• Strong understanding of data security principles and practices.
• Experience with version control systems, particularly Git, for collaborative development.
• Familiarity with Agile methodologies and project management tools.

Practical notes

• This role offers visa sponsorship for qualified candidates, making it an excellent opportunity for international applicants.
• Relocation assistance will be provided to help you settle in Australia smoothly.
• The salary for this position is competitive and commensurate with experience, reflecting the value we place on our team members.
• Candidates should be prepared for a comprehensive interview process that may include technical assessments and team interviews.
• Billigence is committed to fostering a diverse and inclusive workplace, and we encourage applications from individuals of all backgrounds.

META

Company: Billigence

Title: Lead Data Engineer - Visa Sponsorship & Relocation to Australia

Listed

location: North Sydney, New South Wales

Job type: Full-time