Data Engineer

About the role

As a , you will play a role in shaping the infrastructure that supports our innovative digital asset solutions. Your expertise will be essential in building, maintaining, and optimizing data pipelines that empower teams across the organization to data effectively. This position requires a hands-on approach and a commitment to excellence, as you will be responsible for ensuring the reliability and scalability of our data operations. If you are about working at the crossroads of finance and technology and have a strong foundation in modern data stacks, this could be the perfect opportunity for you.

Key facts

What you'll do

• Design and develop data pipelines that facilitate the flow of information across various teams and applications.
• Build and maintain the necessary tooling and infrastructure that allows data teams to manage their own pipelines autonomously.
• Implement and oversee monitoring, alerting, and data operations practices to ensure the platform remains reliable as it scales.
• Operate Kafka as the primary message broker, enabling a dynamic event-driven architecture that supports cross-team collaboration.
• Deploy, manage, and maintain infrastructure components using Terraform and Kubernetes, ensuring optimal performance and security.
• Execute high-throughput, low-latency processing tasks utilizing Databricks/Spark and other cloud-native services on AWS.
• Support data transformation processes using dbt and orchestrate workflows with Airflow or similar tools across the platform.
• Collaborate closely with product, analytics, and infrastructure teams to design and implement improvements to the data platform.
• Troubleshoot production issues effectively, driving timely resolutions to minimize downtime and enhance system reliability.
• Advocate for the thoughtful integration of AI tools to boost team performance and improve overall business outcomes, leveraging generative AI and automation platforms in your daily tasks.

Requirements

• A minimum of 5 years of experience in data engineering or a related field, with a strong understanding of data architecture and pipeline design.
• Proficiency in programming languages such as Python or Java, with a focus on writing clean, maintainable, and well-tested code.
• Extensive experience with cloud platforms, particularly AWS, and familiarity with tools like Kubernetes, Terraform, and Kafka.
• Solid understanding of modern data processing frameworks, especially Databricks and Spark.
• Demonstrated ability to implement monitoring and alerting systems that enhance the reliability of data operations.
• Experience with data transformation tools like dbt and orchestration solutions such as Airflow.
• Strong problem-solving skills with a proactive approach to troubleshooting and resolving production issues.
• Excellent communication skills, enabling effective collaboration with cross-functional teams and stakeholders.

Nice to have

• Familiarity with blockchain technology and digital asset ecosystems, particularly in the context of finance and investment.
• Experience working in fast-paced startup environments, demonstrating agility and adaptability in your work.
• Knowledge of machine learning concepts and their applications in data engineering.
• Understanding of data governance and compliance regulations relevant to the financial sector.

Skills & tools

• Proficient in Python or Java for data pipeline development.
• Experienced with AWS cloud services for deploying and managing data infrastructure.
• Knowledgeable in container orchestration using Kubernetes and infrastructure as code with Terraform.
• Familiar with data processing frameworks, particularly Databricks and Spark, for handling large-scale data workloads.
• Skilled in using Kafka for event-driven architecture and message brokering.
• Comfortable with data transformation and orchestration tools like dbt and Airflow.

Practical notes

• This position is based in India, and candidates must be willing to work within the local time zone for collaboration with global teams.
• A competitive salary will be offered, commensurate with experience and industry standards.
• Candidates must be eligible to work in India, and visa sponsorship is not available for this role.
• Galaxy promotes a culture of continuous learning and development, providing opportunities for professional growth and advancement within the company.

At Galaxy, we are committed to fostering a diverse and inclusive work environment that encourages innovative thinking and collaboration. We value individuals who are about technology and its potential to transform the financial landscape. If you are ready to take on new challenges and make a significant impact in the world of digital assets, we invite you to apply and join our dynamic team.