Talent Pool - Data Engineer

About the role

As a Data Engineer at Agilityfeat, you will play a crucial role in shaping the data landscape of our organization. You will be responsible for designing, building, and maintaining robust data pipelines and architectures that enable our teams to derive actionable insights from large datasets. This position requires a blend of technical expertise and analytical thinking, as you will collaborate with cross-functional teams to support data-driven decision-making processes. Your contributions will directly impact our ability to deliver innovative solutions to our clients.

Key facts

What you'll do

• Design and implement scalable data pipelines that efficiently process large volumes of data from various sources, ensuring data integrity and reliability.
• Collaborate with data scientists and analysts to understand data requirements and translate them into technical specifications for data architecture.
• Optimize existing data workflows and processes to enhance performance and reduce latency in data retrieval and processing.
• Develop and maintain data models and schemas that support analytical and reporting needs across the organization.
• Monitor and troubleshoot data pipeline performance, identifying and resolving issues to ensure seamless data flow.
• Implement data governance practices to ensure compliance with data privacy regulations and industry standards.
• Work with cloud-based data storage solutions, leveraging platforms such as AWS, Azure, or Google Cloud to manage and scale data infrastructure.
• Create and maintain comprehensive documentation for data processes, architectures, and workflows to facilitate knowledge sharing and onboarding of new team members.
• Participate in code reviews and contribute to best practices in data engineering, fostering a culture of continuous improvement within the team.
• Stay updated with emerging technologies and industry trends in data engineering, recommending tools and practices that can enhance our data capabilities.
• Engage with stakeholders to gather feedback and iterate on data solutions, ensuring alignment with business objectives and user needs.
• Mentor junior data engineers, providing guidance and support in their professional development and technical skills enhancement.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• A minimum of 3 years of experience in data engineering or a similar role, with a proven track record of building and maintaining data pipelines.
• Proficiency in programming languages such as Python, Java, or Scala, with a strong understanding of data structures and algorithms.
• Experience with SQL and NoSQL databases, including but not limited to PostgreSQL, MongoDB, or Cassandra.
• Familiarity with data warehousing solutions and ETL (Extract, Transform, Load) processes.
• Knowledge of cloud platforms (AWS, Azure, or Google Cloud) and their data services, including data lakes and data warehouses.
• Strong analytical and problem-solving skills, with the ability to work independently and as part of a team.
• Excellent communication skills, capable of conveying complex technical concepts to non-technical stakeholders.
• Experience with version control systems, such as Git, and familiarity with Agile methodologies.

Nice to have

• Experience with big data technologies such as Apache Hadoop, Spark, or Kafka.
• Familiarity with data visualization tools like Tableau, Power BI, or Looker.
• Knowledge of machine learning concepts and frameworks, enabling collaboration with data science teams.
• Previous experience in a remote work environment, demonstrating self-motivation and effective time management.

Skills & tools

• Programming Languages: Python, Java, Scala
• Databases: PostgreSQL, MongoDB, Cassandra
• Cloud Platforms: AWS, Azure, Google Cloud
• Data Processing: ETL tools, Apache Hadoop, Spark
• Version Control: Git
• Data Visualization: Tableau, Power BI

Practical notes

• This position is fully remote, allowing you to work from anywhere.
• Candidates requiring visa sponsorship are encouraged to apply.
• The salary for this role is competitive and will be determined based on your experience and qualifications.
• Agilityfeat values diversity and encourages applications from individuals of all backgrounds.

META

Company: Agilityfeat

Title: Talent Pool

Data Engineer

Listed

location: Unknown

Job type: Full-time