Data Engineer
Job description
Data Engineer at Bamboohr.
About the role
As a Data Engineer at Bamboohr, you will play a pivotal role in shaping the data infrastructure that supports our innovative solutions. Your expertise will be essential in designing, building, and maintaining robust data pipelines that ensure the seamless flow of information across various systems. You will collaborate with cross-functional teams to understand data needs and translate them into scalable solutions, contributing to the overall success of our data-driven initiatives. This position offers an exciting opportunity to work in a dynamic environment where your contributions will directly impact the company's growth and efficiency.
Key facts
What you'll do
- Design and implement scalable data pipelines to facilitate the extraction, transformation, and loading (ETL) of large datasets from various sources into our data warehouse.
- Collaborate with data scientists and analysts to understand their data requirements and ensure that the data infrastructure meets their needs.
- Optimize existing data processes for performance and efficiency, identifying bottlenecks and implementing solutions to enhance data flow.
- Develop and maintain data models that support business intelligence and reporting initiatives, ensuring data accuracy and reliability.
- Monitor and troubleshoot data pipeline performance, implementing necessary adjustments to improve reliability and reduce downtime.
- Work with cloud-based data storage solutions, ensuring data security and compliance with industry standards.
- Document data architecture, processes, and workflows to maintain clarity and facilitate knowledge sharing within the team.
- Participate in code reviews and contribute to best practices in data engineering, fostering a culture of continuous improvement within the team.
- Stay updated with the latest trends and technologies in data engineering, recommending tools and methodologies that can enhance our data capabilities.
- Assist in the integration of third-party APIs and data sources, ensuring seamless connectivity and data synchronization.
- Collaborate with IT and security teams to implement data governance policies and ensure data integrity across all platforms.
- Provide support and training to team members on data tools and technologies, promoting a data-driven culture within the organization.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field.
- A minimum of 3 years of experience in data engineering or a related role, with a strong understanding of data warehousing concepts.
- Proficiency in SQL and experience with relational databases such as PostgreSQL or MySQL.
- Familiarity with big data technologies such as Hadoop, Spark, or Kafka is a plus.
- Experience with cloud platforms like AWS, Azure, or Google Cloud for data storage and processing.
- Strong programming skills in languages such as Python, Java, or Scala for data manipulation and pipeline development.
- Knowledge of data modeling techniques and best practices for data architecture.
- Excellent problem-solving skills and the ability to work independently as well as collaboratively within a team.
- Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
- Familiarity with data visualization tools such as Tableau or Power BI is advantageous.
Nice to have
- Experience with machine learning frameworks and libraries, such as TensorFlow or PyTorch.
- Knowledge of data governance and compliance standards, including GDPR and CCPA.
- Familiarity with containerization technologies like Docker or Kubernetes for deploying data applications.
Skills & tools
- SQL, Python, Java, Scala
- Data warehousing solutions (e.g., Snowflake, Redshift)
- Big data technologies (e.g., Hadoop, Spark)
- Cloud platforms (e.g., AWS, Azure, Google Cloud)
- Data visualization tools (e.g., Tableau, Power BI)
- ETL tools (e.g., Apache NiFi, Talend)
Practical notes
This position is based in Cairo, Egypt, and offers a full-time engagement with a competitive salary that reflects your experience and skills. Bamboohr is committed to fostering a diverse and inclusive workplace, and we welcome applications from candidates of all backgrounds. If you are passionate about data engineering and eager to contribute to innovative projects, we encourage you to apply through our career portal. Work visa sponsorship is available for qualified candidates, ensuring that we can attract the best talent from around the globe.
META
Company: Bamboohr
Title: Data Engineer
Listed
location: Cairo, Egypt
Job type: Full-time