Data Processing Quality Engineer

About the role

As a , you will play a vital role in ensuring the integrity and quality of data processed within our systems. This position requires a keen eye for detail and a strong understanding of data processing methodologies. You will collaborate with various teams to identify quality issues and implement solutions that enhance our data processing capabilities. Your contributions will directly impact our operational efficiency and the quality of our data-driven insights.

Key facts

What you'll do

• Develop and implement quality assurance processes for data processing workflows to ensure accuracy and reliability.
• Collaborate with data engineers and software developers to identify potential quality issues in data pipelines and processing algorithms.
• Conduct thorough testing of data processing systems, including unit tests, integration tests, and performance tests to validate functionality and performance.
• Analyze data quality metrics and generate reports to communicate findings and recommendations to stakeholders.
• Design and maintain automated testing frameworks to streamline quality assurance processes and enhance efficiency.
• Participate in code reviews and provide constructive feedback to ensure adherence to best practices in data processing and quality assurance.
• Work closely with cross-functional teams to define data quality standards and establish protocols for data validation and cleansing.
• Identify and troubleshoot data discrepancies, working to resolve issues promptly and effectively.
• Stay current with industry trends and advancements in data processing technologies to continuously improve quality assurance practices.
• Assist in training and mentoring junior team members on data quality principles and best practices.
• Document quality assurance processes, test cases, and results to maintain clear records and facilitate knowledge sharing within the team.
• Engage in continuous improvement initiatives to enhance data processing workflows and quality assurance methodologies.

Requirements

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• A minimum of 3 years of experience in data quality assurance or a similar role, preferably within a data processing environment.
• Strong understanding of data processing frameworks and methodologies, including ETL processes.
• Proficiency in programming languages such as Python, Java, or SQL for data manipulation and testing.
• Experience with data quality tools and frameworks, such as Apache NiFi, Talend, or similar.
• Familiarity with database management systems (e.g., MySQL, PostgreSQL, or MongoDB) and data warehousing concepts.
• Excellent analytical skills with the ability to interpret complex data sets and identify patterns and anomalies.
• Strong problem-solving abilities and a detail-oriented mindset.
• Effective communication skills, with the ability to convey technical concepts to non-technical stakeholders.
• Experience in Agile methodologies and working within cross-functional teams is a plus.

Nice to have

• Knowledge of data governance principles and practices.
• Familiarity with cloud-based data processing platforms, such as AWS or Azure.
• Experience with machine learning concepts and their application in data quality improvement.
• Understanding of data privacy regulations and compliance standards.
• Certification in quality assurance or data management is a plus.

Skills & tools

• Proficient in data quality assessment and improvement methodologies.
• Strong programming skills in Python, Java, or SQL.
• Experience with data visualization tools such as Tableau or Power BI for reporting purposes.
• Familiarity with version control systems like Git for collaborative development.
• Knowledge of automated testing tools and frameworks to enhance quality assurance processes.

Practical notes

• This position is based in Hyderabad, Telangana, and is a full-time role.
• Competitive salary will be offered based on the candidate's experience and qualifications.
• Visa sponsorship is available for exceptional candidates who require it.
• Interested applicants can apply through the following link: [Datapelago Careers](https://datapelago.bamboohr.com/careers/42).
• The ideal candidate will be proactive, detail-oriented, and passionate about data quality and processing.

Join Datapelago and be part of a dynamic team dedicated to delivering high-quality data solutions that drive business success. Your expertise will help us maintain our commitment to excellence in data processing and quality assurance.