Job Description –
As a Data Quality Engineer, you will be responsible for ensuring the quality, accuracy, and reliability of organizational data. This role involves in developing and implementing data quality processes, and tools throughout the data lifecycle. This role requires a deep understanding of data quality principles, quality assurance methods, and the ability to collaborate with cross-functional teams to identify and resolve data quality issues
Roles & Responsibilities:
- Ability to understand the business domain and determine business impact due to data issues.
- Strong understanding of data quality concepts, methodologies, and best practices.
- Conduct thorough data profiling and analysis to identify anomalies, inconsistencies, and inaccuracies in datasets.
- Develop and execute comprehensive data quality testing strategies and plans to verify the implementation of data pipelines and data validations
- Collaborate with data engineers and other cross-functional teams to integrate data quality checks into the data pipeline and maintain quality throughout.
- Continuously assess and enhance data quality processes and methodologies to adapt to evolving business needs and industry best practices
- Design and execute data quality assessments to identify inconsistencies, inaccuracies, and incompleteness in data.
- Strong understanding of relational databases, star schema, and data modeling.
- Demonstrate expert-level knowledge of SQL for complex data querying and manipulation.
- Demonstrate python experience to develop and maintain data quality scripts, tools, and frameworks.
- Conduct unit and regression testing to validate data pipelines.
- Be a strong Agile team member.
- Determine root cause of data quality errors and recommend solutions
Skills:
- Strong knowledge on Excel – (Pivots, Macros / Functions (statistical), Filters, VLOOKUP etc.).
- Should be hands on in Data profiling / Data Quality tools
- Should be hands on writing complex sql queries
- Should have scripting experience on Python
- Excellent communication skills
- Excellent problem-solving and analytical skills.
Qualifications & Experience :
- B.E /BTech/ME/MTech/BStat/MCA(or equivalent)
- 5-7 years of prior experience having worked on data related projects
- Experience in Analysis of Complex data sets
- Experience in Data Validation for data accuracy
- Knowledge of Data visualization tools
- Excel Advanced functions
- Exp in writing complex SQL Query
- Exp in Statistical techniques
- Experience of Scripting python
- Experience in Data profiling /cataloging tools
- Proficient knowledge of DQ Metrics
