Job Description : Azure Data Engineer (Consultant Software Engineer)
As a Consultant Data Engineer, you will be responsible for designing and implementing scalable, high-performance data engineering solutions using Microsoft Azure technology stack and modern data warehouses solutions
Roles & Responsibilities:
- Participate and attend daily scrum calls and other project meetings
- Understand business requirements and actively participate and clarify requirements with the client
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Understand the underlying data, data model and flow of data
- Design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Azure Data Factory, Azure Function Apps & Azure Storage solutions.
- Design & build complex data models using cloud based data warehouse solutions like Azure Synapse Analytics, Snowflake etc.
- Develop and maintain scalable and efficient data pipelines and architectures.
- Ensure optimal architecture and performance of applications deployed on Azure.
- Manage the full lifecycle of data and analytics solutions, from requirements gathering to deployment and maintenance.
- Continuous learning and acquiring new skills and knowledge on different DE tools
- Lead & mentor a team of Data Engineers
- Should act as an SME on Azure Data Engineering and lead all technical discussions and suggestions with the client
- Optimize technical solutions and implementation for performance, security and cost efficiency.
Skills
- Expert level knowledge of Azure Data Factory
- Expert level knowledge of SQL
- Expert level knowledge on Cloud based DW solutions like Snowflake or Azure Synapse Analytics
- Strong knowledge of programming languages such as Python or C#
- Should be able to analyze and understand data
- Experience with version control systems like Git.
- Experience with other Azure services such as Azure Function App, Azure Data Lake, Azure Synapse, or Azure DevOps
- Excellent interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision
- Solid influencing skills and demonstrates leadership, motivating and encouraging others to get results
- Demonstrates and is deemed as an SME on Data Engineering stack
Qualifications & Experience :
Must have
- Bachelor or Masters Degree in computer science or engineering
- Around 8+ years of experience as a data engineer, with strong proficiency in Azure cloud services and Azure Data Factory
- 3+ years of experience with designing and implementing data solutions using Azure Cloud
- Experience with data modeling, ETL/ELT development, data integration and orchestration techniques leveraging Azure Data Lake and Data Factory
- Strong experience with advanced SQL concepts
Nice to Have
Certifications like Azure Data Engineer Associate, Azure Administrator Associate, Azure Solutions Architect or Snow Pro Core
Familiarity with CI/CD practices
Familiarity with Power BI or similar visualization tools
Familiarity with Microsoft Fabric
