Data Engineer

As a Data Engineer, you will play a key role in the development and maintenance of our data infrastructure. You will work closely with cross-functional teams to gather requirements, design data pipelines, and deliver analytical reports. This role requires proficiency in Azure-based tools and services to ensure seamless data integration, transformation, and visualization.

Key Responsibilities:

• Design, implement, and maintain data pipelines using Azure Data Factory (ADF) for data ingestion, transformation, and orchestration.
• Create dynamic and insightful dashboards and reports using Power BI for business users and stakeholders.
• Integrate data sources and automate workflows using Logic Apps to streamline processes and enhance data accuracy.
• Optimize and maintain Azure SQL databases, ensuring high performance, availability, and security of data.
• Collaborate with data analysts, data scientists, and business stakeholders to understand data needs and provide actionable insights.
• Develop and execute unit tests and data validation procedures to ensure data quality and accuracy.
• Troubleshoot and resolve data integration issues, ensuring smooth operations across data platforms.
• Stay updated on the latest Azure services and best practices for data engineering.

Technical Skills and Qualifications:

• Proven experience working with Azure Data Factory (ADF) for building, automating, and managing data workflows.
• Strong expertise in Power BI for building interactive reports, dashboards, and visualizations.
• Experience with Logic Apps for creating automated workflows between Azure services and other cloud-based applications.
• Proficiency in Azure SQL for data modeling, querying, and performance tuning.
• Familiarity with data warehousing concepts and best practices.
• Experience in data migration, transformation, and integration across multiple platforms.
• Knowledge of ETL processes, data pipelines, and cloud architecture.
• Strong understanding of cloud-based data storage solutions and data governance practices.

Preferred Qualifications:

• Experience with other Azure services like Azure Data Lake, Azure Synapse Analytics, or Azure Databricks.
• Familiarity with Python or SQL for advanced data processing and automation.
• Certification in Microsoft Azure or Power BI is a plus.
• Strong problem-solving and analytical skills.
• Excellent communication skills and the ability to work collaboratively in a team environment.