Data Engineer

Data Engineer Job Description

BlackStone eIT, a leading computer software company, is seeking a talented and experienced Data Engineer to join our dynamic team. As a Data Engineer at BlackStone eIT, you will be responsible for designing, developing, and maintaining scalable data infrastructure and systems. You will work closely with cross-functional teams to gather data requirements, design data pipelines, and ensure data quality and integrity. In this role, you will have the opportunity to work on diverse and challenging projects, leveraging the latest technologies and methodologies. We are looking for individuals who are passionate about data engineering and possess strong problem-solving and analytical skills.

Responsibilities

1. Design, build, and maintain scalable data pipelines and data systems
2. Collaborate with cross-functional teams to understand data requirements and develop appropriate solutions
3. Create and optimize databases and data models for efficiency and performance
4. Implement and automate ETL processes to extract, transform, and load data from various sources
5. Ensure data quality and integrity by performing data validation and implementing data quality checks
6. Develop and maintain documentation related to data infrastructure and processes
7. Troubleshoot and resolve data-related issues
8. Stay up-to-date with the latest trends and technologies in data engineering and data management

Requirements

1. Bachelor’s degree in a relevant field
2. 3+ years of experience in Agile/Kanban
3. 6+ years of experience in ETL
4. 3+ years of experience in Big Data
5. 6+ years of in DWH
6. 6+ years of experience in SQL
7. 4+ years of experience in Python

Tools:

1. Azure DataLake: 5+ years of experience
2. Azure SQL/Snowflake or similar: 5+ years of experience
3. Azure Databricks: 5+ years of experience
4. Talend: 3+ years of experience
5. Jira/Azure DevOps or similar: 3+ years of experience
6. Confluence or similar: 3+ years of experience