Data engineer

Responsibilities

1. Create and maintain an optimal data structure
2. Compile large and complex datasets that meet functional/non-functional business requirements
3. Define, design and implement internal process improvements: automate manual processes, improve data delivery, and redesign infrastructure to increase scalability
4. Build the infrastructure required to optimally extract, transform, and load data from a variety of data sources
5. Build analytics tools that use data to provide actionable insights into operational efficiency and business KPIs
6. Work with stakeholders and implementation teams to assist with data-related technical issues and support data infrastructure needs
7. Identify ways to improve data reliability, efficiency and quality
8. Ensure that data is available and accessed by the right parties
9. Ensure data entries adhere to data management practices

Requirements

1. Must have a Bachelor's degree in Statistics/Computer Science or equivalent
2. At least 5 years of working experience in data warehouses and big data
3. Advanced SQL working experience with relational databases and writing SQL queries, as well as familiarity with working with a variety of databases
4. Experience building and optimizing big data
5. Strong analytical skills related to working with unstructured data sets
6. Build processes that support data transformation, data structures, metadata, and dependency
7. Manipulating, processing, and extracting value from large disconnected datasets
8. Knowledge of message queuing, stream processing, and scalable