Senior Data Engineer is responsible to build systems that collect, manage, and convert raw data into usable information for business analysts.
Responsibilities:
Make optimal data pipeline architecture
Perform internal process improvements in the data engineering field: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
Create data tools for the data team to perform analytics.
Requirements:
Bachelor’s degree in Information Technology or equivalent.
Minimum 3 years of experience as a Data Engineer or similar role
Deep knowledge of various database systems (SQL and NoSQL) and data warehousing solutions
Familiarity with ETL / ELT tools
Accustomed to interacting with data APIs
Knowledge of algorithms and data structures
Adept in Python Programming Language, Apache Airflow, Amazon Web Services (Redshift, S3)