Data Engineer

Job Summary:

We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong technical background in designing and developing data pipelines, integrating and managing data systems, and collaborating with various stakeholders to deliver high-quality data solutions. This role is vital to ensuring our data infrastructure is robust, scalable, and optimized to meet the business’s evolving needs.

Location: Bali, Indonesia (in office)

Key Responsibilities:

Design and Develop Data Pipelines:

1. Create and maintain optimal data pipeline architecture.
2. Assemble large, complex data sets that meet functional and non-functional business requirements.

Data Integration and ETL:

1. Build the infrastructure required for the optimal extraction, transformation, and loading (ETL) of data from various data sources.
2. Develop processes and tools to monitor and analyze data pipeline performance.

Database Management:

1. Work with data and analytics experts to strive for greater functionality in our data systems.
2. Implement, maintain, and optimize database solutions, including both SQL and NoSQL databases.

Collaboration and Communication:

1. Collaborate with data scientists, business analysts, and other stakeholders to understand data needs and provide technical solutions.
2. Communicate project progress, issues, and solutions effectively to the team and management.

Data Quality and Governance:

1. Ensure data quality and data governance standards are maintained.
2. Implement data security measures and compliance policies.

Qualifications:

Education and Experience:

1. Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
2. Proven experience as a Data Engineer or in a similar role.

Technical Skills:

1. Proficient in SQL and experienced with relational databases.
2. Experience with big data tools such as Hadoop, Spark, or Kafka.
3. Knowledge of data pipeline and workflow management tools like Airflow or Luigi.
4. Experience with cloud services (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes).

Programming Skills:

1. Strong programming skills in Python, Java, Scala, or similar languages.

Soft Skills:

1. Strong problem-solving skills and attention to detail.
2. Excellent communication and teamwork abilities.
3. Ability to work in a fast-paced, dynamic environment.

Preferred Qualifications:

1. Experience with machine learning and data mining techniques.
2. Familiarity with data visualization tools such as Tableau or Power BI.
3. Knowledge of data privacy regulations and best practices.

Why Join Us?

This is an exciting opportunity to contribute to the development and optimization of our data infrastructure, working with a team of talented professionals in a fast-paced and innovative environment. If you are passionate about data and have the technical skills to match, we encourage you to apply.