Data Engineer

Data Engineer

Join Our Team and Drive Digital Innovation!

Responsibilities:

1. Design and implement robust, scalable data pipelines and architectures to support data ingestion, processing, and storage, including performance optimizations for data modeling and ingestion.
2. Develop and optimize complex SQL queries and stored procedures for data extraction, transformation, and analysis.
3. Model data to meet different use cases.
4. Utilize programming languages (e.g., Python, R, Java, Scala) to build data processing applications and automate data workflows.
5. Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
6. Lead the integration of data from various sources into data lakes and warehouses, ensuring data quality and consistency.
7. Monitor and troubleshoot data pipelines and workflows to ensure optimal performance and reliability.
8. Communicate with and support data users.
9. Document data processes, data models, and architectural designs to ensure knowledge sharing and compliance with best practices.

Prerequisites:

1. Experience: Minimum 3 years in data engineering fields with system integration, and at least 1 year in system integration and implementation in cloud/web-based environments.
2. Proven Solutions: Demonstrated experience in providing effective, working solutions and implementations, particularly in cloud-based environments.
3. Technical Skills:
   1. Solid understanding of ETL processes, data warehousing concepts, and data modeling best practices.
   2. Proficiency in Databricks, Azure Data Lake, PowerBI, Tableau, and related data processing and visualization software.
   3. Familiarity with Windows, Linux, AWS, and/or Azure platforms.
   4. Strong programming skills in languages such as Python and R are a must.
   5. Proficiency in other programming languages such as Java, Scala, and C# will be advantageous.
   6. Experience in data processing frameworks (e.g., Apache Spark, Apache Flink).
4. Preferred Exposure: Experience with large-data management systems with visualization tools. Experience with Data Integration and ETL Pipelines, Data Warehousing, and BI reporting projects. Experience with Singapore Government Project will be advantageous.
5. Personal Attributes: Excellent problem-solving skills and the ability to work independently and collaboratively in a fast-paced environment.

Why Join Us?

Be part of a forward-thinking team that is transforming government digital services. If you are passionate about technology and innovation, and thrive in a dynamic environment, we want to hear from you!