Data Engineer | Singapore, SG | In-Office

Data Engineer

Apply now

Posted: 2 days ago | Type: In-Office Job | Contract: S$10k - S$15k

As a Data Engineer, you will be a key contributor in building the Data Platform as a foundation for Data Analytics and AI.

Responsibilities:

• Design, develop, and maintain data pipelines and backend services for real-time decisioning, reporting, data collecting, and related functions.
• Data Requirements and Modeling
• Data Management and Transformation
• Produce high-quality, well-tested, and secure code.
• Develop and maintain software designed to improve data governance and security.
• Develop processes designed to ensure Data Security and Data Quality.

Requirements:

• BS/MS in Computer Science, Data Analytics, Data Management, Information Systems or related technical field or equivalent training & experience.
• 2+ years incorporating data processing and workflow management tools into pipeline design.
• 2+ years’ experience in ETL/ELT, Data warehousing, and/or Business Intelligence Development.
• 2+ years building and maintaining end-to-end data systems and supporting services in Python, Scala or similar.
• 2+ years using SQL to understand data and to investigate data issues or problems and provide solutions.
• 1+ years working with cloud data technologies.
• Experience with structured, semi-structured, and unstructured data.
• Experience utilizing a variety of data stores, including data warehouses, RDBMSes, in-memory caches, and searchable document databases.
• Experience working with large data sets in SQL/Databricks/PySpark.
• Experience with Spark Streaming, and Delta (Live) Tables.
• Experience with storage systems such as Azure Storage/Data Lakes.
• Experience with data modelling.
• Strong design, implementation, and testing skills.
• Experience developing for continuous integration and automated deployments.
• Experience developing on cloud platforms (preferably Azure) in a continuous delivery environment.
• Excellent communication and collaboration skills.
• Experience with microservices platforms (Kubernetes, Docker, Helm Charts).
• Experience with Event-Driven streaming systems (Kafka, Event Hub, Event Grid, Apache Flink).
• Knowledge and use of DBT.
• Experience with data vault is a plus.
• Experience with Microsoft Fabric.
• Experience with creating, editing and administering BI tools.

We are Nicoll Curtin, the award-winning global Technology & Change recruitment Group.