Data Engineer

We are the World's Port of Call. Our winning formula is our People.

In our continuing journey to build great teams, we are looking for passionate individuals driven by a strong sense of purpose. It is only with the determination and commitment of our People that we can serve our customers, lead our industry and contribute to our nation to create new possibilities.

Working Alongside, we can deliver extraordinary results together! Join #TeamPSA today!

Apply now Job no: 493595
Work type: Permanent
Categories: Infocomm Technology

We are seeking a skilled Data Engineer to join the Insights, Digitalization & Analytics department. The ideal candidate will design, develop, and maintain scalable data solutions to drive analytics, machine learning, and business insights.

Responsibilities

1. Design, develop, and maintain ETL/ELT pipelines, API endpoints, and data applications across cloud (Microsoft Azure) and on-premise environments, integrating internal and external data sources, including web scraping of public data (ensuring compliance).
2. Monitor, optimize, and maintain data quality, performance, and availability through data cleansing, transformation, and deployment of scalable solutions.
3. Create and optimize interactive dashboards to visualize business metrics, collaborating with stakeholders to design user-friendly interfaces and integrate them with backend data pipelines.
4. Implement CI/CD pipelines, automate deployments, and ensure scalability and performance for data and Machine Learning (ML)/AI solutions.
5. Collaborate with Data Scientists and software engineers to deploy, monitor, and maintain ML/AI projects in production systems.

Requirements

• Possess a bachelor’s degree in computer science, Computer Engineering, or a related field (specialization in Software Engineering is a plus).
• 2–3 years of experience in data engineering or software engineering with expertise in data warehousing, big data platforms, cloud technologies, and automation tools.
• Strong data analysis, data verification and problem-solving abilities.
• Analytical, meticulous, and team player.
• Effective communication skills for collaboration across teams.
• Ability to manage multiple tasks in a dynamic environment.
• Self-motivated and possess initiative to learn new skills and technologies.

Technical Skills required:

• Proficiency in relational databases (MS SQL Server), NoSQL, and ETL pipelines using Python or ETL tools (e.g., Microsoft SSIS, Informatica IPC).
• Familiarity with Python web application and API development tools (e.g., Flask, Requests) and web scraping tools (e.g., BeautifulSoup, Scrapy).
• Skilled in Power BI, including DAX and Power Query, for creating reports and dashboards.
• Experience with Microsoft Azure PaaS services, including Azure Data Factory, Data Lake Storage, App Service, and Azure SQL, as well as CI/CD pipelines using Azure DevOps.
• Knowledge of Machine Learning tools (e.g., AutoML platforms like Azure AutoML or DataRobot) and ML libraries (e.g., Scikit-learn, TensorFlow, PyTorch, Keras).
• Familiarity with big data technologies (e.g., Hadoop, Hive, Spark) and Databricks platform (a plus).

Only shortlisted candidates will be notified.

Advertised: 21 Dec 2024
Applications close: 30 Apr 2025