Data Engineer

Digital Hub Kuala Lumpur attracts, inspires, and develops diverse talents who will elevate BASF’s digital journey.

As one of the world’s largest chemical companies, BASF is on a mission to create chemistry with a sustainable future. The Digital Hub Kuala Lumpur, alongside four other Digital Hubs across the globe, is part of the technology powerhouse driving our vision. Join our organization and make an impact in an inclusive and diverse work environment. We value individual differences and provide opportunities for you to contribute your unique perspective towards our collective goals.

We are looking for a Data Engineer to ensure we can leverage data effectively for analytics, reporting, and decision-making by building and maintaining a robust data infrastructure for enterprise-grade IT solutions of BASF Agricultural. The role involves both technical and leadership skills to drive efficient product delivery.

High-level objectives are as follows:

• Designing, building, and maintaining data pipelines and infrastructure
• Integrate data from various sources, ensuring data quality, manage data storage, and optimize performance.
• Communication and collaboration
• Ensure compliance.
• Stakeholder alignment
• Innovation

Responsibilities

• Design, build, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into data storage systems such as data warehouses or data lakes.
• Integrate data from different databases, applications, and external sources, ensuring data consistency and accuracy.
• Create and maintain data models, schemas, and structures that facilitate efficient data storage and retrieval.
• Transform and clean raw data to prepare it for analysis, including handling missing values, data normalization, and aggregation.
• Implement data quality checks, validation processes, and error handling to maintain high data quality standards.
• Administer and optimize databases, including performance tuning, indexing, and ensuring data security.
• Automate ETL processes and routine tasks to improve efficiency and reduce manual intervention.
• Continuously monitor data pipelines and infrastructure for performance issues, errors, and data anomalies. Troubleshoot and resolve issues promptly.
• Stay updated with the latest data engineering tools and technologies and evaluate their suitability for the organization's needs.

Qualifications

• Bachelor's Degree in Computer Science, Computer Engineering, Information Technology, or a business-technology related discipline
• Minimum 3-5 years of professional experience in IT and/or IT Consulting
• Experience in tools like Databricks, Azure Data Factory, Synapse, SQL Server
• Proficiency in Python and SQL
• Business Consulting and Technical Consulting skills
• Familiarity with Data Warehouse and Data Lake architecture concepts
• Design and implementation of ETL/ELT data pipelines

At BASF, we create chemistry for a sustainable future. We combine economic success with environmental protection and social responsibility. Around 112,000 employees in the BASF Group contribute to the success of our customers in nearly all sectors and almost every country in the world. Our portfolio comprises six segments: Chemicals, Materials, Industrial Solutions, Surface Technologies, Nutrition & Care, and Agricultural Solutions. BASF generated sales of €68.9 billion in 2023.

BASF is committed to empowering its employees to pursue their interests and explore emerging technologies. By investing in top-quality tools and promoting cross-functional collaboration, we encourage our team members to drive positive change within our organization. Come join us and be a part of our digitalization journey.

Further Information at https://go.basf.net/careers_digitalhubkl