Data Engineer - ICDM

COMPANY DESCRIPTION

Beyondsoft International (Singapore) Pte. Ltd. was set up in 2007 and established as the regional headquarters for the Southeast Asia (SEA) and European markets in September 2015. Based on our vision of "Using technology to promote social progress, economic development and become a global customer preferred partner" and our concept of "Beyond your expectations", Beyondsoft is committed to provide our customers in countries along the "Belt and Road" with comprehensive solutions and products and creating commercial value for customers to realizing continuous businesses development.

Our core business includes:

1. IT development services providing customers with IT consulting, software research and development, software and hardware testing, system integration and operation and maintenance, data analysis and other services;
2. New retail solutions and products through intelligent products, helping small and medium-sized enterprises (SMEs) realize the digital transformation of their daily operations;
3. Internet of Things (IoT) platform and solutions comprehensive use of IoT, artificial intelligence, big data, cloud computing and other technologies to provide IoT solutions for intelligent upgrades in cities, parks, buildings and industries, to create a smart future.

RESPONSIBILITIES

• Develop, maintain, and optimize scalable data pipelines and ETL/ELT workflows.
• Ensure high maintainability of code through unit and integration testing.
• Collaborate with analytics, data science, and business teams to understand data requirements and ensure timely delivery.
• Automate deployment processes, pipeline monitoring, and alerting to ensure high availability and reliability.
• Optimize data storage, processing performance, and troubleshoot data-related issues.
• Implement best practices for data security, quality, and governance.

QUALIFICATIONS

• Bachelor’s degree in computer science, Engineering, or a related field.
• Minimum 5 years of experience as a Data Engineer, with a focus on building pipelines and configurations.
• Strong understanding of data modeling concepts and able to design various components of data model and data engineering solution.
• Proven experience in building and testing data pipelines, with a solid foundation in unit and integration testing.
• Hands-on experience with AWS and Kubernetes for cloud-based and containerized deployments.
• Experience working with data warehouses such as Snowflake, Apache Spark, or Hive, and orchestration tools like Apache Airflow, Dagster, or Prefect.
• Strong analytical and problem-solving skills.
• Comfortable with DevOps practices, GitHub workflows, CI/CD pipelines, and Agile development methodologies.