Principal Engineer - Distributed Data Processing System

Social network you want to login/join with:

Location:

Markham, Canada

Job Category:

Information Technology

Job Reference:

86u31lmb

Job Views:

Posted:

Expiry Date:

06.05.2025

Job Description:

Huawei Canada has an immediate permanent opening for a Principal Engineer.

About the team:

Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation center in Canada. The lab focuses on researching and developing advanced cloud technologies, supporting the productization and iterative optimization of its technical achievements. Current research areas include cloud native databases, infrastructure resource scheduling and prediction, cloud-native middleware, media engines, and user experience studies. The lab fosters a robust technical environment, allowing collaboration with industry experts to create a highly competitive cloud platform.

About the job:

• Work with a team of architects and engineers to develop proof-of-concept distributed systems and product components.
• Investigate and design data processing systems focusing on extra-large volume data for real-time streaming, based distributed systems with the latest and state of the art hardware technology.
• Continuous enhancements on the AI-native data analysis system to fulfill customer requirements utilizing AI techniques for public cloud capacity management and scheduling.

About the ideal candidate:

• Master's or Ph.D. in Computer Science, Computer Engineering, or Applied Mathematics.
• 5+ years of working experience in distributed data processing systems.
• High proficiency with Java and Golang; must be able to write strong, clean, brand-new code.
• Deep understanding of fundamental concepts such as distributed data processing, distributed database/storage systems, file systems, and memory allocation/cache systems, like Kafka and Flink.
• Ability to clearly articulate technical concepts and challenges.
• Highly analytical with strong problem-solving skills; self-motivated with a proven ability to learn and take initiative.
• Experience with Linux system-level development, distributed systems, or scheduling algorithms is an asset.