AIML - Software Engineer, MLSEE

High-quality software and complex ML models require dynamic and sophisticated automation to evaluate them. The ML Systems Evaluation Engineering (ML SEE) team, within the AI/ML org at Apple, is looking for an exceptional Software Engineer to evaluate our Apple Intelligence based systems and deliver the best experience for our customers across the world. This exciting role will bridge knowledge and experience from software engineering to the ML world, combining the best of both to build robust, extensible, and efficient systems to evaluate ML products at scale.

In this role, you will have the opportunity to shape the vision of end-to-end automated systems evaluation methodology for all Siri supported languages. You will influence the design of Apple Intelligence ML products and ensure it is flexible to evaluate them at scale through high levels of automation. You will operate in a highly cross-functional environment to keep pushing the boundaries of existing tests automation and ML evaluation. If you are committed to delivering a first-class customer experience and are a skilled and passionate software engineer, this role will give you an exciting opportunity to apply your expertise to an entirely new problem space.

Description

In this role, you will be part of a team of software and ML engineers to design and develop solutions to perform automated end-to-end functional evaluation for all Siri supported languages. This includes the design of automation frameworks and methodologies for simulation and evaluation of user experiences for ML-based products at scale. You will be a technology evangelist ensuring best practices for software development are followed in the team. The role spans from AIML product qualification, implementation, and iteration on systems, frameworks, and evaluation methodologies, defining and tracking user impact and user success metrics. Equally, this role will participate in the AIML product-specific roadmap decisions, contributing insights and recommendations derived from the in-depth understanding of the current success metrics of AIML products.

Minimum Qualifications

• Extensive experience as a Software Developer using programming languages like Swift and/or Objective-C
• Experience developing tests using the XCTest framework
• Proven ability architecting, designing, and implementing scalable software solutions.
• Project and technical leadership: lead projects from architecture to deployment and scaling.

Preferred Qualifications

• Experience in developing applications within the Apple ecosystem
• Proven experience in Java and Python
• Solid experience with CI/CD and DevOps best practices.
• Experience in AWS, Azure, or GCP infrastructure and cloud services.
• AI/ML knowledge. Good understanding of machine learning concepts.