Research Engineer, Foundational Research

The Rundown AI, Inc.; London; On-site; USD 114,000 - 300,000

Job description

About Us

Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

The Role

Key Responsibilities:

Our team develops the next generation of theoretically-founded methods for LLMs and generative AI. We are hiring a research/software engineer.

We work on large-scale sequence modeling (e.g. language modeling and LLMs) to improve the quality and efficiency of current state-of-the-art techniques. We are looking for an engineer who can collaborate with researchers to develop and run experiments, helping to bring innovative ideas to reality. For this role a low-level understanding of common XLA primitives and how jax code runs on TPUs in practice is highly beneficial.

The ideal candidate is willing to roll up sleeves to work across the LLM stack (pretraining, finetuning, serving) to deliver strong results.

Experience in any of these is highly beneficial:

• Natural Language Processing/Understanding
• Multimodal Understanding
• LLM serving

About You

We seek out individuals who thrive in ambiguity and who are willing to help out with whatever moves prototypes forward. We regularly need to invent novel solutions to problems, and often change course if our ideas don’t work out, so flexibility and adaptability to work on any project is a must.

In order to set you up for success as a Research Engineer at Google DeepMind, we look for the following skills and experience:

BSc degree in computer science or a related STEM field

• Proven knowledge and experience in Python
• Proven experience with JAX or PyTorch
• Excellent familiarity with deep neural networks and LLMs
• Strong mathematical skills, ability to understand theoretical research in ML
• Excellent team working and communication ability
• Knowledge of machine learning and statistics
• Proven experience working with Large Language Models (LLMs)
• Knowledge of algorithm design
• Recent experience conducting applied research to improve the quality and training/serving efficiency of large transformer-based models highly desirable
• Experience fine-tuning large models (e.g. supervised, RLHF)
• Experience applying and productionizing state-of-the-art large visual, language and multimodal research highly desirable
• Software Engineering experience and experience working on large-scale ML projects highly desirable
• Proven experience working in industry, working on projects from proof-of-concept through to implementation highly beneficial
• A passion for Artificial Intelligence
• Great communication skills and proven interpersonal skills

In addition, the following would be an advantage:

• Experience in applying experimental ideas to applied problems
• Cross functional collaboration experience
• Prior experience collaborating with researchers
• Prior experience working with product teams

What we offer

At Google DeepMind, we want employees and their families to live happier and healthier lives, both in and out of work, and our benefits reflect that. Some select benefits we offer: enhanced maternity, paternity, adoption, and shared parental leave, private medical and dental insurance for yourself and any dependents, and flexible working options. We strive to continually improve our working environment, and provide you with excellent facilities such as healthy food, an on-site gym, faith rooms, terraces etc.

We value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunities regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.

The US base salary range for this full-time position is between $114,000 - $300,000 + bonus + equity + benefits. Your recruiter can share more about the specific salary range for your targeted location during the hiring process.