Search - Extract & Transform - Senior Software Engineer

Elasticsearch B.V.; London; Remote; USD 60,000 - 100,000

Job description

Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to enable everyone to accelerate the results that matter. By taking advantage of all structured and unstructured data — securing and protecting private information more effectively — Elastic’s complete, cloud-based solutions for search, security, and observability help organizations deliver on the promise of AI.

What is the Role

We are looking for a Senior Software Engineer to join our Elasticsearch - Extract and Transformation team. You'll be working collaboratively in a distributed working environment delivering valuable features for the Elastic Search solution. We’re seeking a versatile software engineer and communicator to help push the product and team to new heights. The team is responsible for data ingestion from a wide range of content sources and our web crawler. We are extending our charter to adopt this data into more GenAI use cases.

What You Will Be Doing:

• Contributing to the development of large-scale extraction and transformation applications, ideally using multi modal data in an LLM context.
• Architect, optimize, and maintain pipelines for processing and analyzing various data, including PDF, HTML, and image formats.
• You will collaborate with and mentor international teammates in a mostly text-based, asynchronous, remote-first team environment with occasional video calls and yearly conferences. You’ll be hands-on with the team and codebase, reviewing work and providing constructive feedback.
• You will collaborate with the team on features, breaking them down into technical deliverables. You’ll act as an important and communicative part of an engaged and spirited team, working with data scientists and product teams to integrate AI-driven solutions.

What You Will Bring:

• We appreciate articulate and “low ego” people who want to grow as part of a team.
• Experience building software using Ruby and/or Python.
• Previous experience building and maintaining ETL pipelines and processes.
• Previous experience with operational components of modern web applications including asynchronous job queues, daemonized services, and CI/CD pipelines.
• Previous experience with open source.
• Excellent practical judgment. You know how to prioritize, when to collaborate and ask for help, and when to be independent.
• Measured and articulated written and spoken communication skills. You work well with others and can craft concise and expressive thoughts into correspondence: issues, investigations, documentation, and onboarding material.
• An interest in learning new tools, languages, workflows, and philosophies that can help you grow. You can function well in an environment that drives towards change.
• Experience with multi-modal data, including formats like PDF, HTML, Word docs. Also, general knowledge of tooling and transformer architecture around LLMs.
• Knowledge of authentication and authorization in general is a plus, especially around OAuth flows.

If this sounds interesting, we would love to hear from you! Please include whatever info you believe is relevant: resume, GitHub profile, code samples, blog posts and writing samples, links to personal projects, etc.

Additional Information - We Take Care of Our People

As a distributed company, diversity drives our identity. Whether you’re looking to launch a new career or grow an existing one, Elastic is the type of company where you can balance great work with great life. Your age is only a number. It doesn’t matter if you’re just out of college or your children are; we need you for what you can do.

We strive to have parity of benefits across regions and while regulations differ from place to place, we believe taking care of our people is the right thing to do.

• Competitive pay based on the work you do here and not your previous salary.
• Health coverage for you and your family in many locations.
• Ability to craft your calendar with flexible locations and schedules for many roles.
• Generous number of vacation days each year.
• Increase your impact - We match up to $2000 (or local currency equivalent) for financial donations and service.
• Up to 40 hours each year to use toward volunteer projects you love.
• Embracing parenthood with minimum of 16 weeks of parental leave.

Different people approach problems differently. We need that. Elastic is an equal opportunity/affirmative action employer committed to diversity, equity, and inclusion. Qualified applicants will receive consideration for employment without regard to race, ethnicity, color, religion, sex, pregnancy, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, disability status, or any other basis protected by federal, state or local law, ordinance or regulation.

We welcome individuals with disabilities and strive to create an accessible and inclusive experience for all individuals. To request an accommodation during the application or the recruiting process, please email [e-mail]. We will reply to your request within 24 business hours of submission.