We are looking for a Sr. Data Engineer to join our data team. If you accept this challenge you will be part of a group of passionate people investigating the potential of generative AI and multimodal models to detect fake news. You will work alongside data scientists, ML ops, engineers and fact-checkers in the design of a new generation of intelligent systems capable of verifying information automatically.
Your mission will be to help build the data pipelines, microservices and information architecture that support the intelligent agents we are developing to fight fake news.
Are you decisive and dynamic? Do you like to solve unsolved problems? Do you want to do something to improve society? This is your place.
Requirements
At least 5 years experience building production-quality software.
Bachelors or Masters degree and / or equivalent professional experience
Experience building end-to-end systems as a Platform Engineer, ML DevOps Engineer, or Data Engineer (or equivalent)
Development of API endpoints for data applications, with Python (FastAPI) or Typescript (Nest.js)
Design, deploy and maintain SQL (MariaDB) and NoSQL (MongoDB) databases, including schema and table definition
Knowledge of stream event data architecture (Apache Kafka, RabbitMQ, NATS, etc)
Development of CI / CD pipelines
Design, development, testing, deployment and maintenance of ETL / ELT pipelines
Experience deploying and managing cloud services on AWS, GCP or Azure
Design and implementation of vector databases (Pinecone, ElasticSearch, FAISS)
Knowledge of techniques of data quality and governance
Experience developing and maintaining ML systems built with open source tools
Familiarity with one or more data-oriented workflow orchestration frameworks (KubeFlow, Prefect, Airflow, Argo, etc.)
Exposure to deep learning approaches and modeling frameworks (PyTorch, Tensorflow, Keras, etc.)
What we offer?
Competitive salary: 50-80K € based on your expertise in required technologies.
Fully remote work
Other perks: career path, off-sites in different cities, cobee card...
Obtenga la revisión gratuita y confidencial de su currículum.