Senior Data Engineer (Java)

Company Description

We are seeking a talented Data Engineer who is eager to learn and wants to join our experienced team. This opportunity is for you if you want to work with a tightly knit team of Data Engineers solving challenging problems using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud.

Sounds interesting? Keep reading!

CUSTOMER

Our client has top-tier end-to-end technology, a premium marketplace, and best-in-market advisory services that power the advertising businesses of the world’s largest media and entertainment companies, including Fox, NBC Universal, Viacom in the USA, Sky, Channel 4, RTE, and Mediaset in Europe.

PROJECT

We invite you to work with the provider of comprehensive ad platforms for publishers, advertisers, and media buyers. We build and support high-quality data solutions to process terabytes of data on AWS’s cloud-native data platform.

Job Description

• Hands-on development of ETL pipelines
• Modify existing application code, interfaces, or develop new application components
• Analyze requirements, support design, develop code, test, debug, deploy, and maintain programs and interfaces. Proper documentation of work is essential
• Develop and implement databases, data collection systems, data analytics, and other strategies that optimize statistical efficiency and quality
• Conduct code and design reviews to ensure the product quality remains high
• Mentor and provide guidance to colleagues and new team members
• Collaborate with the Data Engineers and Product Managers to prioritize business needs and translate complex product requirements into working high-quality, cloud-native data solutions
• Share knowledge with wider engineering teams by doing technical demos

Qualifications

• 5+ years of hands-on experience in software development and data engineering
• Excellent knowledge of Java
• Production experience with Databricks and Spark
• Experience in building and maintaining an enterprise Data Lakes and/or Data Warehouses (preferably Snowflake)
• Strong SQL skills and proven experience working with major database platforms
• Understanding of AWS (IAM, S3, Security Groups) and Kubernetes
• Must be versatile and an inquisitive problem solver
• Excellent communication and writing skills
• At least an Upper-Intermediate level of English

Would be a plus:

• Experience with Python and Scala
• Experience with Apache Airflow
• Experience with Flink