Senior Data Engineer

About DeepLight

DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI research and development.

Position Overview

DeepLight is seeking a skilled Senior Data Engineer to join our advanced data engineering team in the UAE. In this role, you will leverage your extensive experience to design and implement robust data architectures and frameworks that support the development of our cutting-edge AI models. As a Senior Data Engineer, you will be instrumental in optimizing data processes and ensuring the integrity and availability of critical data across the organization.

Requirements

1. Data Architecture Development: Lead the design and implementation of scalable data architectures that align with business needs and technical requirements, ensuring optimal data flow and storage solutions.
2. Advanced ETL Management: Create and optimize complex ETL processes, using a variety of tools and technologies to efficiently extract, transform, and load data from diverse sources.
3. Data Quality Assurance: Establish and enforce data quality standards and testing protocols to ensure the accuracy, consistency, and reliability of data across the organization.
4. Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of learning and knowledge sharing within the team.
5. Collaboration: Work closely with data scientists, analysts, and other stakeholders to define data requirements and support the development of machine learning models and data-driven applications.
6. Performance Tuning: Monitor and optimize data processing workflows to ensure maximum efficiency and performance, applying best practices in database management and query optimization.
7. Documentation and Reporting: Document data architecture, processes, and operational procedures, while providing regular updates to stakeholders regarding data initiatives and project status.

Qualifications:

1. Proven experience as a Data Engineer, with a minimum of 5 years of experience in designing and building large-scale data systems.
2. Expertise in data modeling and ETL processes, with strong proficiency in SQL and at least one programming language (e.g., Python, Java).
3. In-depth experience with big data technologies such as Hadoop, Spark, and streaming technologies like Kafka, as well as cloud platforms (e.g., AWS, Azure, GCP).
4. Solid understanding of data warehousing concepts and experience implementing and managing data warehouses or data lakes.
5. Knowledge of containerization and orchestration technologies, such as Docker and Kubernetes, and familiarity with CI/CD methodologies.
6. Strong analytical, problem-solving, and communication skills, with a proven ability to collaborate with cross-functional teams.
7. A passion for innovation and continuous improvement in the field of data engineering and artificial intelligence.

Benefits

Why Join DeepLight?

1. Impact: Be part of a dynamic team that is shaping the future of AI and making a meaningful impact on industries and society.
2. Innovation: Work on cutting-edge projects at the intersection of AI, data engineering, and machine learning, leveraging the latest technologies and methodologies.
3. Collaboration: Collaborate with a diverse team of experts from various disciplines, fostering creativity, learning, and growth.
4. Opportunity: Enjoy ample opportunities for professional development, career advancement, and leadership roles in a rapidly growing company.
5. Culture: Join a culture of curiosity, excellence, and collaboration, where your ideas are valued, and your contributions are recognized and rewarded.

If you are passionate about data engineering, AI, and innovation, and you thrive in a dynamic and collaborative environment, we want to hear from you! Apply now to join DeepLight and be part of our journey to unlock the potential of AI for a brighter future.