Data Engineer

About Presight

Presight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region's leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of every scale, to create business and positive societal impact. Presight excels at all-source data interpretation to support insight-driven decision-making that shapes policy and creates safer, healthier, happier, and more sustainable societies. Today, through its range of GenAI-driven products and solutions, Presight is bringing Applied AI to the private and public sector, enabling them to realize their AI strategy and ambitions faster.

Overview
Role: Data Engineer
Location: Abu Dhabi

The Opportunity
Looking for an astute, proficient and qualified Data Engineer to assess, analyze and work with data concepts, use-cases & complex new data sources to provide business insights to customers and support the implementation & integration of the data sources into the Presight platform.

Responsibilities
The Data Engineer plays a critical role in the development of high-performance data solutions & information products at Presight.

1. The candidate is expected to have a solid background in software development with strong Python coding skills and solve challenging problems.
2. Web crawling, data cleaning, data annotation, data ingestion, and data processing.
3. Reading and collating complex data sets.
4. Creating and maintaining data pipelines.
5. Continual focus on process improvement to drive efficiency and productivity within the team.
6. Use of Python, SQL, Shell, etc. to build the infrastructure required for optimal extraction, transformation, and loading of data.
7. Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline.
8. Support the wider business with their data needs on an ad hoc basis.
9. Comply with QHSE (Quality Health Safety and Environment), Business Continuity, Information Security, Privacy, Risk, Compliance Management and Governance of Organizations policies, procedures, plans, and related risk assessments.

Requirements

Qualifications

1. Bachelor's degree in computer engineering, Computer Science, or Electrical Engineering and Computer Sciences.
2. 3+ years of programming experience, solid coding skills in SQL, Python, Shell, Java, Scala (optional).
3. Understanding of data warehouse architecture, including ETL/ELT workflows, data pipeline design for structured and semi-structured data, and experience with modern solutions like Snowflake, BigQuery, and Amazon Redshift.
4. Proficient in batch data processing with tools like Apache Airflow or Luigi, and knowledgeable about real-time processing workflows and low-latency data system challenges.
5. Expertise in writing efficient SQL queries, optimizing database performance, and using relational databases like Oracle, PostgreSQL, ClickHouse, and DuckDB, with knowledge of advanced SQL features such as window functions, CTEs, and partitioning.
6. Familiarity with NoSQL databases like ElasticSearch, Redis, and document-oriented databases (e.g., MongoDB).
7. Proficient in Python for data engineering with libraries like Pandas, PySpark, and Dask; experienced in big data and MPP frameworks such as Apache Spark, with skills in optimizing and debugging distributed data processing jobs.
8. Understanding of data modeling principles, including dimensional modeling, SCD handling, surrogate key generation, and designing schemas for analytical workloads with complex hierarchies.
9. Familiarity with BI tools like Power BI, Tableau, Apache Superset, or Looker. Experience in integrating BI tools with data warehouses or other data sources.
10. Knowledge of best practices for data security, including encryption, access control, and IAM policies.

Ideally, you'll also need

1. Strong analytical and data visualization skills.
2. In-depth market and domain knowledge.
3. An innovative and creative approach to problem-solving.
4. Excellent communication and presentation skills.

What We Look For
If you are a performance-driven, inquisitive mind with the agility to adapt to ambiguity, you will fit right in. You should be eager to explore opportunities to build meaningful collaborations with stakeholders and aspire to create unique customer-centric solutions. Bias for action and a passion to conquer new frontiers in the AI space is at the heart of the Presight community.

What Working At Presight Offers

Culture: An open, diverse, and inclusive environment with a global vision that encourages personal growth and focuses on ground-breaking, industry-first innovations.
Career: Outstanding learning, development & growth opportunities via structured training programs and innovative, high-tech projects.
Rewards: A competitive remuneration package with a host of perks including healthcare, education support, leave benefits and more.