Senior Specialist, Data Engineer

Job Description

Purpose: The position will be part of the Enterprise Architecture & Delivery Team to deliver the data management capabilities.

Key Roles and Responsibilities

1. The key responsibility of a Data Engineer will be to help build the data platform and capabilities for the organization along with the lead data engineer.
2. Performs thorough code reviews of fellow developers and ensures quality code.
3. Automating manual processes, optimizing data delivery.
4. Create and maintain comprehensive documentation.
5. Assumes responsibility for solving problems.
6. Communicate effectively across all levels, engaging and inspiring at senior levels internally and externally.
7. Cultural awareness within a multi-cultural corporate environment.

Functional Competencies

1. Data Ingestion / Data Warehouse development.
2. Implementing data ingestion pipelines using Azure Data Ingestion Tools like Azure Data Factory, Azure Data Bricks etc.
3. Experience in developing solutions using Scala Scripting, Python, Pyspark, and Spark SQL with Data bricks.
4. Experience Integrating the End-to-End Data Pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data.
5. Working within Agile delivery and DevOps methodologies to deliver proof of concept and production implementation in iterative sprints.
6. Monitoring performance and optimization of data ingestion and reports.
7. Working with Event based technologies to ingest and process real-time data.
8. Experience in working with real-time big data processing.
9. Experience in Working with Data analytics tools like Power BI, Tableau etc.

Behavioral Competencies

1. Motivate staff and create a space where they can ask questions and voice their concerns in a transparent fashion.
2. Develop productive relationships with business leaders across the organization to influence how applications can enable new sources of value.
3. Cooperation/Teamwork: Works harmoniously with others to get a job done; responds positively to instructions and procedures; able to work well with staff, co-workers, peers and managers; shares critical information with everyone involved in a project; works effectively on projects that cross functional lines; helps set a tone of cooperation within the work group and across groups; coordinates own work with others; seeks opinions; values working relationships; when appropriate facilitates discussion before decision-making process is complete.
4. Judgment: Makes sound decisions; bases decisions on fact rather than emotion; analyses problems skilfully; uses logic to reach solutions.
5. Problem Solving: Anticipates problems; sees how a problem and its solution will affect other units; gathers information before making decisions; weighs alternatives against objectives and arrives at reasonable decisions; adapts well to changing priorities, deadlines and directions; works to eliminate all processes which do not add value; is willing to take action, even under pressure, criticism or tight deadlines; takes informed risks; recognizes and accurately evaluates the signs of a problem; analyses current procedures for possible improvements; notifies supervisor of problems in a timely manner.

Qualifications

Education: An undergraduate or postgraduate degree in computer science, engineering or a related field or similar knowledge.

Experience: 6+ years of experience in software development and 3+ years of experience in data ingestion / data warehouse development.

Additional Information

Organizational Competencies:

1. Customer Focus: People demonstrating this competency understand & exceed our customers' needs. They develop trusted, reliable & collaborative relationships. They are consistently operating to the highest standards of service & delivery.
2. Innovation: People demonstrating this competency constantly seek new & improved ways to deliver our products & services. They champion engineering & skills development, and work to create a collaborative and supportive operating environment.
3. Integrity: People demonstrating this competency are open & honest in everything they do. They support financially & environmentally sustainable growth. They make socially responsible decisions and treat their stakeholders with respect.
4. Be Bold: People demonstrating this competency are thorough in analyses & decision-making. They are courageous in expanding existing markets & developing new ones. They confidently pursue appropriate financial returns and are forward-thinking and ambitious.
5. Sustainability: People demonstrating this competency are constantly seeking to create a positive impact in the communities we serve.

Our Vision

IHS is committed to improving the quality and availability of telecommunications infrastructure, the lifeline for an increasingly connected world. We are dedicated to helping create a sustainable future for the communities in which we operate, and our sustainable strategy is structured around four pillars: ethics and governance, environment and climate change, education and economic growth, and our people and communities.