AWS Data Engineer

Overview

Adastra is hiring and expanding the AWS Practice! We are looking for a highly skilled AWS Data Engineer who will be responsible for building and maintaining our data pipelines, ensuring the efficient and reliable extraction, transformation, and loading (ETL) of large datasets. The ideal candidate will have a strong background in cloud-based data engineering, particularly within the AWS ecosystem, and will be passionate about data-driven decision-making.

Location: Calgary (AB), or willing to relocate

Status: Full-Time or Contract (Long-Term)

Responsibilities:

• Design, develop, and maintain scalable ETL pipelines using AWS services such as Glue, Lambda, S3, and Redshift
• Develop and optimize complex SQL queries for data transformation, validation, and reporting
• Utilize Python for data processing, automation, and scripting within ETL workflows
• Work with Databricks to develop, optimize, and scale data pipelines and analytics solutions
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data availability and integrity
• Implement and optimize data storage solutions, including data lakes and data warehouses, to support analytics and reporting
• Monitor and troubleshoot data pipelines to ensure continuous and reliable data flow
• Ensure data security and compliance with industry standards and best practices
• Automate data integration and processing tasks using AWS tools like Step Functions, CloudFormation, and others
• Document data flows, data models, and processes for internal use and future reference
• Stay updated with the latest trends and best practices in data engineering and AWS technologies

Qualifications, Skills & Experience:

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. A Master's degree is a plus
• 3+ years of experience in data engineering
• Extensive hands-on experience working with Databricks, including:
• the development, optimization, and management of data pipelines
• for advanced data analysis workflows
• Strong experience with AWS services such as S3, Glue, Lambda, Redshift, DynamoDB, and Athena
• Proficiency in programming languages such as Python, Java, or Scala
• Experience with SQL and NoSQL databases
• Solid understanding of data warehousing principles, ETL workflows, and data modeling techniques
• Knowledge of data security, governance, and compliance best practices
• Strong problem-solving skills and attention to detail
• Excellent communication skills, with the ability to collaborate effectively with cross-functional teams

Nice to Have:

• AWS Certified Data Engineer, or AWS Certified Data Analytics, or AWS Certified Solutions Architect
• Experience with big data tools and technologies like Apache Spark, Hadoop, and Kafka
• Knowledge of CI/CD pipelines and automation tools such as Jenkins or GitLab CI

About Adastra

For more than 20 years, Adastra Corporation has been hyper-focused on data and the infrastructures to support it. We are an international consulting company working with businesses and IT Leaders to extract value through data and analytic solutions in the domains of Cloud, Data Management, Analytics, AI and ML, Governance, Hyper Automation, and Enterprise Application Development. Our team of experts, combined with our world-class data management platform, helps provide trusted insights, establish frameworks, enforce best practices, and streamline processes for around-the-clock global coverage. Adastra has a proven track record of helping organizations of all sizes – from SMEs to Fortune 1000s – achieve their data transformation goals, whether that be accelerating innovation, improving operational excellence, or creating unforgettable customer experiences.

What We Offer

• Opportunity for advancement and career progression
• Competitive compensation package
• Comprehensive benefits plan
• Successful referral program
• Satisfaction of working for a reputable company
• A flexible, dynamic, and diverse workplace

Equal Opportunity Employer

In our commitment to promote fair and equitable treatment of all employees and applicants, Adastra Corporation provides equal employment opportunities for all individuals regardless of age, sex, disability, race, ethnic origin, citizenship, creed, sexual orientation, marital status, or any other ground as described in the Ontario Human Rights Code. In addition, accommodation will be provided during the hiring process. Adastra Corporation’s implementation and support of employment initiatives encourage diversified labour force participation and equal access to opportunities based on merit and performance.