Solution Engineer (Data)

Ready to embark on this thrilling journey? Apply now and let's revolutionize the economic and technology landscape together!

About Copious (www.goCopious.com)

We're Copious. At Copious, we believe in People, Knowledge, and Solutions. We believe that when you bring those three things together, you can create something truly valuable. That's why we bring together engaged talents to provide high-value technology services that help our consultants and clients succeed.

Copious is a Talent & Technology services company dedicated to helping businesses grow. Since 2014, we've been partnering with our talents and clients to create Career and Business solutions for the Peoples in the business and technology ecosystem.

We're here to help you thrive in today's fast-paced world of work. We offer API Test Automation, Salesforce Services, Business Intelligence & Analytics, SAP Services, and Talent Solutions Services. We are present in South Africa, India, Singapore & soon in UAE.

Why Work with Us

• Better income structure for more take-home.
• Team get-togethers & workation trips.
• Work on the latest Tech Stacks with a choice from many clients.
• Up-skilling & re-skilling.
• A dedicated account manager is assigned who works closely with your engagement.

About Clients

Imagine working with industry-leading customers who are changing the game and disrupting the landscape in sectors like Finance, Insurance, Banking, and Retail. At Copious, we bring together the brightest minds to collaborate on groundbreaking projects that shape the future.

Role

As a Solution Engineer in the Data vertical, you will be expected to design, implement, and manage data solutions on the Microsoft Azure cloud platform. You will be in charge of creating and maintaining data pipelines, data storage solutions, data processing, and data integration to enable data-driven decision-making inside a company.

Responsibilities

• Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
• Work together with data teams and analysts to understand the needs for data and create effective data workflows.
• Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
• Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.
• Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
• Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
• Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.

Requirements

• Minimum 5+ years of experience in Data Engineering.
• Expert database knowledge in SQL and experience with MS Azure tools such as Data Factory, Synapse Analytics, Data Lake, Databricks, Pyspark, Azure Stream Analytics, and PowerBI.
• Modern Azure data warehouse skills.
• Expert Unix/Linux admin experience including shell script development.
• Experience working on large and complex datasets.
• Understanding and application of Big Data and distributed computing principles (Hadoop and MapReduce).
• ML model optimization skills in a production environment.
• Production environment: machine learning and AI.
• DevOps/DataOps and CI/CD experience.

Qualification & Certifications

Bachelor's degree in Computer Science or BCA or MCA or a related tech education.