Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics

ZipRecruiter; Wakefield; Hybrid; GBP 80,000 - 100,000

Job description

Job Description

Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics

C-4 Analytics is a fast-growing, private, full-service digital marketing company that excels at helping automotive dealerships increase sales, increase market share, and lower cost per acquisition. C-4 Analytics is committed to developing innovative solutions for every dealer in every market, and to providing the highest levels of accountability and customer service. We are currently hiring for a Senior Data Engineer as we look to expand our team and support our growing roster of local and clients.

Who We're Looking For: Senior Data Engineer

Data Alchemy: Forging Insights from Information C-4 Analytics is looking for an Experienced Senior Data Engineer with expertise in data infrastructure and architecture to help shape the future of our data-driven digital marketing platforms. As a member of our growing AI team, you’ll play a critical role in the orchestration of Intelligent Systems. Working with AI related orchestration and data pipeline technologies to turn information into insights using multiple platforms.

We're not just processing data—we're transforming it into organizational intelligence. As our Data Engineering Virtuoso, you'll build enterprise grade AI pipelines turning unstructured data into decision-making gold by creating intelligent data platforms at scale.

Illuminate the Future of Marketing Intelligence

The ideal candidate will have a strong background in ETL/ELT pipelines, data warehouse connectivity, data cleaning, normalization, database architecture, database optimization, and orchestration processes. This role will be responsible for orchestrating and delivering enterprise-grade AI pipelines. Connecting disparate data sources to Snowflake (our data warehouse), ensuring the cleanliness and normalization of data, and implementing database architecture best practices.

Your Canvas

• Prototype the Impossible: Design, develop and maintain proof-of-concepts using cutting-edge technologies, then refine them into production-ready solutions.
• Empower Through Innovation: Craft intuitive tools that elevate data scientists and analysts to their highest potential. Collaborate with cross-functional teams to ensure that data storage and organization align with business needs and objectives.
• Seamless Scaling & Performance Optimization: Implement database architecture best practices, including database sharding, replication strategies, indexing, and optimization techniques to enhance data performance.
• Compose Data Symphonies: Orchestrate enterprise-grade AI pipelines for complex data flows that bring harmony to disparate sources through batch and streaming pipelines. Evaluate and optimize data storage and retrieval systems based on relationships, data access patterns, cost-effectiveness, and performance requirements.
• Blueprint Before Building: Design elegant solutions and document your vision so others can follow your path. Provide leadership and guidance on information architecture decisions, ensuring that data is stored, organized, and accessed in the most efficient and effective manner.

Your Toolkit

• The You Speak: Python, SQL, the dialect of data.
• Libraries | Tools: Terraform, Flask, Pandas, FastAPI, Dagster, GraphQL, SQLAlchemy, GitLab, Athena.
• Your Trusted Companions: Docker, Snowflake, MongoDB, Relational Databases (e.g., MySQL, PostgreSQL), Dagster, Airflow/Luigi, Spark, Kubernetes.
• Your AWS Kingdom: Lambda, Redshift, EC2, ELB, IAM, RDS, Route53, S3—the building blocks of cloud mastery.
• Your Philosophy: Continuous integration/deployments (CI/CD) automation, rigorous code reviews, documentation as communication.

Qualifications

• Familiar with data manipulation and experience with Python libraries like Flask, FastAPI, Pandas, PySpark, PyTorch.
• Proficiency in statistics and/or machine learning libraries like NumPy, matplotlib, seaborn, scikit-learn.
• Experience in building ETL/ELT processes and data pipelines with platforms like Airflow, Dagster, or Luigi.

What's important for us:

• Academically Grounded: Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
• Seasoned Practitioner: 5+ years of experience in data engineering, with a focus on data infrastructure, architecture, and database management.
• Code Craftsperson: Fluent in Python and SQL, expressing complex logic with elegant simplicity.
• Database Strategist: Understanding when to deploy relational, vector, graph, or document data models. Strong understanding of database architecture principles, including sharding, replication, indexing, and optimization techniques.
• Data Driven: Proficiency in designing and developing ETL/ELT pipelines for data integration and transformation.
• Cloud Navigator: Confidently guiding projects through the AWS ecosystem and hands-on experience with Snowflake or similar cloud-based data warehouse platforms.
• Dynamic Collaborator: Adept Problem-Solver with keen attention to detail. Excellent problem-solving skills, attention to detail, and the ability to work in a fast-paced, collaborative environment.
• Infrastructure Poet: Expressing infrastructure needs as clear, reproducible code. Packaging or containerizing applications for consistency across environments. Knowledge of information architecture best practices, data modeling, and data governance.
• Question Seeker: Finding the right questions that others haven't thought to ask.

Brownie Points

• Visualization Artist: Creating compelling visual narratives from complex data patterns.
• Statistical Thinker: Grounding engineering decisions in mathematical rigor.
• Framework Explorer: Experience with web frameworks that extend data's utility.
• Security Mindful: Navigating enterprise security with confidence and care.

Flexibility:

The Senior Data Engineer may benefit from the flexibility to work in a way that suits them best. We offer the following working options:

• Office-Based: Our modern and well-equipped office space provides a collaborative environment where you can work closely with your team, engage in face-to-face interactions, and foster a sense of community.
• Remote: We understand that some individuals thrive in a remote working setup. As such, we support remote work arrangements, allowing you to work from the comfort of your own home or any location that enhances your productivity.
• Hybrid: For those who prefer a balance between office and remote work, we offer a hybrid model. This allows you to divide your time between working in the office and remotely, providing the best of both worlds.

Working at C-4 Analytics

We provide our employees with a range of benefits, including career development programs, unlimited paid time off, and additional perks. All are welcome to visit our careers and culture page for more details.

More About C-4 Analytics

C-4 Analytics takes the guesswork out of advertising. We don’t over-promise: we over-deliver. We provide real value to our clients because we really value them as partners. We love Google and Facebook, but also love Instagram and Bing. We innovate, educate and instigate. We are forward-thinking, but we learn from the past. We are results-driven and our strategies drive results. We are team players, but we love to crush our competitors. We create an environment of respect and we respect the environment. We are the brains and the good looks. We are very humble. We are nerds, but cool, likable nerds. We are never gonna give you up. Never gonna let you down. We are all work and all play.