My Shortlist

Your shortlisted jobs will appear here. To view your shortlist: Login Or Register

Date Added: Wed 01/01/2025

Data Engineer

London, UK
Apply Now

Company: HARNHAM - DATA & ANALYTICS RECRUITMENT

Job Type: Permanent, FullTime

Salary: £70,000 - £75,000 per annum

Data Engineer Opportunity - Join an Exciting Team!

Are you an experienced Data Engineer looking to make an impact? We're searching for a talented professional to help shape the future of data systems at a forward-thinking and flexible organization. If you're passionate about data architecture, cloud solutions, and building scalable systems, this could be the role for you!

Company

Our client is a dynamic and innovative company with a clear mission: empowering people with tailored insurance solutions. Using cutting-edge technology and a customer-focused approach, they've built a reputation for delivering personalized, high-quality service.

Responsibilities

As a Data Engineer, you'll play a crucial role in designing and maintaining cutting-edge data systems. Key duties include:

  • Building custom data systems for collecting, processing, and provisioning data from various sources.
  • Developing and managing Terraform modules for scalable, secure infrastructure.
  • Collaborating with DevOps to integrate CI/CD pipelines.
  • Assisting with integrating data solutions into existing workflows, including Airflow and DBT pipelines.
  • Supporting stakeholders like data scientists and analysts to deliver high-impact data products.
Experience Needed

We're seeking candidates with the following skills and experience:

Must-Haves:

  • Strong Python skills (including OOP, asynchronous programming, and Docker).
  • Advanced SQL knowledge for building complex queries and optimizing ETL/ELT pipelines.
  • Practical experience with Terraform for Infrastructure as Code, especially on Azure.
  • Deep understanding of structured and unstructured data, including streaming/batch data.

Nice-to-Haves:

  • Familiarity with DBT, Airflow, Delta Tables, or Kafka.
  • Experience with Azure Data Lake Storage or similar distributed systems.
  • Knowledge of machine learning and AI-related data applications.
Apply Now