Company: HARNHAM - DATA & ANALYTICS RECRUITMENT
Job Type: Permanent, FullTime
Salary: £70,000 - £75,000 per annum
Data Engineer Opportunity - Join an Exciting Team! Are you an experienced Data Engineer looking to make an impact? We're searching for a talented professional to help shape the future of data systems at a forward-thinking and flexible organization. If you're passionate about data architecture, cloud solutions, and building scalable systems, this could be the role for you!
Company Our client is a dynamic and innovative company with a clear mission: empowering people with tailored insurance solutions. Using cutting-edge technology and a customer-focused approach, they've built a reputation for delivering personalized, high-quality service.
Responsibilities As a Data Engineer, you'll play a crucial role in designing and maintaining cutting-edge data systems. Key duties include:
- Building custom data systems for collecting, processing, and provisioning data from various sources.
- Developing and managing Terraform modules for scalable, secure infrastructure.
- Collaborating with DevOps to integrate CI/CD pipelines.
- Assisting with integrating data solutions into existing workflows, including Airflow and DBT pipelines.
- Supporting stakeholders like data scientists and analysts to deliver high-impact data products.
Experience Needed We're seeking candidates with the following skills and experience:
Must-Haves:
- Strong Python skills (including OOP, asynchronous programming, and Docker).
- Advanced SQL knowledge for building complex queries and optimizing ETL/ELT pipelines.
- Practical experience with Terraform for Infrastructure as Code, especially on Azure.
- Deep understanding of structured and unstructured data, including streaming/batch data.
Nice-to-Haves:
- Familiarity with DBT, Airflow, Delta Tables, or Kafka.
- Experience with Azure Data Lake Storage or similar distributed systems.
- Knowledge of machine learning and AI-related data applications.