My Shortlist

Your shortlisted jobs will appear here. To view your shortlist: Login Or Register

Date Added: TODAY

Data Engineer

London, EC4N, UK
Apply Now

Company: HUXLEY ASSOCIATES

Job Type: Contract, Full Time

Salary: £500 - £600/day (umbrella)

Data Engineer - GCP, Big Query, Airflow

Job Description: We are seeking a GCP Data Engineer with 3-5 years experience who is confident and proficient in Python programming, with 1-2 years of experience specifically in data processing tasks. The successful candidate will play a pivotal role in designing, building, and optimizing our data pipelines on GCP, ensuring that our data infrastructure is robust, efficient, and scalable.

Key Responsibilities:

Develop, maintain, and optimize data pipelines on Google Cloud Platform (GCP).
Big Query, Airflow
Utilize Python for data processing tasks, ensuring high performance and reliability.
Collaborate with data scientists, analysts, and other engineers to gather requirements and deliver high-quality data solutions.
Implement best practices for data engineering, including data governance, security, and compliance.
Troubleshoot and resolve issues related to data processing and pipeline performance.Qualifications:

Primary Skill: Confident Python programming.
Experience: 1-2 years of hands-on experience using Python specifically for data processing tasks.
Proven experience with Google Cloud Platform (GCP) and its data services (e.g., BigQuery, Dataflow, Pub/Sub).
Strong understanding of data engineering concepts, including ETL processes, data warehousing, and data modeling.
Familiarity with SQL and experience in writing complex queries.
Excellent problem-solving skills and attention to detail.
Ability to work independently and as part of a team in a fast-paced, dynamic environment.Preferred Qualifications:

Experience with additional programming languages such as Java or Scala.
Knowledge of containerization and orchestration tools like Docker and Kubernetes.
Familiarity with CI/CD pipelines and version control systems (e.g., Git).Please click to find out more about our Key Information Documents. Please note that the documents provided contain generic information. If we are successful in finding you an assignment, you will receive a Key Information Document which will be specific to the vendor set-up you have chosen and your placement.
Apply Now