As an AWS Data Engineer, you will be responsible for designing, developing, and maintaining the data infrastructure, pipelines, and applications for our clients. You will collaborate with cross-functional teams to ensure efficient data processing, integration, and analysis.

Generally, these responsibilities consist of:

Designing and implementing data solutions.

Developing and optimising data pipelines for ETL.

Collaborating with data engineers and analysts to ensure data accuracy, consistency, and integrity.

Troubleshooting and resolving issues related to data processing and performance.

Staying up to date with industry best practices and emerging technologies in data engineering and data management.

Working closely with stakeholders to gather requirements, provide technical expertise, and implement solutions.

Learning and practicing additional skills such as those listed in the Relevant

Below are the general requirements for the AWS Data Engineer for cloudandthings.io.

Required

Proven track record of designing and implementing data solutions.

Knowledge of and experience with AWS Cloud infrastructure and services.

Understanding of Cloud Security best practices.

Willingness to learn and expand knowledge related to Cloud and Data Technologies.

Strong problem-solving and analytical skills.

Self-organising with the ability to prioritize and manage multiple tasks simultaneously.

Excellent verbal and written communication skills.

Ability to work collaboratively with clients and team members.

Willingness to travel to clients as and when required.

Advantageous

Bachelor's degree in Engineering, Computer Science, or related field.

Certifications, such as:

AWS Solutions Architect Associate

AWS Data Analytics Specialty

AWS Database Specialty.

AWS Data Engineer Associate

Databricks Certified: Data Engineer Professional

Databricks Certified: Data Engineer Associate

Any other data-related experience, e.g. working with Hadoop, databases, analytics software, etc.

Experience with a second cloud vendor (e.g. both AWS and Azure).

Experience with Docker/Containers/Kubernetes/CICD pipelines for data.

Knowledge of data security and compliance standards.

What We Offer

A culture of engineering and an environment where ideas are heard and builders can build.

Competitive salary.

A flexible and supportive work environment that values diversity, work-life balance, and personal growth.

Opportunities for career advancement and ongoing professional development.

The chance to work on cutting-edge products and technologies that make a real impact on people's lives.

Relevant Skills and Experience

While the list below is long, an ideal candidate should have working knowledge and experience covering many of the tools and services. The requirements for each project differ over time, and these skills provide an overview of what may typically be required of an AWS Data Engineer.

Software Engineering - Fundamentals

A fundamental software engineering skill set underpins all engineering work at cloudandthings.io.

Experience with modern operating systems, particularly Linux.

Experience with version control software, particularly Git.

Software fundamentals, such as Problem-solving, data structures and algorithms, software development methodologies, common design patterns and best practices.

Experience with at least one relevant language, preferably more. For example, Python, SQL, NodeJS, and Te