AWS Data Engineer

 

Recruiter:

PBT Group

Job Ref:

2816695148

Date posted:

Wednesday, October 20, 2021

Location:

Johannesburg, South Africa


SUMMARY:
-

POSITION INFO:

We are looking to hire a skilled AWS Cloud ETL Developer to design and build AWS Cloud ETL pipelines for ingesting and processing of Big data.

 

Your duties will include working with the AWS data lake development team, developing and implementing solutions to facilitate movement of data, testing the solutions and performing third line support for developed solutions.

DUTIES:

- Consult with business teams to understand data ingestion and processing requirements

- Develop effective, secure, and fit-for-purpose ETL capabilities to ingest and process data to, from and on the cloud

- Identify suitable cloud components on the basis of performance, cost-effectiveness, security, and other relevant metrics

- Develop patterns which meet the business objectives, follow best practices, and are extendable or re-usable

- Follow the software development lifecycle

- Test and troubleshoot solution characteristics

- Provide documentation on how your solution should be used, and train business teams how to use them

- Provide third line support for developed solutions, including troubleshooting and implementing corrective measures, tuning and optimisation, and monitoring.

- Identify and assist with improvements to developed solutions, on the basis of operational excellence, security, reliability, performance efficiency and cost optimisation.

- Manage time effectively through planning and prioritisation of activities

- Discuss and communicate progress with the development team and stakeholders

 

EXPERIENCE:

- Be familiar with modern cloud concepts and best practices.

- Must have development experience on traditional relational databases and with big data technologies.

- Extensive knowledge of coding languages especially Python, PySpark and SQL.

- Experience working with AWS cloud technologies for processing business data

- Solid knowledge / experience with Business Intelligence architectures, best practices & principles and techniques.

- Proven work experience as a Data Engineer developing ETL code, pipelines and data engineering

- Understand and integrate with common Enterprise IT components such as Active Directory, virtual machines, shares, etc

- Ability to troubleshoot and solve complex technical problems

- Experience managing the software development lifecycle

- Creative problem-solving skills around data engineering and data integration.

- The ability to prioritise activities and deliver on time

- Be willing and able to learn and adapt to the changing tech landscape

- Have a positive attitude and strong written and verbal communication and interpersonal skills

 

ADVANTAGEOUS SKILLS:

- Data warehousing experience

- Big data experience

- Relevant AWS cloud certification/s

- Experience with Terraform

 

QUALIFICATIONS/ CERTIFICATION:

- Bachelor’s degree in Computer Science, Information Technology, Data Engineering or related field

- Ideally have at least one relevant AWS cloud certification

 



 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Senior AWS Data Engineer (Contract)
Location: Johannesburg
Salary:
7 days ago


Senior Cloud DevOps Engineer
Location: Johannesburg
Salary: 1 300 000 Annually
Do you get more excited about building deployment pipelines than deploying code manually? Does scaling infrastructure, automating everything possible, and keeping production environments running smoothly sound like a good day at the office? My client is looking for a Senior Cloud DevOps engineer to join a growing engineering team building a large-scale SaaS platform. This opportunity is ideal...
Today


Principle Engineer
Location: Johannesburg
Salary:
This is not another senior development role. My client is looking for a Principal engineer who wants to shape the future of an enterprise-scale technology platform, influence architectural decisions across multiple engineering teams, and solve the kinds of problems most developers rarely get exposure to. If you're currently working as Staff engineer, Lead engineer, Principal engineer, So...
Today


Systems Engineer (Linux, Unix)
Location: Pretoria
Salary: Annually
The Systems engineer (Linux / Unix experience) will be responsible for the stability, integrity and efficient operation of an in-house information system that supports core organisational functions as well as all business operation.
1 day ago


Java Tech Lead
Location: Johannesburg
Salary: Annually
Hands-on leadership opportunity where you'll set technical direction, review code, unblock engineers, and make key decisions to keep delivery on track. You will lead the modernisation of a core platform, defining and executing the roadmap from a legacy front end to a modern, component-based architecture while ensuring platform stability and team productivity. Key initiatives include migrating to a...
1 day ago


Cloud Infrastructure Specialist
Location: Midrand
Salary:
We are seeking an experienced Cloud Infrastructure Specialist to take ownership of our cloud infrastructure and Microsoft 365 environment. The successful candidate will be responsible for managing, securing, and optimizing cloud-based services while ensuring high availability, performance, and security across the technology landscape.
1 day ago


Principal Engineer – Onsite - JHB
Location: Johannesburg
Salary:
5 days ago


Cloud Infrastructure Specialist
Location: Johannesburg
Salary:
Take ownership. Secure the cloud. Drive performance.Are you an experienced Cloud Infrastructure Specialist who thrives on managing, securing and optimising complex cloud environments?Our client is looking for a highly skilled, hands-on Cloud Infrastructure Specialist to take ownership of their cloud infrastructure and Microsoft 365 environment, ensuring the availability, security, performance and ...
5 days ago


Senior Data Engineer
Location: Johannesburg
Salary:
We are seeking a highly skilled Senior data engineer to join a dynamic engineering team where data engineering, software development, and platform architecture intersect. This role is ideal for an experienced engineer who enjoys building scalable systems, designing reusable frameworks, and contributing to the evolution of modern data platforms.The successful candidate will play a key role in shapi...
9 days ago


Senior DevOps Engineer
Location: Johannesburg
Salary:
We are seeking an experienced Senior DevOps engineer / Site Reliability engineer (SRE) to provide technical leadership across modern Kubernetes-based platforms operating in both cloud and on-premise environments.This role is ideal for a seasoned infrastructure professional who is passionate about platform engineering, automation, reliability, and operational excellence. You will play a key role in...
9 days ago


Create a free job alert for AWS Data Engineer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions