AWS Data Engineer

Recruiter:

PBT Group

Job Ref:

2816695148

Date posted:

Wednesday, October 20, 2021

Location:

Johannesburg, South Africa

SUMMARY:
-

POSITION INFO:

We are looking to hire a skilled AWS Cloud ETL Developer to design and build AWS Cloud ETL pipelines for ingesting and processing of Big data.

Your duties will include working with the AWS data lake development team, developing and implementing solutions to facilitate movement of data, testing the solutions and performing third line support for developed solutions.

DUTIES:

- Consult with business teams to understand data ingestion and processing requirements

- Develop effective, secure, and fit-for-purpose ETL capabilities to ingest and process data to, from and on the cloud

- Identify suitable cloud components on the basis of performance, cost-effectiveness, security, and other relevant metrics

- Develop patterns which meet the business objectives, follow best practices, and are extendable or re-usable

- Follow the software development lifecycle

- Test and troubleshoot solution characteristics

- Provide documentation on how your solution should be used, and train business teams how to use them

- Provide third line support for developed solutions, including troubleshooting and implementing corrective measures, tuning and optimisation, and monitoring.

- Identify and assist with improvements to developed solutions, on the basis of operational excellence, security, reliability, performance efficiency and cost optimisation.

- Manage time effectively through planning and prioritisation of activities

- Discuss and communicate progress with the development team and stakeholders

EXPERIENCE:

- Be familiar with modern cloud concepts and best practices.

- Must have development experience on traditional relational databases and with big data technologies.

- Extensive knowledge of coding languages especially Python, PySpark and SQL.

- Experience working with AWS cloud technologies for processing business data

- Solid knowledge / experience with Business Intelligence architectures, best practices & principles and techniques.

- Proven work experience as a Data Engineer developing ETL code, pipelines and data engineering

- Understand and integrate with common Enterprise IT components such as Active Directory, virtual machines, shares, etc

- Ability to troubleshoot and solve complex technical problems

- Experience managing the software development lifecycle

- Creative problem-solving skills around data engineering and data integration.

- The ability to prioritise activities and deliver on time

- Be willing and able to learn and adapt to the changing tech landscape

- Have a positive attitude and strong written and verbal communication and interpersonal skills

ADVANTAGEOUS SKILLS:

- Data warehousing experience

- Big data experience

- Relevant AWS cloud certification/s

- Experience with Terraform

QUALIFICATIONS/ CERTIFICATION:

- Bachelor’s degree in Computer Science, Information Technology, Data Engineering or related field

- Ideally have at least one relevant AWS cloud certification

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Intermediate Software Developer
Location: Pretoria
Salary: Monthly
Are you an Intermediate Software Developer looking for an opportunity to build innovative software solutions and work with modern technologies? This role offers the chance to contribute to impactful projects, collaborate with experienced developers, and play a key role in delivering high-quality applications that drive business success.
5 days ago

Junior Software Developer
Location: Johannesburg
Salary:
This is an exciting opportunity to be involved in the full software development lifecycle, from requirements gathering and solution design to coding, testing, deployment, and support. You'll work on meaningful projects that directly impact customers while continuously developing your technical and problem-solving skills.
5 days ago

Intermediate Software Developer
Location: Johannesburg
Salary:
This role offers the opportunity to work across the full software development lifecycle, from requirements gathering and solution design to development, testing, deployment, and customer support. You'll gain exposure to modern technologies, work alongside skilled professionals, and play a key role in delivering high-quality software products.
5 days ago

Systems Engineer (Linux, Unix)
Location: Pretoria
Salary: Annually
The Systems engineer (Linux / Unix experience) will be responsible for the stability, integrity and efficient operation of an in-house information system that supports core organisational functions as well as all business operation.
12 days ago

AI Specialist
Location: Johannesburg
Salary: Annually
Step into the future of AI innovation within a fast-evolving digital and customer experience environment. This exciting opportunity is ideal for an AI engineer passionate about building cutting-edge solutions across voice, chat, and generative AI. You will play a key role in developing intelligent automation, conversational AI systems, and advanced analytics solutions, with a strong focus on real-...
12 days ago

AI Engineer
Location: Johannesburg
Salary: Monthly
The AI engineer is responsible for designing, developing, and maintaining advanced Artificial Intelligence solutions that support strategic business objectives across voice and digital customer engagement channels.This role focuses on building and deploying production-grade AI applications, including intelligent voice bots, conversational chatbots, AI-powered Quality Assurance (QA) solutions for i...
15 days ago

AI Engineer
Location: Johannesburg
Salary: Monthly
AI engineer | Build the Future with Artificial Intelligence Ready to work on cutting-edge AI solutions that transform how businesses operate? We're seeking a talented AI engineer to design, develop, and deploy intelligent systems that drive innovation and deliver real-world impact.
15 days ago

Senior DevOps Engineer
Location: Johannesburg
Salary:
Senior DevOps engineer (Backend Development Skills Required)Hybrid (Bedfordview) | Senior Level | 5–10+ Years Experience | 24/7 Production On-Call Rotation Our client is seeking an experienced Senior DevOps engineer with strong backend software development skills to take ownership of a complex, multi-cloud production environment.This is a senior, hands-on engineering role for someone wh...
16 days ago

AI Engineer
Location: Johannesburg
Salary: Monthly
Ready to build the future instead of just watching it happen?Artificial Intelligence is reshaping how businesses operate, innovate, and compete. From Generative AI and machine learning to intelligent automation and predictive analytics, organisations are actively seeking AI talent that can turn complex challenges into smart solutions.
21 days ago

Head of Data and Digital
Location: Johannesburg
Salary: Monthly
Head: data and DigitalThe Head of data and Digital plays a critical role in shaping the strategic direction of the organisation by developing and executing a comprehensive digital and data strategy aligned to overall business objectives. This leader drives the identification, evaluation, and implementation of emerging technologies, digital solutions, and data-driven capabilities that enhance opera...
22 days ago

AWS Data Engineer

Similar jobs you might be interested in:

Create a free job alert for AWS Data Engineer in Johannesburg

Jobseekers

Recruiter

General