AWS Data Engineer

Recruiter:

PBT Group

Job Ref:

2816695148

Date posted:

Wednesday, October 20, 2021

Location:

Johannesburg, South Africa

SUMMARY:
-

POSITION INFO:

We are looking to hire a skilled AWS Cloud ETL Developer to design and build AWS Cloud ETL pipelines for ingesting and processing of Big data.

Your duties will include working with the AWS data lake development team, developing and implementing solutions to facilitate movement of data, testing the solutions and performing third line support for developed solutions.

DUTIES:

- Consult with business teams to understand data ingestion and processing requirements

- Develop effective, secure, and fit-for-purpose ETL capabilities to ingest and process data to, from and on the cloud

- Identify suitable cloud components on the basis of performance, cost-effectiveness, security, and other relevant metrics

- Develop patterns which meet the business objectives, follow best practices, and are extendable or re-usable

- Follow the software development lifecycle

- Test and troubleshoot solution characteristics

- Provide documentation on how your solution should be used, and train business teams how to use them

- Provide third line support for developed solutions, including troubleshooting and implementing corrective measures, tuning and optimisation, and monitoring.

- Identify and assist with improvements to developed solutions, on the basis of operational excellence, security, reliability, performance efficiency and cost optimisation.

- Manage time effectively through planning and prioritisation of activities

- Discuss and communicate progress with the development team and stakeholders

EXPERIENCE:

- Be familiar with modern cloud concepts and best practices.

- Must have development experience on traditional relational databases and with big data technologies.

- Extensive knowledge of coding languages especially Python, PySpark and SQL.

- Experience working with AWS cloud technologies for processing business data

- Solid knowledge / experience with Business Intelligence architectures, best practices & principles and techniques.

- Proven work experience as a Data Engineer developing ETL code, pipelines and data engineering

- Understand and integrate with common Enterprise IT components such as Active Directory, virtual machines, shares, etc

- Ability to troubleshoot and solve complex technical problems

- Experience managing the software development lifecycle

- Creative problem-solving skills around data engineering and data integration.

- The ability to prioritise activities and deliver on time

- Be willing and able to learn and adapt to the changing tech landscape

- Have a positive attitude and strong written and verbal communication and interpersonal skills

ADVANTAGEOUS SKILLS:

- Data warehousing experience

- Big data experience

- Relevant AWS cloud certification/s

- Experience with Terraform

QUALIFICATIONS/ CERTIFICATION:

- Bachelor’s degree in Computer Science, Information Technology, Data Engineering or related field

- Ideally have at least one relevant AWS cloud certification

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Senior Data Engineer
Location: Johannesburg
Salary:
1 day ago

Cloud Services Manager
Location: Johannesburg
Salary: Monthly
The Cloud Services Manager is responsible for the governance, operational oversight, service assurance, and strategic management of the organisation's cloud technology landscape, including Microsoft Azure, Microsoft 365, aws, and other cloud platforms across multiple environments, tenants, and business entities.This role is accountable for managing and overseeing third-party service providers resp...
6 days ago

IT Operations Manager
Location: Johannesburg
Salary: Monthly
We are seeking an experienced IT Operations Manager to take ownership of our infrastructure, networking, hosting, and end-user technology environments.This role is accountable for the stability, security, performance, and governance of the technology that supports our business operations, as well as the overall service experience of the internal teams that rely on it daily.The technology function ...
6 days ago

AI Specialist
Location: Johannesburg
Salary: Annually
Step into the future of AI innovation within a fast-evolving digital and customer experience environment. This exciting opportunity is ideal for an AI engineer passionate about building cutting-edge solutions across voice, chat, and generative AI. You will play a key role in developing intelligent automation, conversational AI systems, and advanced analytics solutions, with a strong focus on real-...
7 days ago

Senior Security Architect
Location: Johannesburg
Salary:
Psybergate is an IT company that builds bespoke software solutions and provides highly skilled resources to its clients.We are looking for a Senior Security Architect – Mobile Banking Platforms to join our financial services client based in Sandton for a 12-month contract role.The Senior Security Architect will be responsible for defining, governing, and evolving the end-to-end security arch...
8 days ago

Python Developer
Location: Centurion
Salary: Monthly
Are you a passionate Python Developer looking to grow your career in a collaborative, technology-driven environment? This is an excellent opportunity to work on modern backend applications, build scalable APIs, and contribute to innovative software solutions that make a real impact.
9 days ago

Intermediate Full-Stack Software Engineer
Location: Johannesburg
Salary: Market Related Salary
Intermediate Full-Stack Software engineer
12 days ago

Senior Full Stack Developer
Location: Johannesburg
Salary: Monthly
Our client is seeking an experienced and highly skilled Senior Full Stack Developer to join a dynamic and innovative development team.This role is ideal for a passionate software professional with strong expertise in C# and .NET development, combined with front-end technologies such as TypeScript, HTML, CSS3, and SQL. The successful candidate will play a key role in designing, developing, and deli...
12 days ago

Senior Software Developer
Location: Johannesburg
Salary: Monthly
Are you a Senior Full Stack Developer looking to take ownership of enterprise-grade solutions and complex system integrations? This is an exciting opportunity to work on impactful projects, influence technical direction, and mentor developers while delivering scalable, high-performance applications.
13 days ago

Software Engineer- Upper Mid-level / Senior (Remote)
Location: Johannesburg
Salary:
Our client is looking for a Software engineer- Upper Mid-level / Senior to join their team remotely.
14 days ago

AWS Data Engineer

Similar jobs you might be interested in:

Create a free job alert for AWS Data Engineer in Johannesburg

Jobseekers

Recruiter

General