AWS Data Engineer

Recruiter:

PBT Group

Job Ref:

2816695148

Date posted:

Wednesday, October 20, 2021

Location:

Johannesburg, South Africa

SUMMARY:
-

POSITION INFO:

We are looking to hire a skilled AWS Cloud ETL Developer to design and build AWS Cloud ETL pipelines for ingesting and processing of Big data.

Your duties will include working with the AWS data lake development team, developing and implementing solutions to facilitate movement of data, testing the solutions and performing third line support for developed solutions.

DUTIES:

- Consult with business teams to understand data ingestion and processing requirements

- Develop effective, secure, and fit-for-purpose ETL capabilities to ingest and process data to, from and on the cloud

- Identify suitable cloud components on the basis of performance, cost-effectiveness, security, and other relevant metrics

- Develop patterns which meet the business objectives, follow best practices, and are extendable or re-usable

- Follow the software development lifecycle

- Test and troubleshoot solution characteristics

- Provide documentation on how your solution should be used, and train business teams how to use them

- Provide third line support for developed solutions, including troubleshooting and implementing corrective measures, tuning and optimisation, and monitoring.

- Identify and assist with improvements to developed solutions, on the basis of operational excellence, security, reliability, performance efficiency and cost optimisation.

- Manage time effectively through planning and prioritisation of activities

- Discuss and communicate progress with the development team and stakeholders

EXPERIENCE:

- Be familiar with modern cloud concepts and best practices.

- Must have development experience on traditional relational databases and with big data technologies.

- Extensive knowledge of coding languages especially Python, PySpark and SQL.

- Experience working with AWS cloud technologies for processing business data

- Solid knowledge / experience with Business Intelligence architectures, best practices & principles and techniques.

- Proven work experience as a Data Engineer developing ETL code, pipelines and data engineering

- Understand and integrate with common Enterprise IT components such as Active Directory, virtual machines, shares, etc

- Ability to troubleshoot and solve complex technical problems

- Experience managing the software development lifecycle

- Creative problem-solving skills around data engineering and data integration.

- The ability to prioritise activities and deliver on time

- Be willing and able to learn and adapt to the changing tech landscape

- Have a positive attitude and strong written and verbal communication and interpersonal skills

ADVANTAGEOUS SKILLS:

- Data warehousing experience

- Big data experience

- Relevant AWS cloud certification/s

- Experience with Terraform

QUALIFICATIONS/ CERTIFICATION:

- Bachelor’s degree in Computer Science, Information Technology, Data Engineering or related field

- Ideally have at least one relevant AWS cloud certification

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Senior Data Scientist
Location: Johannesburg
Salary:
As a Senior data Scientist, you will design, train, and optimise scalable machine learning and decisioning models while building reusable feature assets on databricks. You’ll partner closely with Product, Risk, and ML engineering teams to take complex predictive, prescriptive, and GenAI models from initial EDA to productionized enterprise decision systems.
1 day ago

Data Engineer
Location: South Africa
Salary:
data is at the heart of every modern organisation, and we're looking to connect with talented data engineers who enjoy building the pipelines, platforms and infrastructure that turn raw data into meaningful business insights. If you're passionate about solving complex data challenges and enabling data-driven decision-making, we'd love to hear from you.
2 days ago

Investigator - Digital Forensic
Location: Johannesburg
Salary: Hourly
5 Months ContractConduct in-depth digital forensic investigations across the Bank's Group, in adherence with the Group Digital Forensic Investigation Framework and standards, to identify, preserve, analyse and report on digital evidence relating to fraud, cybercrime, misconduct, insider threats and data breaches.
7 days ago

Java Developer
Location: Johannesburg
Salary: Monthly
Are you a Java Developer who is passionate about software engineering, problem-solving, and building enterprise-grade applications? This is an exciting opportunity to join a highly technical environment where strong Computer Science fundamentals, innovative thinking, and engineering excellence are valued as much as coding ability.
12 days ago

Java Team Lead
Location: Johannesburg
Salary: Monthly
Are you a passionate Java Team Lead who thrives on solving complex technical challenges while developing high-performing teams? This is an exciting opportunity to lead enterprise-scale software delivery, mentor talented engineers, and work on innovative solutions that make a real business impact.
12 days ago

Senior Digital Workspace Technical Engineer
Location: Johannesburg
Salary: Monthly
Are you a Senior Digital Workspace Support engineer with a passion for enterprise platforms, workflow automation, and business process improvement? This is an exciting opportunity to take ownership of critical enterprise applications, drive digital transformation initiatives, and deliver innovative solutions that enhance productivity across the organisation.
14 days ago

Senior Java Developer
Location: Johannesburg
Salary:
Are you a seasoned Java Software engineer looking to work on enterprise-scale solutions, modern cloud technologies, and complex business challenges? This opportunity offers the chance to join a high-performing technology environment where innovation, collaboration, and continuous learning are at the heart of everything you do.
14 days ago

Java Team Lead
Location: Johannesburg
Salary:
We are seeking an experienced Java Team Lead to join a high-performing technology team focused on delivering enterprise-grade software solutions. This role combines hands-on software engineering with people leadership, offering the opportunity to lead talented developers, drive technical excellence, and deliver impactful web and mobile applications for leading organizations.The ideal candidate wil...
14 days ago

Java Developer
Location: Johannesburg
Salary:
We are seeking a talented and experienced Senior Java Software engineer to join a dynamic, collaborative, and innovation-driven technology team. This is an exciting opportunity to work on enterprise-scale web and mobile applications, solve complex business challenges, and contribute to the development of high-quality software solutions for leading organizations.The ideal candidate is passionate ab...
14 days ago

Senior Full Stack Engineer
Location: South Africa
Salary: R80,000 per month, negotiable
This is the business''s first engineering hire. You will join a team of three who own the data pipelines, client relationships and private markets domain, while taking ownership of the application, including the portal, authentication, tenant isolation, infrastructure and security.
15 days ago

AWS Data Engineer

Similar jobs you might be interested in:

Create a free job alert for AWS Data Engineer in Johannesburg

Jobseekers

Recruiter

General