AWS Data Engineer

Recruiter:

PBT Group

Job Ref:

2816695148

Date posted:

Wednesday, October 20, 2021

Location:

Johannesburg, South Africa

SUMMARY:
-

POSITION INFO:

We are looking to hire a skilled AWS Cloud ETL Developer to design and build AWS Cloud ETL pipelines for ingesting and processing of Big data.

Your duties will include working with the AWS data lake development team, developing and implementing solutions to facilitate movement of data, testing the solutions and performing third line support for developed solutions.

DUTIES:

- Consult with business teams to understand data ingestion and processing requirements

- Develop effective, secure, and fit-for-purpose ETL capabilities to ingest and process data to, from and on the cloud

- Identify suitable cloud components on the basis of performance, cost-effectiveness, security, and other relevant metrics

- Develop patterns which meet the business objectives, follow best practices, and are extendable or re-usable

- Follow the software development lifecycle

- Test and troubleshoot solution characteristics

- Provide documentation on how your solution should be used, and train business teams how to use them

- Provide third line support for developed solutions, including troubleshooting and implementing corrective measures, tuning and optimisation, and monitoring.

- Identify and assist with improvements to developed solutions, on the basis of operational excellence, security, reliability, performance efficiency and cost optimisation.

- Manage time effectively through planning and prioritisation of activities

- Discuss and communicate progress with the development team and stakeholders

EXPERIENCE:

- Be familiar with modern cloud concepts and best practices.

- Must have development experience on traditional relational databases and with big data technologies.

- Extensive knowledge of coding languages especially Python, PySpark and SQL.

- Experience working with AWS cloud technologies for processing business data

- Solid knowledge / experience with Business Intelligence architectures, best practices & principles and techniques.

- Proven work experience as a Data Engineer developing ETL code, pipelines and data engineering

- Understand and integrate with common Enterprise IT components such as Active Directory, virtual machines, shares, etc

- Ability to troubleshoot and solve complex technical problems

- Experience managing the software development lifecycle

- Creative problem-solving skills around data engineering and data integration.

- The ability to prioritise activities and deliver on time

- Be willing and able to learn and adapt to the changing tech landscape

- Have a positive attitude and strong written and verbal communication and interpersonal skills

ADVANTAGEOUS SKILLS:

- Data warehousing experience

- Big data experience

- Relevant AWS cloud certification/s

- Experience with Terraform

QUALIFICATIONS/ CERTIFICATION:

- Bachelor’s degree in Computer Science, Information Technology, Data Engineering or related field

- Ideally have at least one relevant AWS cloud certification

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Senior Data Engineer – Google Cloud Platform (GCP) (Contract)
Location: Johannesburg
Salary:
2 days ago

Senior Mobile Developer
Location: Johannesburg
Salary: Monthly
Are you a Senior Mobile Developer passionate about building world-class mobile applications and leading technical innovation? This is an exciting opportunity to take ownership of cross-platform mobile solutions, work with modern technologies, and play a key role in delivering scalable, secure, and high-performing applications that make a real business impact.
3 days ago

Technical Programme Manager
Location: Johannesburg
Salary: Monthly
Are you a Senior Technical Programme Manager with deep infrastructure expertise and a proven track record of delivering complex enterprise transformation programmes? This is a unique opportunity to lead a large-scale infrastructure modernisation initiative, driving critical technology workstreams across cloud, identity, messaging, networking, security, migration, and operational readiness.
3 days ago

Senior AI Lead
Location: Johannesburg
Salary:
Take the lead in shaping the future of AI at scale. As a Senior AI Lead, you will drive the strategy, design, and delivery of enterprise-grade AI solutions, leading high-performing teams to build sophisticated machine learning systems, deploy robust production-ready models, and integrate innovative technologies across cloud and enterprise environments.
5 days ago

Senior Full Stack Mobile Developer
Location: Johannesburg
Salary:
We are seeking an experienced Senior Mobile Developer to join a dynamic Information Technology team responsible for designing, developing, enhancing, and supporting high-quality cross-platform mobile applications.This role offers the opportunity to provide technical leadership, influence mobile architecture and development standards, and contribute to the delivery of scalable, secure, and high-per...
5 days ago

Java Team Lead
Location: Johannesburg
Salary:
Lead. Mentor. Innovate. Deliver.Are you an experienced Java professional with a passion for leadership, software craftsmanship, and delivering impactful solutions? Our client is seeking a talented Java Team Lead to join their high-performing engineering team and help shape world-class digital solutions for some of South Africa's most respected organisations.Join a collaborative, multidisciplinary ...
12 days ago

Full Stack Developer (Expert) 1508
Location: Menlyn
Salary:
AI Solutions Architect (Python & Java)Location: Pretoria, South AfricaWork Model: HybridContract Duration: 3 years We're looking for an exceptional Senior AI Software engineer to help shape the evolution of a modern, AI-native data and platform ecosystem. This is a unique opportunity for a hands-on engineer who thrives at the intersection of software engineering, data engineering, cloud p...
15 days ago

1508 Full Stack Developer (Expert)
Location: Menlyn
Salary:
ESSENTIAL SKILLS:Expert software engineering capability with a strong record of designing, building, testing, deploying andoperating production-grade enterprise solutions.Advanced Python and Java development, including clean code, object-oriented and functional design,concurrency, performance optimisation, packaging and dependency management.Strong data engineering capability across batch and even...
16 days ago

Senior Data Engineer - Johannesburg - R90 000 – R100 000
Location: Johannesburg
Salary: Market-related
This role exists to join a growing engineering team to build scalable data infrastructure and implement robust data integrations.
16 days ago

Firmware and Hardware Development Engineer
Location: Johannesburg
Salary: Monthly
Are you a Firmware & Hardware Development engineer who enjoys building innovative embedded solutions from the ground up? This is an exciting opportunity to work with cutting-edge technologies across firmware, hardware, communications, and IoT environments while contributing to the development of next-generation products.
16 days ago

AWS Data Engineer

Similar jobs you might be interested in:

Create a free job alert for AWS Data Engineer in Johannesburg

Jobseekers

Recruiter

General