AWS Data Engineer

Recruiter:

PBT Group

Job Ref:

2816695148

Date posted:

Wednesday, October 20, 2021

Location:

Johannesburg, South Africa

SUMMARY:
-

POSITION INFO:

We are looking to hire a skilled AWS Cloud ETL Developer to design and build AWS Cloud ETL pipelines for ingesting and processing of Big data.

Your duties will include working with the AWS data lake development team, developing and implementing solutions to facilitate movement of data, testing the solutions and performing third line support for developed solutions.

DUTIES:

- Consult with business teams to understand data ingestion and processing requirements

- Develop effective, secure, and fit-for-purpose ETL capabilities to ingest and process data to, from and on the cloud

- Identify suitable cloud components on the basis of performance, cost-effectiveness, security, and other relevant metrics

- Develop patterns which meet the business objectives, follow best practices, and are extendable or re-usable

- Follow the software development lifecycle

- Test and troubleshoot solution characteristics

- Provide documentation on how your solution should be used, and train business teams how to use them

- Provide third line support for developed solutions, including troubleshooting and implementing corrective measures, tuning and optimisation, and monitoring.

- Identify and assist with improvements to developed solutions, on the basis of operational excellence, security, reliability, performance efficiency and cost optimisation.

- Manage time effectively through planning and prioritisation of activities

- Discuss and communicate progress with the development team and stakeholders

EXPERIENCE:

- Be familiar with modern cloud concepts and best practices.

- Must have development experience on traditional relational databases and with big data technologies.

- Extensive knowledge of coding languages especially Python, PySpark and SQL.

- Experience working with AWS cloud technologies for processing business data

- Solid knowledge / experience with Business Intelligence architectures, best practices & principles and techniques.

- Proven work experience as a Data Engineer developing ETL code, pipelines and data engineering

- Understand and integrate with common Enterprise IT components such as Active Directory, virtual machines, shares, etc

- Ability to troubleshoot and solve complex technical problems

- Experience managing the software development lifecycle

- Creative problem-solving skills around data engineering and data integration.

- The ability to prioritise activities and deliver on time

- Be willing and able to learn and adapt to the changing tech landscape

- Have a positive attitude and strong written and verbal communication and interpersonal skills

ADVANTAGEOUS SKILLS:

- Data warehousing experience

- Big data experience

- Relevant AWS cloud certification/s

- Experience with Terraform

QUALIFICATIONS/ CERTIFICATION:

- Bachelor’s degree in Computer Science, Information Technology, Data Engineering or related field

- Ideally have at least one relevant AWS cloud certification

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

AWS Data Engineer
Location: Johannesburg
Salary: Monthly
Build Scalable data Solutions on aws!
6 days ago

Senior Data Scientist (ML Engineer)
Location: Johannesburg
Salary:
To design, prototype, and build next-generation analytic engines and services by applying strong expertise in Artificial Intelligence (AI). Build, deploy, scale and support machine learning, AI and GenAI solutions in production. The role focuses on operationalising models, developing AI applications and agents, and creating the platforms and services required to deliver business value at sca...
2 days ago

Backend Software Engineer
Location: Johannesburg
Salary: 60000.00 Monthly
Our client is seeking a strong Backend Software engineer to join their development team. This is an exciting opportunity for a software engineer who is passionate about backend development and wants to broaden their expertise into platform engineering, DevOps, infrastructure, and production systems.The successful candidate will primarily focus on designing, developing, debugging, maintaining, and ...
2 days ago

MLOps Engineer
Location: Johannesburg
Salary: Monthly
Passionate about bridging the gap between Machine Learning and Production? Join a technology-driven organisation where you'll play a key role in deploying, automating, and scaling AI solutions that deliver real business value.
2 days ago

AI Machine Learning Engineer
Location: Johannesburg
Salary: Monthly
Ready to turn data into intelligent solutions that create real business impact? Join a forward-thinking technology company that is leveraging Machine Learning and AI to solve complex challenges, drive innovation, and shape the future.
2 days ago

Digital Forensic Investigator
Location: Johannesburg
Salary:
Conduct in-depth digital forensic investigations across the the company, in adherence with the Group Digital Forensic Investigation Framework and standards, to identify, preserve, analyse and report on digital evidence relating to fraud, cybercrime, misconduct, insider threats and data breaches.
5 days ago

Digital Forensics Investigator
Location: Johannesburg
Salary: Monthly
Are you an experienced Digital Forensics Investigator with a strong background in digital evidence, cyber investigations and incident response? This is an exciting 5 months contract opportunity to join a sophisticated environment where your expertise will be used to investigate complex digital incidents, uncover critical evidence and support high-impact disciplinary, regulatory, civil and criminal...
5 days ago

Forward Deployed Engineer, Torque
Location: Johannesburg
Salary: Negoitable
The role sits in a small founding team and reports to the Chief Operating Officer. It is based in Johannesburg, with engagements run mostly remotely and on site when required or preferred. It suits an engineer who wants to build with frontier AI on real industrial problems
6 days ago

2496 SAP Technical Consultant (Advanced)
Location: Menlyn
Salary:
ESSENTIAL SKILLS:Kindly note that this role is for an AI engineer in a SAP team. 1. Python ProgrammingStrong understanding of Python syntax and principles of clean, reusable code.Understanding of Python frameworks and libraries e.g. Pandas and NumPy2. aws Lambda FunctionsExperience developing, deploying, and managing serverless applications using aws LambdaProficiency in writing unit and integrati...
6 days ago

AI Specialist
Location: Johannesburg
Salary: Annually
Step into the future of AI innovation within a fast-evolving digital and customer experience environment. This exciting opportunity is ideal for an AI engineer passionate about building cutting-edge solutions across voice, chat, and generative AI. You will play a key role in developing intelligent automation, conversational AI systems, and advanced analytics solutions, with a strong focus on real-...
8 days ago

AWS Data Engineer

Similar jobs you might be interested in:

Create a free job alert for AWS Data Engineer in Johannesburg

Jobseekers

Recruiter

General