Senior Engineer - BIG Data

 

Recruiter:

HR Genie

Job Ref:

BIGDATA

Date posted:

Wednesday, February 24, 2021

Location:

Johannesburg, South Africa

Salary:

Market Related


SUMMARY:
We require a highly skilled Big Data Engineer

POSITION INFO:

Job Function:

• Design and development of applications for Ratings Advance analytical, data innovation systems
• Participate in multiple software development processes including Coding, Testing, De-bugging & Documentation.
• Develop software applications based on clear business specifications.
• Work on new initiatives and support existing Ratings applications.
• Perform Application & System Performance tuning and troubleshoot performance issues.
• Integrate in-house applications with various vendor software platforms.
• Setup development environment / sandbox for application development.
• Check-in application code changes into the source repository.
• Perform unit testing of application code and fix errors.
• Effectively interact with customers, business users and IT staff.

Experience: 

• Hands on development experience in writing Apache/Pi Spark jobs using Python and Scala
• Complete knowledge of the Hadoop ecosystem
• 5 + years of IT experience in application development and support.
• 3+ years of Strong experience with Apache/Pi Spark jobs using Python and Scala
• Strong experience with Oracle and related technologies
• Strong experience with SQL and no SQL database technologies.
• Experience with Unix/Linux Operating System.
• Experience using system tools, source control systems, utilities and third-party products.
• Experience using scheduling technologies (i.e. Autosys)
• Experience with DevOps Tools i.e. Git, Jenkins, Ansible etc…
• Experience working in an Agile development environment is MUST
• Experience with Cloud Solutions, Design patterns, data models & data architecture & design is a plus.
• Experience with Change Management and defect tracking tools
• Experience in leading and managing small teams.
• Experience with Java Technologies is a plus
• Financial experience is preferred



 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Senior C# Software Engineer – Bedfordview (Hybrid) – up to R1.1m Per Annum
Location: Johannesburg
Salary: 1100000
senior C# Software engineer – Bedfordview (Hybrid) – up to R1.1m Per Annum
Today


Mechanical Engineer (Senior), Pretoria
Location: Centurion
Salary:
We are seeking a Mechanical engineer (senior) for a permanent role based in Pretoria, Gauteng
Today


Senior Electrical Design Engineer
Location: Johannesburg
Salary:
Become an integral part of a renowned multi-disciplinary consulting firm as a senior Electrical Design engineer. Take charge in spearheading the development and delivery of essential engineering solutions for Power, Energy, and Mining services. Participate in the design of renewable energy systems, and Transmission solutions tailored to the Mining sector's power system engineering needs.
2 days ago


Senior Engineer (Electrical)
Location: Johannesburg
Salary:
We are looking for a senior engineer (Electrical) to actively participate in and lead as required the development and delivery of core engineering outputs to Power, Energy and Mining services solutions. We have a permanent role in Johannesburg North.
2 days ago


Cloud Database Engineer (Senior)
Location: Midrand
Salary:
Join our dynamic team as a senior Cloud database engineer, where you'll play a pivotal role in designing and implementing cutting-edge cloud-based database solutions. With a focus on Oracle database architecture and cloud technologies, you'll collaborate closely with cross-functional teams to ensure the reliability, security, and compliance of our database systems. If you're passionate about stayi...
2 days ago


Senior Operations Engineer
Location: Pretoria
Salary: Hourly
We are seeking a senior Operations engineer to serve as the Feature Owner for Security Tools. The successful candidate will be responsible for the SecDevOps of the client's UEM and Endpoint Protection security platform components and tools, ensuring operational stability and security.
3 days ago


Senior Tailings Engineer
Location: Johannesburg
Salary: R 700,000 Annually
Tailings engineer with more than 7 years of tailings related experience, in the tailings department, based in the Sandton or Centurion offices.You contribute to new and existing projects and assist project managers and project directors with surveillance of existing and design of new tailings storage facilities and return water dams.
3 days ago


Senior Civil Design Engineer
Location: Johannesburg
Salary: R 800,000 Annually
Well respected engineering consultancy is seeking a senior Civil Design engineer to join their team.The successful candidate will be responsible for managing civil design mine infrastructure projects. This includes storm water management infrastructure (dams, canals), bulk earthworks (terraces, platforms), roads (gravel, mine haul roads, dragline walkways), mine waste disposal facilities, tailings...
3 days ago


Senior Systems Engineer
Location: Johannesburg
Salary: 700000
Are you a seasoned senior Systems engineer looking to join a Leading financial services provider?Here's a permanent role where you can showcase your experience and skillset.
4 days ago


Python & AWS Software Engineer (Senior)
Location: Centurion
Salary:
SummaryJoin our dynamic client as a senior Python & AWS Software engineer, where you'll play a pivotal role in crafting innovative IT solutions for global clients. You'll leverage your expertise in API and ETL development, alongside proficiency in Git, CI/CD pipelines, and PySpark, to drive impactful projects within the Impact Foundry Platform. Collaborate closely with cross-functional teams, ...
6 days ago


Create a free job alert for Senior Engineer - BIG Data in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions