Data Engineer Johannesburg

Recruiter:

Career Circuit

Job Ref:

Data Engineer Johan..

Date posted:

Tuesday, April 19, 2022

Location:

Johannesburg, South Africa

Salary:

Market Related

SUMMARY:
Data Engineer Johannesburg

JOB DESCRIPTION:

Think like a scientist; build like a software engineer. Our data engineers create robust and scalable computing environments which bring data-driven technologies to our users. We are constantly challenging ourselves to build more effective data architectures, flexing our freedom to incorporate new technologies and expand our computing power.

Strong candidates will have a mix of the following:

vFluency in Python and some variety of SQL.

vA strong degree in computer science, or a quantitative discipline.

vExperience in designing and setting up large data systems, with an ability to assess the tradeoffs in architectural decisions.

vExperience with distributed processing frameworks (Hadoop, Spark, etc).

vKnowledge of large data architectures (data warehouses, lakes, meshes, etc).

vExperience working in cloud environments, especially Azure.

vExperience in building and optimizing big data pipelines.

vDesigning and implementing data warehouses, data lakes and data meshes.

vAdvanced knowledge of relational, non-relational databases with strong experience in SQL.

vWorking knowledge of streaming, message queuing and highly scalable data stores.

vUnderstanding of DevOps processes, CI/CD and agile development.

vExperience in testing and observability in the context of big data.

vExperience with distributed processing frameworks (Apache Spark, Hive, Kafka, etc).

vHaving worked in a cloud environment (Azure, AWS).

vSpecific technologies: - Python, R, Scala - SQL (MS SQL Server, Postgres) - Apache Spark, Hadoop, Hive - Databricks, EMR.

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Azure Data Engineer – Johannesburg – up to R1mil per annum
Location: Johannesburg
Salary: 1 000 000
Azure data engineer – johannesburg – up to R1mil per annum
3 days ago

Azure Data Engineer – Johannesburg – up to R1mil per annum
Location: Johannesburg
Salary: 1 000 000
Azure data engineer – johannesburg – up to R1mil per annum
17 days ago

Data Engineer (AWS and Redshift) - Johannesburg – up to R1mil
Location: Johannesburg
Salary: 1000000
data engineer (AWS and Redshift) - johannesburg – up to R1mil
3 days ago

AWS Data Engineer - 0675
Location: Pretoria
Salary: Hourly
Are you ready to fuel innovation in the motor industry through cutting-edge data solutions? Our client is seeking a dynamic data engineer to accelerate their enterprise collaboration and data quality initiatives.
10 days ago

Senior AWS Data Engineer - 1154
Location: Pretoria
Salary: Hourly
Our client in the motor industry is looking to employ a Senior AWS data engineer. As a Big data engineer, you will be responsible for building and maintaining robust Big data Pipelines using our client's data Platforms.
10 days ago

AWS Data Engineer - 1432
Location: Pretoria
Salary: Hourly
Contract Starts: 01.06.2024Contract Ends: 31.12.2026Location: Midrand/Menlyn/Rosslyn/Home Office rotation
10 days ago

Data Engineer
Location: Midrand
Salary:
Our client in the banking sector seeks to employ a data engineer yo assemble large, complex data sets to meet functional/non-functional requirements, adhering to best big data practices.
11 days ago

Data Streaming Platform Engineer (Advanced)
Location: Midrand
Salary:
Company PurposeOur client in the motor industry is seeking an experienced data Streaming Platform engineer to delve into the core of data streaming processes, ensuring robustness, scalability, and efficiency at every stage. From designing and implementing streaming architectures to optimizing data pipelines, you'll play a crucial role in shaping our data infrastructure and driving insights to fuel...
12 days ago

0831_SAP Data Engineer (Focus: SAP BW) (Senior)
Location: Pretoria
Salary:
0831_SAP data engineer (Focus: SAP BW)Location: GautengContract Term: 1 June 2024 - 31 December 2026
12 days ago

Data Engineer
Location: Johannesburg
Salary:
Are you a seasoned data engineer with a strong focus on staging high-quality data? Are you passionate about leveraging your expertise in SQL, ETL toolsets, and database technologies to drive effective data management solutions? If so, we have an exciting opportunity for you!
13 days ago

Data Engineer Johannesburg

Similar jobs you might be interested in:

Create a free job alert for Data Engineer Johannesburg in Johannesburg

Jobseekers

Recruiter

General