Data Engineer

 

Recruiter:

HR Genie

Job Ref:

Data Engineer

Date posted:

Monday, January 10, 2022

Location:

South Africa, South Africa

Salary:

Market related


SUMMARY:
We value a Data Engineer as someone who works behind the scenes to obtain, process and supply data v

JOB DESCRIPTION:

We value a Data Engineer as someone who works behind the scenes to obtain, process and supply data via various methodologies and technologies, to various consumers, in ways and forms that makes sense and add value. This definition is very broad, as the field of data engineering is just as broad. You may be the type of Data Engineer that develops API endpoints for the consumption of data by end users or even another data pipeline, or you may be the type of Data Engineer that develops highly distributed, high availability data processing pipelines in an effort to satisfy the need of the ever questioning data analysts and/or data scientists.

 

You have awesome knowledge about the following concepts:

  • Data modelling
  • Relational data modelling in traditional relational database management systems. (Microsoft SQL Server, MySQL, PostgreSQL, etc.)
  • Coercing unstructured and semi-structured data into a structured form.
  • Data pipelining knowledge - data extraction and transformation.
  • Data transformation knowledge for reporting and analytics purposes.
  • Knowledge of the MapReduce and related data processing paradigms would be a boon.

 

You have the following technical competencies:

  • Writing SQL queries, that can relate, transform and aggregate data from many differing sources where natural keys may or may not exist.
  • Experience with writing data pipelines that move and transform data, for various uses.
  • Working knowledge of a general purpose programming language like Python would be a boost.
  • Working knowledge of columnar databases such as Google BigQuery, and SAP HANA would be a boost.
  • Working knowledge of highly distributed technologies such as Apache Hadoop or Apache Spark would be a boost.
  • Working knowledge of NoSQL technologies, such as Apache Solr would be a boost.

 

You have the following personal competencies:

  • The ability to solve problems.
  • The ability to rotate around a problem, to see if solutions can be gained in different ways.
  • The ability to work in an ever changing, unstructured environment.
  • The ability to work as part of a team, with vastly differing skill sets and opinions.
  • The ability to contribute ideas to the quorum.
  • The ability to mentor and provide guidance for other team members.
  • A systems approach to thinking, as opposed to a siloed approach. The candidate needs to understand how their work affects the greater system.
  • The ability to work without supervision, and take accountability for the work they deliver.
  • The ability to liaise with a client, sifting through the fluff and extracting the actual requirements.

 

If this is you - apply now and we'll get in touch!!

 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Voice and Data Engineer
Location: Centurion
Salary:
CenturionVoice and data engineer (1 x Junior and 1 x Senior)R15 000 - R35 000 P/aLooking for a skilled and experienced Voice and data engineer to join the dynamic team.
4 days ago


Data Engineer
Location: Johannesburg
Salary:
data engineer - Johannesburg - City DeepA skilled data engineer is required to support and enhance data platforms, reporting environments, data integration solutions, and business intelligence capabilities. The ideal candidate will have 2–5 years’ experience in data engineering, BI, reporting, SQL development, or data analytics, with strong SQL skills and experience in reporting and an...
5 days ago


Data Engineer
Location: Johannesburg
Salary:
A well-established group based in South Johannesburg, is seeking a technically capable data engineer to join their Head Office IT team.This is an excellent opportunity for a data professional with 2–5 years’ relevant experience who enjoys working with SQL, reporting, analytics and data-integration solutions and would like to continue developing within the Microsoft data and Analytics e...
4 days ago


Senior Data Engineer
Location: Johannesburg
Salary:
7 days ago


2865 Data Engineer (Entry)
Location: Menlyn
Salary:
ESSENTIAL SKILLS:Strong data engineering skills, including Python coding and data ingestion (ETL, Kafka, Apache Spark).Familiarity with AI/ML frameworks (e.g., Langchain, Langgraph, GAIA) and their integration into solutions.Proven ability to translate business requirements into well-defined technical specifications.Excellent communication skills to convey technical concepts to non-technical stake...
7 days ago


Data Engineer (Senior)
Location: Menlyn
Salary:
ESSENTIAL SKILLS:Strong experience with Python (Python 3.x) and PySpark for developing data processing jobs.At least 3 years’ experience with AWS services commonly used by data engineers, such as Athena, Glue, Lambda, S3 and ECS.Hands-on experience with NoSQL databases such as DynamoDB and relational databases (Oracle/PostgreSQL) including strong Oracle SQL skills.Experience with Oracle Clou...
7 days ago


Data Engineer (Senior) 1053
Location: Menlyn
Salary:
data engineer We are seeking a highly skilled data engineer to join our growing data team, with a core focus on designing and delivering scalable, cloud-based data platforms. This role centres on building robust data pipelines, enabling high-quality data for analytics and reporting, and driving modern data engineering practices across the organisation. You will work closely with stakeholders,...
11 days ago


Data Engineer
Location: Johannesburg
Salary:
We’re looking for a data-driven professional with a strong analytics mindset to join a growing team. This role is ideal for someone who enjoys working hands-on with data, uncovering insights, and supporting business decisions.
14 days ago


Intermediate Data Engineer
Location: Johannesburg
Salary: 670000 Annually
Our client is looking for a data engineer to join their team in Bryanston. You should have a Degree in Computer Science, Information Systems, engineering with at least 3 - 6 years experience. You need experience in databricks and Python as well as ELT tools. Send your CV now!
20 days ago


Senior Data Engineer
Location: Johannesburg
Salary:
21 days ago


Create a free job alert for Data Engineer in South Africa

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions