Data Engineer

Recruiter:

HR Genie

Job Ref:

Data Engineer

Date posted:

Monday, January 10, 2022

Location:

South Africa, South Africa

Salary:

Market related

SUMMARY:
We value a Data Engineer as someone who works behind the scenes to obtain, process and supply data v

JOB DESCRIPTION:

We value a Data Engineer as someone who works behind the scenes to obtain, process and supply data via various methodologies and technologies, to various consumers, in ways and forms that makes sense and add value. This definition is very broad, as the field of data engineering is just as broad. You may be the type of Data Engineer that develops API endpoints for the consumption of data by end users or even another data pipeline, or you may be the type of Data Engineer that develops highly distributed, high availability data processing pipelines in an effort to satisfy the need of the ever questioning data analysts and/or data scientists.

You have awesome knowledge about the following concepts:

Data modelling
Relational data modelling in traditional relational database management systems. (Microsoft SQL Server, MySQL, PostgreSQL, etc.)
Coercing unstructured and semi-structured data into a structured form.
Data pipelining knowledge - data extraction and transformation.
Data transformation knowledge for reporting and analytics purposes.
Knowledge of the MapReduce and related data processing paradigms would be a boon.

You have the following technical competencies:

Writing SQL queries, that can relate, transform and aggregate data from many differing sources where natural keys may or may not exist.
Experience with writing data pipelines that move and transform data, for various uses.
Working knowledge of a general purpose programming language like Python would be a boost.
Working knowledge of columnar databases such as Google BigQuery, and SAP HANA would be a boost.
Working knowledge of highly distributed technologies such as Apache Hadoop or Apache Spark would be a boost.
Working knowledge of NoSQL technologies, such as Apache Solr would be a boost.

You have the following personal competencies:

The ability to solve problems.
The ability to rotate around a problem, to see if solutions can be gained in different ways.
The ability to work in an ever changing, unstructured environment.
The ability to work as part of a team, with vastly differing skill sets and opinions.
The ability to contribute ideas to the quorum.
The ability to mentor and provide guidance for other team members.
A systems approach to thinking, as opposed to a siloed approach. The candidate needs to understand how their work affects the greater system.
The ability to work without supervision, and take accountability for the work they deliver.
The ability to liaise with a client, sifting through the fluff and extracting the actual requirements.

If this is you - apply now and we'll get in touch!!

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Senior Data Engineer - Johannesburg - R90 000 – R100 000
Location: Johannesburg
Salary: Market-related
This role exists to join a growing engineering team to build scalable data infrastructure and implement robust data integrations.
5 days ago

Data Engineer
Location: Johannesburg
Salary: Annually
Background:Excellent career opportunity for a data engineer to join a leading retail group
15 days ago

Data Engineer
Location: Johannesburg
Salary:
One of South Africa's Banking Giants is looking for a data engineer to join their team.
3 days ago

Data Engineer
Location: South Africa
Salary:
data is at the heart of every modern organisation, and we're looking to connect with talented data engineers who enjoy building the pipelines, platforms and infrastructure that turn raw data into meaningful business insights. If you're passionate about solving complex data challenges and enabling data-driven decision-making, we'd love to hear from you.
19 days ago

Junior Data Engineer
Location: Pretoria
Salary:
Introduction:We are seeking an experienced Junior data engineer to join a company based in Pretoria and manage and develop an established Microsoft Fabric data platform. The successful candidate will ensure reliable day-to-day operations while delivering new data engineering requirements. This is a hands-on role requiring strong technical capability, independent problem-solving and the ability to ...
39 days ago

Senior Data Engineer
Location: Pretoria
Salary:
Are you a passionate data engineer looking to work with modern cloud technologies, big data platforms, and scalable data architectures? Join a forward-thinking organisation where you'll play a pivotal role in building robust data pipelines, enabling business intelligence, and driving data-driven decision-making across the business.
6 days ago

Intermediate Data Engineer
Location: Pretoria
Salary:
Introduction:We are seeking an experienced Intermediate data engineer to join a company based in Pretoria and manage and develop an established Microsoft Fabric data platform. The successful candidate will ensure reliable day-to-day operations while delivering new data engineering requirements. This is a hands-on role requiring strong technical capability, independent problem-solving and the abili...
43 days ago

Data Engineer
Location: Johannesburg
Salary: Market Related
51 days ago

Data Engineer | Microsoft Fabric | Azure | SQL | Python | Data Engineering | Your Next Career Move Starts Here
Location: Johannesburg
Salary:
Are you a skilled data engineer ready for your next career move?I specialize in connecting talented data engineers with exciting opportunities across software development houses, start-ups, consultancies and large corporates.I work with organisations that value data-driven decision-making, modern data platforms, cloud technologies and strong technical talent, both within South Afric...
8 days ago

3352 Data Engineer (Expert)
Location: Menlyn
Salary:
ESSENTIAL SKILLS:Hands-on experience with Kafka and event streaming platforms for real-time data movement.Proven experience with API integration patterns, webhooks and event/webhook ingestion.Strong proficiency in Python for data engineering, ingestion pipelines and automation.Solid competence with enterprise databases and query languages, with practical experience with database performance tuning...
3 days ago

Data Engineer

Similar jobs you might be interested in:

Create a free job alert for Data Engineer in South Africa

Jobseekers

Recruiter

General