Senior Data Engineer

SUMMARY:
Are you passionate about building reliable data platforms and transforming complex data into business value?

POSITION INFO:
We are currently building our IT talent database and are looking to connect with experienced Senior Data Engineers for current and future opportunities. We are particularly interested in professionals with strong experience in Python, SQL, ETL/ELT, data warehousing and cloud data platforms. This is an opportunity to register your profile with us so that your data engineering experience can be considered for suitable opportunities as they become available. If you enjoy solving complex data challenges and engineering high-quality data solutions, we'd love to hear from you.
 
Key Responsibilities:

• Design, develop and maintain scalable data pipelines.
• Build and optimise ETL and ELT processes.
• Develop data ingestion and integration solutions.
• Develop and maintain data models.
• Implement data quality and validation processes.
• Optimise data processing and pipeline performance.
• Collaborate with Data Scientists, BI Developers and Software Engineers.
• Work with cloud-based data platforms.
• Automate data engineering processes.
• Troubleshoot data pipeline and integration issues.

• BSc, BCom, Diploma or equivalent qualification in Computer Science, Information Technology, Data Engineering or a related field will be advantageous.
• Relevant cloud or data certifications will be advantageous.

• 5+ years of data engineering experience.
• Strong experience with SQL.
• Strong experience with Python.
• Experience developing ETL/ELT pipelines.
• Experience working with cloud data platforms.
• Experience working with large datasets.

• Python
• SQL
• ETL / ELT.
• Data Warehousing.
• AWS and/or Azure.
• Data Modelling.
• Azure Data Factory.
• Apache Spark.