Specialist Data Engineer

SUMMARY:
My client that are a world class organization is currently looking for a Data Engineer Specialist for their ever-growing department. The candidate must have a good academic record and should be multi-disciplined. This opportunity will come with a hands-on experience and a work life balance

POSITION INFO:

Description:

Education:

B-Degree in Computer Science or related qualification.

Skills:

• 5 Years’ experience
• 3-5 years’ experience with designing and building, BI systems and complex data eco systems.
• 3 + years’ experience working in Big data environment (advantageous for all, a must for high volume
• environments) – optimising and building big data pipelines, architectures and data sets with e.g. Java,
• Scala, Python, Hadoop, Apache Spark and Kafka
• Cross domain knowledge
• Architecture
• Infrastructure
• Logical & physical design of data structures
• Testing
• Web Applications & specifically knowledge of data design patterns used within web applications
• Service Side
• Influencing
• Automation
• Messaging
• Solutioning
• SSL Security including expertise in encryption methods & data transfer across systems
• CI/CD etc.
• Experience as an agile practitioner and knowledge or experience of other delivery methodologies e.g.
• Kanban, RUP etc.
• Excellent communication, analytical skills and decision-making ability in collaborative environments
• • Excellent understanding of specific coding / scripting languages e.g. Java, C#, Python, Perl, JavaScript
  • Solid understanding of Object-Oriented Design and ability to properly apply general design patterns and
  • paradigms
  • Experience with test-driven development and domain driven design
  • Solid understanding of messaging protocols and web services like and REST
  • Experience with open-source relational and NoSQL databases
  • Advanced knowledge of SQL e.g. query authoring
  • Knowledge of systems such as Windows, Linux etc
  • Knowledge of application server containers: Tomcat, Jetty, JBoss, NodeJS, IIS, .Net Core etc.
  • Good understanding of frameworks and libraries like, jQuery, TypeScript, HTML, CSS
  • Experience with CI / CD tools (like Jenkins, Bamboo, TFS,) and Artefact Management (preferably Nexus),
  • Experience with Cloud platforms e.g. AWS & Google Cloud Platform
  • Ability to create and maintain sophisticated CI / CD pipelines
  • Strong understanding of version control and related concepts and techniques, particularly Git
  • Experience with appropriate unit testing framework(s)
  • Excellent debugging and problem-solving skills.
  • Comfortable with stubbing tools like wire mock and/or hoverfly
  • Experience with scripting languages like Bash and/or Python
  • Familiar with OAuth, Open Connect ID and SAML, preferably with an understanding of AD / LDAP /
  • Kerberos
  • Familiar with Containerisation technologies like Docker & or orchestrators like Kubernetes

   

   

  Please visit our website www.communicate.co.za to submit your CV directly or to view other I.T related jobs.   If you have not had any response in two weeks, please consider your application unsuccessful. Your profile will be kept on our database for any other suitable positions.
  
  

  We also invite you to contact us to discuss other exciting career opportunities in our niche area! For more information, please call Lufuno Mokwebo on 087 ----- or email on --------Please upload your CV here-------->  

NB! This job is now closed. You can apply for other jobs by uploading your CV.