ABSA Jobs – Data Engineer Specialist

• Collaborate and work closely with cross-functional business partners (business-unit technology teams) to assist and oversee the deployment of the outputs of your work.
• Collaborating with the engineering team in the establishment of data pipelines from source systems to Hadoop.
• Working with lead data scientists to assist in the refinement of business requirements into measureable and actionable deliverables.
• Design, validate, implement, deploy and monitor machine learning models/algorithms on large datasets
• Comfortable engaging with business area subject matter experts, data analysts and system administrators to find data required for projects.
• Will create meaningful presentations and analyses that tell a “story” focused on insights not just data
• Work with large datasets using big tools (such as Spark, Hadoop) and/or data science tools (i.e. sk-learn, pandas, numpy, etc.)
• Work with domain experts to identify and formalize approaches for solving business problems using machine learning and data science.

Job Requirements:

• BSc, BCom, BEng, BBusSc or equivalent NQF level 6 qualification
• SQL
• Strong programming skills, proven track record of coding ability and experience (hands-on back end development)
• Have the ability to work in either an Agile or project methodology to deliver tasks
• Coding/software development skills. Strong mathematical and statistical skills.
• Understanding of and experience of using Big Data technologies essential
• Scala (preferred), Python (pySpark), Java (as a precursor to learning Scala) including the key numerical, analytical and machine learning libraries / packages
• Apache Spark (preferred), Hadoop
• Degree in a quantitative discipline such mathematics, statistics, physics, computer science or engineering.
• Linux/Unix. Bash. Git. SBT/Maven
• Knowledge of information technology environments, administration, policies and processes. Working knowledge of financial and management accounting desirable

Qualification & Experience:

• Understanding of and experience of applying machine learning methods is preferred
• Advantageous: Experience in Elastic Search, Log Stash, Kibana, Tableau, Power Bi, MongoDB.