Software Developer/Data Engineer

Remote, South Africa

Software Developer/Data Engineer - 12 Month Contract

Educational Qualifications

BSc Computer Science / BEng

Professional Qualifications

AWS Professional Certification

Years of Experience

4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems

Skills / Requirements

4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems

Required to code complex transformations using loader specifications provided by the BA

Experience working with Big Data sets and solving data-related challenges

Ability to automate ingestion by building ingestion pipelines using AWS Lambda or Glue

Proficiency in coding languages: PySpark, Python, SQL

Hands-on experience with AWS services , including S3, Athena, Lambda Functions, GLUE, EC2

AWS experience and AWS certification required

Experience in data modeling and data architecture design

Key Responsibilities

Implement scalable data pipelines and architectures using PySpark, Python, SQL

Build distributed data pipelines and compute tiers operating on AWS Lambda and Glue

Serve as a technical resource for team members and mentor junior engineers

Collaborate...