#111 - Data Engineer
Lifted (an Upwork Company)
Remote, South Africa
We are seeking a hands-on Data Engineer to support a large-scale data platform modernization initiative. You will migrate approximately 1,000 datasets to Snowflake, adapt existing pipelines, and help deliver reliable orchestration with Apache Airflow 3. The architecture and technical approach are already defined, with the role focused on implementation and migration delivery through March 2027.
Enterprise experience strongly preferred.
Key Responsibilities
Migrate pipelines from Apache Airflow 2 to Apache Airflow 3.
Migrate Confluent connections between cloud regions.
Migrate pipelines from Hive to Iceberg using Snowpark Connect.
Adapt existing data pipelines to Snowflake while maintaining data quality and reliability.
Support workflow scheduling and monitoring in Apache Airflow.
Partner with the team to execute time-sensitive data migrations.
Must-Have Skills
2+ years of experience.
Strong software engineering fundamentals.
Hands-on Python development experience.
Advanced SQL, including complex joins, CTEs, window functions, and performance tuning.
Snowflake data modeling.
Apache Airflow experience developing and testing pipelines in Airflow and Python.
Apache...
Sourced from Himalayas
This page is a short summary. The full posting and the application are at the source.