Python Developer - with Data engineering Skills

Location: Richmond – hybrid.

Introduction

The project is centered on a data management (TDM) function responsible for securely moving sensitive data across non-production environments using internally built frameworks. The work is heavily backend-focused, combining data engineering and software engineering, with pipelines primarily built in Scala on Spark and supported by AWS services (including EMR, IAM, KMS, S3) and Python-based serverless components like Lambda. The contractor will help maintain and enhance this patented in-house framework, automate data pipelines, ensure compliance with strict cybersecurity and auditing requirements, and contribute to ongoing feature development and self-service capabilities. The team operates entirely in production, even though the data movement is between non-production environments.

Required Skills & Qualifications

• Strong expertise in Spark, Scala, AWS, Python, and shell scripting


• ...