Senior Data Engineer

About the role

Help evolve a data lake by building new ingestion processes, monitoring existing ones and developing ingestion frameworks. Work with cloud services to keep data flowing reliably.

What you will do

• Design Python ingestion pipelines from APIs, object storage and file transfer sources
• Provision cloud infrastructure with infrastructure as code and add observability
• Partner with analysts, product managers and business teams on data delivery
• Write documentation and enforce unit testing standards for data workflows
• Explain technical design choices clearly to non technical colleagues

What they look for

• Advanced Python skills including Pandas and AWS Wrangler
• Strong SQL for schema definition and data manipulation
• Deep experience with AWS data services such as Athena, Glue, S3, Lambda, ECS and Redshift
• Proven use of infrastructure as code and unit testing for data pipelines
• Ability to manage several priorities independently and collaborate across teams

Benefits

• 25 days of holiday plus bank holidays, with extra days after long service
• An extra paid day each year for volunteering
• Paid leave for significant life moments such as a wedding or a move
• A bonus scheme that shares in company success
• Pension contributions matched up to 6 percent through salary sacrifice