Data Infrastructure Engineer

About the role

You will unite data engineering with infrastructure work, designing and running the platforms that keep company data dependable, protected and simple to use, in close cooperation with reliability, product, analytics and security colleagues.

What you will do

• Design, build and operate scalable infrastructure covering ingestion, transformation, storage and serving of data
• Run Kafka and Avro streaming pipelines, schedule batch jobs in Airflow and keep Redshift fast and cost efficient
• Manage cloud environments for development, testing and production through infrastructure as code with cost controls
• Own service level objectives, runbooks and alerts, and safeguard sensitive data via access controls, encryption and retention rules
• Investigate incidents, lead root cause analysis and put preventative fixes in place
• Improve discoverability with cataloging, lineage, ownership and quality tests, and build documentation and self-service tooling

What they look for

• Kafka and Avro skills including schema design, serialization and evolution
• Hands-on Redshift and production Airflow with data modeling and performance tuning
• Cloud and DevOps experience with CI/CD, infrastructure as code, Kubernetes, data lakes and open table formats
• Observability, incident response and pipeline debugging with a security minded approach to access, privacy and secrets
• Clear communication with technical and non-technical stakeholders

Nice to have

• Experience with dbt