Principal Data Engineer

About the role

A senior individual contributor role leading the design of large-scale, secure enterprise data platforms and pipelines that support AI and machine learning work across many business areas.

At a glance

• PayNot stated in the posting
• Remote scopeRemote, United States
• Posted8 Oct 2026
• Last checked18 Oct 2026

What you will do

• Set the technical architecture strategy for worldwide batch and streaming pipelines, streaming frameworks such as AWS Kafka, and Terraform-b
• Act as the top technical authority for the data engineering group, defining standards, review practices and quality criteria for pipelines.
• Build and run autonomous AI agents powered by large language models such as Claude and Gemini, wired into the modern data stack.
• Take definitive decisions on warehouse design, handling upstream schema drift and scaling the data lake across several operational domains.
• Work with IT, security and product infrastructure teams on governance, schema normalization, role-based access control and masking of person
• Add automated monitoring, alerting and cleansing at ingestion so broken fields and source schema changes are caught early.

What they look for

• At least ten years in data engineering, cloud data architecture or related infrastructure work, including technical leadership of engineerin
• Strong SQL and Python skills for pipeline automation, data scripting and orchestrating AI agents.
• Hands-on experience provisioning and tuning production cloud environments with Terraform, including warehouse and networking setups.
• Proven ability to design real-time streaming architectures, high-volume event ingestion and custom API connector frameworks independently.

Nice to have

• Experience delivering data infrastructure iteratively in a fast-moving setting with Agile tools such as Jira.