Data Solution Architect

About the role

Design end-to-end lakehouse data architectures on Databricks and cloud platforms, ensuring reliable pipelines, strong governance and cost-efficient performance.

What you will do

• Design bronze, silver and gold layer architectures for production-ready data pipelines
• Tune and troubleshoot large Spark workloads using caching, partitioning and broadcast joins
• Set up unified governance with role-based access, row and column security and lineage
• Work within cloud ecosystems such as AWS, Azure or GCP, including network and IAM setup
• Monitor compute usage and right-size clusters to control cloud costs

What they look for

• Expertise in lakehouse and medallion architecture design
• Deep knowledge of Databricks and Spark internals for distributed computing
• Understanding of Delta Lake transactions, schema enforcement and optimization
• Proven ability to design governance models in Unity Catalog
• Advanced SQL plus fluency in Python or Scala
• Hands-on grasp of cloud infrastructure and identity management

Nice to have

• Valid Databricks data architect or data engineer certifications
• Experience with generative AI and MLflow model serving and vector search
• CI/CD and DevOps automation using Git, dbt, Azure Data Factory or Airflow
• Familiarity with structured streaming, Auto Loader and BI tools like Power BI