Search

Data Lakehouse Architect - Data Onboarding, DataOps & Data Products

PublishedPublished: 6/14/2022
Technology

Job Description

Position - Data Lakehouse Architect – Data Onboarding, DataOps & Data Products

\n

Location - United States/Canada

\n

Duration - Long Term

\n


\n

Main Responsibilities

\n

    \n
  • Work closely with Data Engineering, IT, Analytics, and Insights teams throughout the Lakehouse onboarding lifecycle.
  • \n

  • Review project architecture, onboarding designs, and technical documents; provide actionable feedback and meet agreed SLAs for review and approval.
  • \n

  • Guide teams on approved Bronze, Silver, and Gold patterns; lead POCs and establish new ingestion patterns when required.
  • \n

  • Maintain the Lakehouse ingestion pattern library and update reusable onboarding guidance as platform capabilities evolve.
  • \n

  • Work with Enterprise Architecture to keep designs, standards, and implementation guidelines current.
  • \n

  • Adjust metadata, lineage, catalog, governance, data quality, and observability frameworks to support new patterns.
  • \n

  • Review conceptual, logical, and semantic models for Gold data products, including business entities, KPIs, metrics, and reporting structures.
  • \n

  • Drive DataOps and GenieOps guidelines, enablement, and rollout to support a large volume of production pipelines.
  • \n

\n


\n

Technical Knowledge

\n

    \n
  • Databricks Certified Data Engineer – required
  • \n

  • Microsoft Azure ecosystem and Azure Databricks
  • \n

  • Lakeflow Connect, Delta Lake, Unity Catalog, and Medallion Architecture
  • \n

  • Deep experience with connectors and ingestion from SAP, Salesforce, Snowflake, APIs, files, and enterprise applications
  • \n

  • Pipeline scalability, production operations, performance tuning, observability, and cost optimization
  • \n

  • Conceptual, logical, physical, and semantic data modeling
  • \n

  • Implement cost optimization strategies.
  • \n

  • Automate production monitoring using GenieOps.
  • \n

\n


Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...