Search

Lead Data Engineer

PublishedPublished: 6/14/2022
Technology
|

Job Description

A global financial institution is seeking a hands-on Lead Data Engineer to design and deliver scalable enterprise data solutions while contributing to a major data platform modernization initiative.

\n


\n

The engineer will work with Snowflake and Databricks, build production data pipelines, implement dimensional data models, and help modernize existing ETL/ELT workloads. The role combines hands-on engineering with technical architecture and collaboration across engineering and business teams.

\n


\n

Responsibilities

\n


\n

    \n
  • Build, maintain, and optimize data pipelines using Snowflake, Databricks, Python, and SQL.
  • \n

  • Support the migration and re-architecture of existing data processing workflows.
  • \n

  • Design dimensional data models, star schemas, fact tables, and dimension tables.
  • \n

  • Develop and orchestrate ETL/ELT workflows using Airflow or similar tools.
  • \n

  • Contribute technical designs, engineering standards, and reusable integration patterns.
  • \n

  • Troubleshoot production data issues involving performance, reliability, and data quality.
  • \n

  • Collaborate with architecture, engineering, governance, and business teams.
  • \n

  • Provide technical guidance and conduct design and code reviews.
  • \n

\n


\n

Role Requirements

\n


\n

    \n
  • 7+ years of relevant data engineering experience.
  • \n

  • Strong hands-on experience with both Snowflake and Databricks.
  • \n

  • Advanced Python and SQL skills.
  • \n

  • Star-schema and dimensional modeling experience.
  • \n

  • Enterprise ETL/ELT pipeline design and implementation.
  • \n

  • Airflow or comparable orchestration technologies.
  • \n

  • Experience with Azure, AWS, or GCP.
  • \n

  • Production performance optimization and troubleshooting.
  • \n

  • Architecture and hands-on implementation experience.
  • \n

  • Strong technical communication and problem-solving abilities.
  • \n

\n


\n

Nice to Have

\n


\n

    \n
  • Experience in financial services or another complex enterprise environment.
  • \n

  • Apache Spark and Azure Data Factory.
  • \n

  • Data platform migrations and modernization.
  • \n

  • dbt or semantic modeling.
  • \n

  • Medallion architecture, lakehouse patterns, SCD Type 2, or data governance.
  • \n

\n


Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...