Search

Data Platform Engineer

PublishedPublished: 6/14/2022
Technology

Job Description

Job Description

ComResource is looking for a Data Platform Engineer.

Responsibilities:

  • Design and implement Dataiku Project Standards to act as a production readiness linter, ensuring all projects meet naming, metadata, and security requirements.
  • Develop custom Dataiku plugins and API integrations to automate Tier 1 and Tier 2 data quality checks, blocking promotion to production if standards are not met.
  • Partner with Information Security to integrate tokenization and field-level encryption directly into Dataiku visual recipes and Python code-based workflows.
  • Build and maintain the promotion path where ad-hoc Dataiku prototypes are hardened and, where necessary, refactored into DBT for long-term enterprise use.
  • Integrate Dataiku monitoring with ServiceNow to automate incident creation for pipeline failures or data quality drift.
  • Serve as the technical steward for non-technical business units, providing approved templates and secure data products.

Essentials:

  • Hands-on experience with Dataiku DSS.
  • Proficiency in Python and SQL.
  • Experience working in Linux/Unix environments.
  • Experience building governance-as-code layers and automated data quality frameworks.
  • Ability to bridge the gap between rapid prototyping and production-grade engineering.

Desired:

  • Experience with Snowflake, Terraform, GitHub, and REST APIs.

Req ID: AM127734720

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...