Job Description
Job DescriptionDuration: 6+ months
*** U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor or transfer visas at this time. ***
*** No Vendors/3rd parties. ***
Build and maintain enterprise data pipelines and curated datasets that support AI/ML training and inference. Develop governed data products using Databricks, dbt, and Snowflake, integrating enterprise SaaS and external program data. Partner with Knowledge Management and Data Science teams to deliver feature-ready datasets.
Requirements:
- 10+ years of experience in Data engineering experience.
- Hands-on experience with Databricks (PySpark/SQL, Unity Catalog), DBT (models, tests, docs), and Snowflake (SQL, performance tuning).
- Experience with enterprise SaaS systems (Salesforce, D365, Coupa, Workday, Concur).
Responsibilities:
- Ingest data from Salesforce, Dynamics 365, Coupa, Workday, Concur, and external program or partner sources.
- Build and maintain ETL/ELT pipelines across Databricks, dbt, and Snowflake.
- Develop reusable data models for AI/ML training and inference.
- Implement data quality tests, documentation, and lineage in dbt.
- Optimize pipeline performance and cost efficiency.
- Apply enterprise data governance and compliance standards.
- Collaborate with Knowledge Management and Data Science teams on feature-ready datasets.
26-00880