Remote Data Engineer (Databricks Migration) W2 only
Job Description
Job Description
Job Title: Data Engineer (Databricks Migration)
Industry: Healthcare IT
Location: 100% Remote
Employment Type: 6-Month Contract (W2) — high likelihood of extension
Max Pay Rate: $58.00 – $62.00/hour W2
Please Note: This position is available on a W2 basis only. We are unable to provide visa sponsorship or visa transfers at this time. Third-party candidates and Corp-to-Corp (C2C) submissions will not be considered.
Overview
A leading regional health system is seeking an experienced, hands-on Data Engineer to support a critical enterprise Databricks migration. This is a 100% remote, 6-month contract opportunity with a strong likelihood of extension.
In this role, you will be responsible for designing and deploying data ingestion pipelines and migrating legacy reporting solutions from Microsoft SQL Server / Health Catalyst into Azure Databricks (Medallion architecture). You will collaborate closely with internal Business Intelligence analysts and developers to deliver robust, secure, and HIPAA-compliant data pipelines.
Note: This is a hands-on technical build role focused on execution. Candidates at the Data Architect level will not be considered.
Key Responsibilities
- Data Ingestion: Design and implement robust Databricks ingestion pipelines across multiple source systems and formats.
- Pipeline & Table Design: Build and optimize Silver and Gold layer tables in Databricks based on existing legacy database solutions.
- Cross-Functional Collaboration: Partner directly with BI analysts and developers to translate reporting requirements into performant data models.
- Code & Architecture Reviews: Participate actively in peer design and code reviews in accordance with established engineering standards.
- Testing & Troubleshooting: Lead unit and integration testing to ensure data integrity; diagnose and resolve pipeline performance issues and technical defects.
- Governance & Compliance: Strictly adhere to healthcare privacy regulations (HIPAA) and enterprise data security protocols.
Required Qualifications
- Experience: Minimum of 4+ years of professional data engineering experience.
- SQL Mastery: Advanced proficiency with Transact-SQL (T-SQL) and Databricks SQL (query optimization, schema design, transformation logic).
- ETL / Pipeline Development: Hands-on experience developing ETL/ELT workflows using Azure Databricks, Microsoft SQL Server, SSIS, and DBSQL.
- Multi-Source Ingestion: Proven track record ingesting structured and semi-structured data from relational databases (RDBMS), REST APIs, Flat files, XML, and JSON.
- Database Performance: Solid foundation in database administration, tuning, index management, and query optimization.
- Data Modeling: Practical understanding of data warehousing methodologies, dimensional modeling, and Medallion architecture principles.
- Communication: Proactive communicator who identifies bottlenecks early, shares lessons learned from prior cloud migrations, and works effectively in a distributed team.
Preferred Qualifications
- Prior experience working within healthcare environments or with clinical/claims datasets.
- Familiarity with Power BI, Epic EHR, or Health Catalyst platforms.
Engagement Details
- Contract Term: Initial 6 months (extensions expected based on project scope)
- Work Arrangement: 100% Remote (US-based)
- Interview Process: Single 1-hour panel interview via Microsoft Teams
\nCompany Description
Premier Staffing Agency
Company Description
Premier Staffing Agency