Job Description
Job DescriptionSenior Azure Data Engineer | Remote
We are seeking a Senior Azure Data Engineer to help design, build, and operate a next-generation enterprise data platform on Microsoft Azure. This is a hands-on data engineering role focused on Azure Data Factory, Databricks/PySpark, modern Lakehouse architecture, enterprise data warehousing, and legacy-to-cloud modernization.
Location:
- Remote/Telecommute
- Occasional travel to Springfield, IL, approximately 2-3 times per year
- Must be willing to participate in a live verbal/video walkthrough of your technical experience and projects as part of the interview and verification process
- No third-party submissions.
What You’ll Do:
- Design reusable, parameter-driven pipelines using Azure Data Factory, Synapse Pipelines, Databricks and/or Microsoft Fabric Data Factory
- Build Bronze/Silver/Gold medallion architecture on ADLS Gen2 using Delta Lake and Parquet
- Develop and optimize PySpark notebooks and jobs
- Build and optimize scalable ELT workflows
- Design dimensional and Data Vault models
- Implement SCD Types 1/2/3, CDC, and late-arriving data patterns
- Implement CI/CD using Azure DevOps, YAML, ARM/Bicep and/or Terraform
- Support monitoring and troubleshooting using Azure Monitor, Log Analytics, and KQL
- Contribute to legacy-to-cloud modernization, including Informatica PowerCenter to Azure Data Factory
- Support migrations from Teradata, Oracle, and SQL Server to Synapse or Fabric
- Support production incident response for critical data pipelines
Required Qualifications:
- Deep hands-on Azure Data Factory experience
- Strong Databricks and PySpark experience
- Production experience with Azure Synapse, Azure Databricks, and/or Microsoft Fabric
- Strong ADLS Gen2 experience
- Advanced SQL skills, including CTEs, window functions, optimization, execution plans, and performance tuning
- Strong Python data engineering skills, including pandas, PySpark, REST API integration, and unit testing
- Experience with Azure Key Vault and Azure AD/Entra ID
- Experience with Azure networking, including VNet integration and private endpoints
- Azure DevOps/CI/CD experience
- Experience with modern Lakehouse architecture and Delta Lake
- T-SQL proficiency
- Familiarity with Spark SQL, KQL, PowerShell, and Bash
Preferred:
- 5+ years of data warehouse development experience
- 5+ years of data modeling experience using ERWIN or similar tools
- 2+ years of Azure Data Factory and Snowflake experience
- Medicaid domain knowledge is a plus
Benefits:
- Medical
- Dental
- Vision
- 401K