Job Description
\n
Senior Data Engineer & Lead Data engineer
\n
\n
Location: Charlotte, NC
\n
Work Model: Hybrid – 2 days onsite per week
\n
Employment Type: Contract-to-Hire
\n
\n
About the Role
\n
\n
We are looking for Senior Data Engineer & Lead Data engineer to join a collaborative Data & Analytics team supporting Claims Analytics. This is a hands-on engineering role focused on building, enhancing, and supporting modern data applications and pipelines.
\n
\n
The ideal candidate has strong experience with Python, PySpark, SQL, and Databricks, along with cloud data engineering experience in Azure or another major cloud platform.
\n
\n
You will work closely with Data Architects, Product Owners, and other engineering teams to design, develop, optimize, and support enterprise-scale data solutions.
\n
\n
What You'll Do
\n
- \n
- Design, develop, and support new and existing data engineering applications.
- Build and maintain scalable ETL/ELT pipelines and data integrations.
- Develop data solutions using Python, PySpark, SQL, and Databricks.
- Work with Data Architects to translate high-level data flows into technical implementations.
- Optimize SQL queries, Spark jobs, schemas, and data pipelines for performance and scalability.
- Develop and maintain data solutions across Data Lake and Data Warehouse environments.
- Participate in code reviews, testing, deployment, and technical documentation.
- Monitor production data pipelines and troubleshoot complex issues.
- Support CI/CD processes for data engineering applications.
- Work collaboratively with Product Owners, Product Managers, Scrum Masters, and engineering teams.
- Provide technical guidance and help mentor junior engineers.
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
Required Qualifications
\n
- \n
- 5–8 years of experience in Data Engineering, Data Integration, or Data Warehousing.
- Strong hands-on experience with Python.
- Strong experience with PySpark / Apache Spark.
- Advanced SQL skills.
- Hands-on experience with Databricks.
- Experience with Azure, AWS, or GCP, preferably Azure.
- Strong understanding of Data Lakes, ETL/ELT, and data modeling.
- Experience optimizing data pipelines and SQL queries for performance.
- Experience with CI/CD pipelines.
- Strong problem-solving and production troubleshooting skills.
- Ability to work effectively in a collaborative Agile environment.
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
Nice to Have
\n
- \n
- Delta Lake
- Azure Data Factory
- Azure Synapse
- Kafka or Kinesis
- Streaming/event-driven architectures
- Power BI
- Azure ML
- Experience supporting analytics or machine learning platforms
- Experience working in regulated enterprise environments
- Data security, encryption, and access-control experience
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
Interview Process
\n
The technical interview will include live coding and technical problem-solving.
\n
Candidates should be prepared for:
\n
- \n
- Python/PySpark coding
- SQL testing
- Data engineering scenarios
- Spark/PySpark troubleshooting
- Performance optimization
- Experience-based and scenario-based technical questions
\n
\n
\n
\n
\n
\n
\n
\n
What We're Looking For
\n
\n
We're looking for someone who is genuinely hands-on and comfortable working deep in the technology. Strong candidates will have recent experience building production data solutions rather than simply managing or overseeing them.
\n
\n
Core skills: Python | PySpark | SQL | Databricks | Azure | Data Engineering | Data Lake | ETL/ELT
\n
\n
If you're interested in building scalable data solutions and working with a strong Data & Analytics team, we'd love to hear from you.
\n
\n
A reasonable, good faith estimate of the minimum and maximum hourly wage for this position is $75/Hr. to $85/hr.
\n
\n
Benefits of our contractor
\n
At Harvey Nash, we know that great technology professionals deserve great support. That’s why we offer a comprehensive benefits package designed to help you thrive—professionally and personally. From company-contributed medical, dental, and vision plans to a 401(k), we invest in your health and future. You’ll also enjoy perks like referral bonuses, commuter savings, a mobile payroll app for easy access to your pay and benefits, and a variety of voluntary insurance options to fit your lifestyle. Join a global IT leader that values your expertise, rewards your contributions, and supports your well-being every step of the way.
\n
\n
* The pay range listed above reflects the expected starting salary /Pay rate for this role. This range may be adjusted based on market conditions, location, and other relevant factors. The Company will determine the final starting salary/Pay rate in consultation with the selected candidate(s), in full compliance with applicable laws
\n