Search

Spark Data Engineer

PublishedPublished: 6/14/2022
Technology

Job Description

Hiring: Spark/Scala Data Engineer

\n

Location: McLean, VA – Hybrid

\n

Work Model: Hybrid – must be able to work onsite in McLean, VA

\n

Duration: 12-month contract

\n

Pay: $70/hr W2

\n

We’re looking for an experienced Data Engineer to support a large-scale ETL modernization initiative. This role will focus on migrating legacy ETL workloads into a modern Spark/Scala-based architecture while ensuring data accuracy and consistency throughout the migration.

\n

What You’ll Be Doing:

\n

• Build and maintain large-scale data pipelines using Apache Spark and Scala

\n

• Modernize legacy ETL workloads into a newer data architecture

\n

• Support legacy-to-modern ETL migrations

\n

• Perform data comparison, reconciliation, and validation between legacy and modern pipelines

\n

• Identify and troubleshoot data discrepancies during migration

\n

• Ensure migrated pipelines maintain data quality and accuracy

\n

Must-Haves:

\n

• Strong Data Engineering background

\n

• Hands-on Apache Spark experience

\n

• Strong Scala experience

\n

• Data pipeline development experience

\n

• ETL modernization or migration experience

\n

• Data comparison, validation, or reconciliation experience

\n

• Experience working with legacy-to-modern architecture migrations

\n

• Ability to work a hybrid schedule in McLean, VA

\n

The existing environment includes Ab Initio, but prior Ab Initio experience is NOT required.

\n

This is a traditional Data Engineering position. AI/GenAI experience is not required.

\n

If you’re a Senior Data Engineer with strong Spark/Scala experience and are open to a hybrid opportunity in McLean, VA, I’d love to connect.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...