Search

Lead Data Engineer

PublishedPublished: 6/14/2022
Technology
|

Job Description

Job Description: Lead Data Engineer (GCP Dataproc & BigQuery)

\n

Location: Edison, NJ (Onsite)

\n

Employment Type: Full-Time

\n

Experience Required: 10+ Years

\n


\n

Position Overview

\n

We are seeking a highly skilled Lead Data Engineer with deep expertise in Google Cloud Platform (GCP), specifically Dataproc and BigQuery, to lead the design, development, and optimization of enterprise-scale data platforms and analytics solutions. This is an onsite role based in Edison, NJ.

\n

The ideal candidate will possess strong technical leadership capabilities, exceptional communication skills, and a proven ability to solve complex data engineering challenges. This individual will work closely with business stakeholders, architects, data scientists, and engineering teams to deliver scalable, high-performance data solutions that drive business outcomes.

\n

Key Responsibilities

\n

    \n
  • Lead the design and implementation of large-scale data engineering solutions on GCP.
  • \n

  • Architect and develop robust ETL/ELT pipelines using Dataproc, BigQuery, and related GCP services.
  • \n

  • Build scalable data ingestion, transformation, and processing frameworks for structured and unstructured data.
  • \n

  • Optimize data models, query performance, and processing efficiency within BigQuery environments.
  • \n

  • Drive cloud migration and modernization initiatives from on-premise or legacy platforms to GCP.
  • \n

  • Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.
  • \n

  • Mentor and guide data engineers through code reviews, design discussions, and best practice adoption.
  • \n

  • Establish data quality, governance, security, and operational monitoring standards.
  • \n

  • Troubleshoot and resolve complex production issues while ensuring platform reliability and performance.
  • \n

  • Communicate effectively with technical and non-technical stakeholders, including executive leadership.
  • \n

\n


\n

Required Qualifications

\n

    \n
  • 10+ years of experience in Data Engineering, Data Warehousing, or Big Data ecosystems.
  • \n

  • 5+ years of hands-on experience with Google Cloud Platform (GCP).
  • \n

  • Strong expertise in:
  • \n

  • Google BigQuery
  • \n

  • Google Dataproc
  • \n

  • Cloud Storage (GCS)
  • \n

  • Cloud Composer / Airflow
  • \n

  • Pub/Sub
  • \n

  • Dataflow (preferred)
  • \n

  • Advanced SQL development and query optimization skills.
  • \n

  • Strong experience with Python, PySpark, or Spark-based data processing frameworks.
  • \n

  • Experience building enterprise-scale batch and real-time data pipelines.
  • \n

  • Strong understanding of data modeling, dimensional modeling, and data warehouse concepts.
  • \n

  • Experience with CI/CD, DevOps practices, and cloud-native architecture patterns.
  • \n

\n


\n

Leadership & Communication Requirements

\n

    \n
  • Exceptional verbal and written communication skills.
  • \n

  • Proven ability to lead client-facing discussions and technical workshops.
  • \n

  • Strong stakeholder management and requirements-gathering experience.
  • \n

  • Ability to influence architecture decisions and drive consensus across teams.
  • \n

  • Demonstrated capability to present complex technical concepts to business audiences.
  • \n

  • Strong mentoring and team leadership skills.
  • \n

\n


\n

Problem-Solving Expectations

\n

The successful candidate will:

\n

    \n
  • Exhibit outstanding analytical and troubleshooting abilities.
  • \n

  • Drive root cause analysis and resolution for complex data platform issues.
  • \n

  • Identify optimization opportunities across architecture, performance, and cost management.
  • \n

  • Provide innovative solutions to business and technical challenges.
  • \n

  • Thrive in fast-paced, highly collaborative environments.
  • \n

\n


\n

Preferred Qualifications

\n

    \n
  • Experience with Terraform, Infrastructure as Code (IaC), and cloud automation.
  • \n

  • Exposure to data governance and metadata management tools.
  • \n

  • Experience with Snowflake, Databricks, or other modern cloud analytics platforms.
  • \n

  • GCP Professional Data Engineer certification.
  • \n

  • Experience leading distributed or offshore teams.
  • \n

\n


\n

Education

\n

    \n
  • Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or related field.
  • \n

\n


Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...