Search

GCP Data Engineer

PublishedPublished: 6/14/2022
Technology

Job Description

Job Description

Required Skills & Experience


-Bachelor’s degree in Computer Science, Engineering, Math, Business, or another technology-focused field with at least 8 years of relevant full-time experience, or a master’s degree in one of these fields with at least 6 years of relevant experience.

-Hands-on data engineering, pipeline architecture, or data-platform operations experience, including experience leading and managing technical teams.

-Extensive experience designing, developing, and operating large-scale data pipelines on Google Cloud Platform.

-Strong working knowledge of GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Dataplex, and Cloud Storage.

-Proficiency in SQL, Python, or Spark for large-scale data processing and data modeling.

-Experience with ETL/ELT pipeline design and workflow orchestration using tools such as Composer or Airflow.

-Experience with CI/CD pipelines and Infrastructure as Code using Terraform.

-Experience defining and managing operational metrics, SLAs, and KPIs for enterprise data-integration platforms.

-Proven ability to review code, guide architecture, troubleshoot complex pipeline issues, and support technical prototyping.

-Valid driver’s license


Nice to Have Skills & Experience


-Master’s degree in Computer Science, Engineering, Math, Business, or another technology-focused field.

-Experience implementing data-governance frameworks, metadata management, lineage, data classification, and data-quality testing.

-Experience with Great Expectations, Dataplex, or Dataform.

-Azure DevOps experience for CI/CD.

-Background in utilities, energy, or another highly regulated industry.

-Exposure to NERC CIP compliance, security protocols, privacy controls, or PII handling.

-Experience migrating data workloads from legacy environments, Azure, Databricks, or C3.ai to GCP.

Familiarity with GCP FinOps, query optimization, storage-cost management, and spend-anomaly identification.

-Experience enabling downstream AI/ML use cases through Vertex AI, Enterprise Gemini, or Model and Agent Garden.

-Google Professional Data Engineer, Google Professional Cloud Architect, or another relevant technical certification.


Job Description


Insight Global is seeking a Systems Manager, GCP Data Engineering for a top energy and utilities client. This hands-on leader will manage a skilled team responsible for designing, building, and maintaining enterprise-grade data pipelines on Google Cloud Platform. The position will oversee the complete data lifecycle, including ingestion, transformation, curation, exposure, and activation, while partnering with architecture, platform, governance, and business teams to deliver trusted data products for analytics and AI/ML use cases. The ideal candidate combines deep expertise in GCP, SQL, Python, Spark, data modeling, and serverless architecture with proven people-management experience and a strong focus on operational excellence, data governance, platform reliability, and FinOps cost efficiency.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...