Job Description
Job DescriptionOnly W2 Remote Position Job description:
Under general supervision, will oversee and expand the systems we use to gather, store, retrieve and analyze data on how customers are using client products. ESSENTIAL FUNCTIONS
- Identifies opportunities to automate data engineering processes and executes with direction of peers and management.
- Maintains and improves the quality of data for all systems.
- Ensures data management best practices are followed in all work efforts.
- Documents all activities on how to support data engineering processes.
- Coordinates with other teams to ensure duties are completed on-time and accurately.
- Adheres to internal and client related compliance and security standards with all activities.
- Define best practices for data platform implementations.
- Create implementation, monitoring, and alerting solutions for data platforms.
- Design, manage, and deploy infrastructure as code solutions.
- Design data solutions for business units and software engineering teams.
- Develop data pipelines to support BU and software engineer’s data requirements.
- Ensure data solutions meet security and audit requirements.
MINIMUM QUALIFICATIONS
- BS or MS degree in Computer Science or a related industry experience field
- Minimum of 8 years of experience in data engineering and software development
- An equivalent combination of education and experience sufficient to successfully perform the essential functions of the job.
- Applicable technical certification(s) preferred.
REQUIRED KNOWLEDGE AND SKILLS
- Google Cloud
- Python, Golang
- Google Dataflow (based on Apache beam)
- BigQuery, Spanner
- Google PubSub
- Batch and Streaming workloads
- Experience in writing infrastructure as code through products like Terraform or Ansible
- Apache Airflow or other orchestration
- Multitenant and/or large systems with hundreds of sites comprising hundreds of files/streams each
- Excellent communication and customer interaction skills.
- Assists team leadership and senior team members to plan, prioritize and organize a diversified workload.
- Able to multi-task and resolve issues.
- Understand the need to regard confidential customer and company information with the highest regard.
- Meets Deadlines and demonstrates the ability to deliver under pressure.
- Strong analytic skills related to working with structured and unstructured datasets.
- Strong project management and organizational skills.
- Experience or knowledge of Agile Software Development processes
- Excellent problem solving and troubleshooting skills
- Process oriented with great documentation skills