Job Description
Job Description
Senior Software Engineer - Data
Full-time/Hybrid
Sunnyvale, CA
$180K - $220K
About this role
We're in search of a Senior Software Engineer who brings a passion for innovation and problem-solving, not limited to traditional data engineering. This role is for those with deep expertise in building large-scale data pipelines, SQL optimization, and cloud infrastructure, excited to design and build the backbone of our AI-powered data solutions. The ideal candidate will play a crucial role in enhancing our AI capabilities, developing high-performance data systems, and integrating advanced AI using the product into thousands of data teams' daily workflows.
Projects You'll Work On:
- Building PB Scale Data Pipelines: Building a highly performant, large-scale data infrastructure that can scale to 100K+ jobs and handle PB-scale data per day.
- Cloud-Native Data Infrastructure: Design and implement robust, scalable data infrastructure on AWS, utilizing Kubernetes and Airflow for efficient resource management and deployment.
- Intelligent SQL Ecosystem: Design and develop a comprehensive SQL intelligence system encompassing query optimization, dynamic pipeline generation, and data lineage tracking. Leverage your expertise in SQL query profiling, AST analysis, and parsing to create a sophisticated engine focused on query performance improvements, building adaptive data pipelines, and implementing granular column-level lineage.
Impact:
- Innovation at the Forefront: Push the boundaries of data engineering by combining traditional techniques with cutting-edge AI technologies.
- High Visibility: Directly affect the productivity and capabilities of global data teams, as your contributions will be crucial to the daily operations of thousands of users spread across 100s of countries.
- Open Source Contribution: As part of our commitment to the developer community, you will contribute to our open-source initiatives, gaining recognition in the tech community.
Requirements
- 7+ years of experiencein software/data engineering, with a focus on building scalable data pipelines and systems
Tech stack
- Python
- SQL
- SQL Abstract Syntax Tree (AST)
- dbt
- Airflow
- AWS
- Kubernetes
Equity
0.05% - 0.3%
Visa sponsorship available
No new H1-B
Hybrid work policy
3 days onsite in our Sunnyvale office
About
Our client founded in 2022 in San Francisco, is revolutionizing enterprise data operations through the power of AI. Our mission is to alleviate the burden on overworked and understaffed enterprise data teams by providing innovative AI-driven solutions that automate and accelerate a wide range of data tasks.
Our flagship product, offers advanced data automation capabilities, while our new technology brings the concept of agentic AI to data operations, acting as virtual teammates for data professionals. Our solutions seamlessly fit into existing tools like VSCode, Git, and Slack, performing tasks ranging from data documentation to performance optimization.We are an engineering heavy team with top talent from companies like Uber, Google, and Autopilot along with active members of the open source community.
By leveraging a proprietary framework that combines multiple language models and a custom-built knowledge graph, we enable contextually aware AI agents that integrate seamlessly into existing workflows. Our solutions, for continuous monitoring and optimization, are designed to meet the growing demands of data operations, business intelligence, and analytics in an era of ever-increasing data volumes.
Founded
2022
Total funding
$12M