Job Description
Position: Druid DBA
\n
Position Type: Fulltime
\n
Location: Tampa, FL - Hybrid
\n
\n
Experience: 10 - 15 Years
\n
\n
Desired Skills: Artificial intelligence
\n
\n
Salary Range: $110,000-$125,000 a year
\n
\n
Job Description
\n
\n
Must Have Technical/Functional Skills
\n
Total Experience: 10 to 15+ years of experience in database administration, big data engineering, or systems infrastructure.
\n
● Apache Druid Expertise: Minimum of 5+ years of dedicated, hands-on production experience managing, troubleshooting, and tuning multi-tier Apache Druid clusters.
\n
● Database Metadata Knowledge: Expert proficiency in SQL, PL/SQL, query optimization, and administering relational databases (MySQL, Oracle, and PostgreSQL) serving as Druid metadata stores.
\n
● Streaming & Messaging: Hands-on experience integrating Druid with real-time streaming platforms (Apache Kafka, Amazon Kinesis, Pulsar).
\n
● Distributed Systems & Storage: Solid knowledge of HDFS, AWS S3, or Blob Storage for deep storage management.
\n
● OS JVM Mastery: Deep understanding of Linux OS kernel settings, networking, JVM direct memory allocation, and GC optimization.
\n
● Automation DevOps: Proficiency with Linux/Bash scripting, Python, Ansible playbooks, Terraform, and CI/CD tools (Jenkins, GitLab).
\n
\n
Roles & Responsibilities
\n
We are seeking a Senior Apache Druid Database Administrator (DBA) with extensive hands-on experience in managing, optimizing, and scaling production-grade Apache Druid clusters. In this role, you will be responsible for maintaining high availability, optimizing sub-second OLAP query performance, managing streaming and batch data ingestion pipelines, and ensuring seamless platform operations across petabyte-scale datasets.
\n
The ideal candidate will possess a deep background in distributed systems, advanced database administration, JVM tuning, and real-time event processing. You will work closely with network architects, infrastructure teams, and analytics engineers to ensure robust data reliability, capacity planning, and zero-downtime operations.
\n
\n
Key Responsibilities
\n
1. Cluster Architecture & Administration
\n
● Architect, deploy, configure, and administer multi-node, multi-tiered Apache Druid clusters across Coordinator, Overlord, Broker, Router, Historical, and MiddleManager/Indexer node roles.
\n
● Execute zero-downtime rolling upgrades, patch management, and capacity sizing for multi-tier Historical storage pools and worker parallelism.
\n
● Perform deep JVM tuning across all Druid service roles, including heap allocation, direct memory buffers, G1GC garbage collection parameters, and off-heap memory settings.
\n
● Maintain cluster metadata stores (MySQL / PostgreSQL) and optimize deep storage interfaces (AWS S3, HDFS, or Azure ADLS Gen2).
\n
2. Ingestion & Pipeline Engineering
\n
● Manage and troubleshoot real-time streaming ingestion specs via Apache Kafka Supervisor services and Apache Flink/Spark integration.
\n
● Design and execute batch ingestion specifications using Hadoop-based or native SQL index tasks for historical network datasets (e.g., CDR, IPDR, and telemetry logs).
\n
● Fine-tune ingestion parameters, including taskCount, replicas, segmentGranularity, queryGranularity, and maxRowsPerSegment, to ensure sub-5-second end-to-end ingestion latency.
\n
● Implement dead-letter queue (DLQ) handling, schema evolution management, and schema-validation enforcement.
\n
3. Segment Lifecycle & Performance Tuning
\n
● Design automatic compaction strategies, defining target segment size thresholds and skip offsets to eliminate segment fragmentation.
\n
● Define data retention rules, load/drop policies, and tier assignment rules between hot and cold historical tiers to optimize storage costs against performance SLAs.
\n
● Analyze slow query profiles via Broker access logs to tune dimension/metric cardinality, bitmap indexing, time-based partitioning, and rollup strategies.
\n
● Apply approximate algorithms (e.g., HyperLogLog, Theta Sketches, Quantiles) where appropriate to balance query execution speed with precision.
\n
4. Operations, Observability & Security
\n
● Build operational dashboards and alerts using Prometheus, Grafana, and Splunk/CloudWatch to track key cluster metrics (ingestion lag, segment count, cache hit ratios, GC pauses, memory pressure).
\n
● Enforce security protocols, including Kerberos authentication, TLS/SSL encryption in transit and at rest, Role-Based Access Control (RBAC), and Apache Ranger integration.
\n
● Lead incident response, root cause analysis (RCA), and disaster recovery (DR) drills, maintaining runbooks for automated recovery and zero-loss operations.
\n
• Education: Bachelor’s or master's degree in electrical engineering, telecommunications, computer science, or a related field.
\n
• Experience: 12+ years of experience in mobile network applications, with at least 3 years in architecture and Kubernetes
\n
\n
Generic Managerial Skills:
\n
▪ Crisis Management Staying calm during a massive network outage to direct the IT NOC team effectively.
\n
▪ Stakeholder Mgmt. Explaining to non-technical C-level why a Druid migration is necessary
\n
\n
\n
Regards,
\n
\n
Sajith Nair
\n
Ztek Consulting Inc.
\n