Search

Databricks Administrator

PublishedPublished: 6/14/2022
Technology
|

Job Description

Databricks Administrator

\n

Location: Washington, DC — fully onsite; telework is not available.

\n

Assignment: Six-month contract with possible extension.

\n

Schedule: Standard business hours; overtime is not expected.

\n

Our corporate client is seeking an experienced Databricks Administrator to help build, secure, and optimize a Lakehouse platform supporting data engineering, analytics, machine learning, and AI. You will work with engineering, data science, analytics, and infrastructure teams as a technical expert, solving complex production challenges and helping teams get the most from Databricks.

\n

What you will do

\n

    \n
  • Design and optimize Databricks solutions using Unity Catalog, Delta Lake, Databricks SQL, Workflows, Jobs, and Mosaic AI.
  • \n

  • Build scalable ingestion, transformation, and orchestration pipelines with Spark, Delta Live Tables, and Auto Loader.
  • \n

  • Tune Spark jobs, clusters, and SQL queries; improve performance, autoscaling, resource utilization, and cost efficiency.
  • \n

  • Implement Unity Catalog governance, access controls, security standards, and compliance practices.
  • \n

  • Support ML and generative AI workloads using MLflow, Feature Store, Vector Search, and Mosaic AI.
  • \n

  • Troubleshoot production issues, perform root-cause analysis, and implement monitoring, logging, and alerts.
  • \n

  • Integrate Databricks with cloud platforms, ETL, BI, catalog, and orchestration tools.
  • \n

  • Automate deployment and platform management, document best practices, and mentor technical teams.
  • \n

\n

What you bring

\n

    \n
  • 7+ years in data engineering or architecture, including at least 4 years focused on Databricks.
  • \n

  • Hands-on Unity Catalog implementation experience, including row- and column-level security and governance across workspaces.
  • \n

  • Advanced Spark performance tuning, including data skew, shuffles, Adaptive Query Execution, caching, and Photon.
  • \n

  • Production experience building generative AI or LLM applications with Mosaic AI, Vector Search, and MLflow.
  • \n

  • Advanced Python, Scala, and SQL skills for distributed computing.
  • \n

  • Infrastructure as Code experience, such as Terraform, to manage Databricks workspaces, clusters, and permissions.
  • \n

  • Secure networking experience with Private Link or VPC peering, customer-managed encryption keys, and IP access lists.
  • \n

  • CI/CD experience with GitHub Actions, Azure DevOps, or GitLab, using Databricks Asset Bundles or the Databricks CLI.
  • \n

  • A bachelor’s degree in Computer Science, Information Technology, Data Management, or a related field, or equivalent relevant work experience.
  • \n

  • U.S. citizenship is required. Public Trust approval is required before starting; candidates with an active Public Trust are preferred.
  • \n

  • Ability to work fully onsite in Washington, DC.
  • \n

\n

Preferred qualifications

\n

    \n
  • Databricks certifications in solutions architecture, professional data engineering, or professional machine learning.
  • \n

  • AWS or Azure architecture certification.
  • \n

\n

Interview process: Phone or video interview.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...