Big Data Engineer (Databricks admin)

  • Job type

  • Location

  • Profession

  • Industry

    Technology & Internet Services
  • Pay

    $60.00 - $75.00/hr.
  • Closing date

    23 Jun 2024

Big Data Engineer (Databricks admin) – Contract – Atlanta, GA – $60.00 - $75.00/hr.

The final salary or hourly wage, as applicable, paid to each candidate/applicant for this position is ultimately dependent on a variety of factors, including, but not limited to, the candidate’s/applicant’s qualifications, skills, and level of experience as well as the geographical location of the position.

Applicants must be legally authorized to work in the United States. Sponsorship not available.

Our client is seeking a Big Data Engineer (Databricks admin) in Atlanta, GA.

Role Description

Responsibilities will include designing, implementing, maintaining databricks platform, and providing operational support. Operational support responsibilities include platform set up and configuration, workspace administration, resource monitoring, provide technical support to data engineering, Data Science/ML, Application/integration teams, performing restores/recoveries, troubleshooting service issues, determining the root causes of issues, and resolving issues. The position will also involve management of security and changes.

The position will work closely with the Team Lead, other Databricks Administrators, System Administrators, and Data Engineers/Scientists/Architects/Modelers/Analysts. This position will involve participation in on-call rotation for 24/7 support.
This position reports to the Client Corporation's HQ building in Midtown Atlanta with easy access to MARTA Train & Bus Service and the interstate.

• Responsible for the administration, configuration, and optimization of the Databricks platform to enable data analytics, machine learning, and data engineering activities within the organization.
• Collaborate with data engineering team to ingest, transform, and orchestrate data.
• Manage privileges over the entire Databricks account, as well as at workspace level, Unity Catalog level and SQL warehouse level.
• Create workspaces, configure cloud resources, view usage data, and manage account identities, settings, and subscriptions.
• Install, configure, and maintain Databricks clusters and workspaces.
• Maintain Platform currency with security, compliance, and patching best practices.
• Monitor and manage cluster performance, resource utilization, platform costs, and troubleshoot issues to ensure optimal performance.
• Implement and manage access controls and security policies to protect sensitive data.
• Manage schema data with Unity Catalog - create, configure, catalog, external storage, and access permissions.
• Administer interfaces with Azure AD and Amazon AWS.
• Hadoop admin skills are preferred
• Knowledge about Apache Kafka is desirable

Skills & Requirements


4-yr College Degree preferably in Information Systems, Computer Science, Engineering, or related field.

• 3+ years of production support of Databricks platform

• 2+ years AWS/Azure PaaS
• 2+ years of automation framework such as Terraform
• 2+ years of Hadoop administration (Cloudera/Hortonworks)
• 2+ years of Apache Kafka streaming platform administration

Benefits/Other Compensation

This position is a contract/temporary role where Hays offers you the opportunity to enroll in full medical benefits, dental benefits, vision benefits, 401K and Life Insurance ($20,000 benefit).

Why Hays?

You will be working with a professional recruiter who has intimate knowledge of the industry and market trends. Your Hays recruiter will lead you through a thorough screening process in order to understand your skills, experience, needs, and drivers. You will also get support on resume writing, interview tips, and career planning, so when there’s a position you really want, you’re fully prepared to get it.

Nervous about an upcoming interview? Unsure how to write a new resume?

Visit the Hays Career Advice section to learn top tips to help you stand out from the crowd when job hunting.

Hays is committed to building a thriving culture of diversity that embraces people with different backgrounds, perspectives, and experiences. We believe that the more inclusive we are, the better we serve our candidates, clients, and employees. We are an equal employment opportunity employer, and we comply with all applicable laws prohibiting discrimination based on race, color, creed, sex (including pregnancy, sexual orientation, or gender identity), age, national origin or ancestry, physical or mental disability, veteran status, marital status, genetic information, HIV-positive status, as well as any other characteristic protected by federal, state, or local law. One of Hays’ guiding principles is ‘do the right thing’. We also believe that actions speak louder than words. In that regard, we train our staff on ensuring inclusivity throughout the entire recruitment process and counsel our clients on these principles. If you have any questions about Hays or any of our processes, please contact us.

In accordance with applicable federal, state, and local law protecting qualified individuals with known disabilities, Hays will attempt to reasonably accommodate those individuals unless doing so would create an undue hardship on the company. Any qualified applicant or consultant with a disability who requires an accommodation in order to perform the essential functions of the job should call or text 813.336.5570.

Drug testing may be required; please contact a recruiter for more information.


Apply for this job