The final salary or hourly wage, as applicable, paid to each candidate/applicant for this position is ultimately dependent on a variety of factors, including, but not limited to, the candidate’s/applicant’s qualifications, skills, and level of experience as well as the geographical location of the position.

Applicants must be legally authorized to work in the United States. Sponsorship not available.

Our client is seeking a Sr Data Engineer in for a remote opportunity

Role Description

The Life, Annuity, and Long Term Care Data Solutions team —responsible for end to end data architecture, data governance, and data engineering from source systems to data consumers—is seeking a Principal Data Engineer with strong Databricks expertise (3–5 years required) and proven experience and subject matter expertise in building analytical pipelines from ingestion, data standardization, and curation that includes raw, entity relationship model in a relational model, and dimensional models.
In this role, you will lead and implement with guidance on using the current architecture and design patterns with no mentoring expected in using current DataBricks features. You will perform all roles in the software development lifecycle including business requirements definition, design, build, test, and run. You will lead the definition of best practices, establish common code frameworks, elevate engineering maturity, prove out and determine when new DataBricks features should be implemented, and ensure consistent delivery of high quality data products and analytical solutions across build teams that will enhance the current architecture.
You will be part of a high performing, mission driven organization of 20 individuals across four agile teams. Collaboration will be central as you work closely with the solution architects, agile team tech leads, business stakeholders, and other partners across security, cloud, testing, and data modeling.
The platform leverages a modern streaming architecture supporting both transactional and analytical pipelines, grounded in Medallion and OneLake design principles. A primary outcome for this role and others on the team is overseeing the implementation of DataBricks that will replace many legacy analytical platforms that result in new and better business outcomes.

• Perform hands on designing, building, testing, and supporting analytical pipelines.
• Establishing and enforcing design, engineering, and coding standards, including code reviews.
• Leading CI/CD and design of reusable data tests for future releases.
• Expanding your expertise into AI, ML, Lakebase, and other capabilities available on the DataBricks platform to these features are implemented as needed.
• Driving Spark performance optimization and leading platform cost optimization opportunities.
• Managing production monitoring, troubleshooting, and defect resolution.

Skills & Requirements

• 3-5 years experience with Databricks required (they should know how to ingest data into Databricks;
• Must have PySpark experience (which is combination of Python and SQL)
• Must have 3-5 years in general analytics, data warehousing, and modern data engineering practices
• 3-5 years SQL experience
• Proven experience leading and performing all SDLC roles not just building
• Healthcare data would be preferred ; Any Cloud (ie Azure) preferred; Familiarity with Data Governance and data quality.

Benefits/Other Compensation
This position is a contract/temporary role where Hays offers you the opportunity to enroll in full medical benefits, dental benefits, vision benefits, 401K and Life Insurance ($20,000 benefit).

Why Hays?

You will be working with a professional recruiter who has intimate knowledge of the industry and market trends. Your Hays recruiter will lead you through a thorough screening process in order to understand your skills, experience, needs, and drivers. You will also get support on resume writing, interview tips, and career planning, so when there’s a position you really want, you’re fully prepared to get it.

Nervous about an upcoming interview? Unsure how to write a new resume?

Visit the Hays Career Advice section to learn top tips to help you stand out from the crowd when job hunting.

Hays is committed to building a thriving culture of diversity that embraces people with different backgrounds, perspectives, and experiences. We believe that the more inclusive we are, the better we serve our candidates, clients, and employees. We are an equal employment opportunity employer, and we comply with all applicable laws prohibiting discrimination based on race, color, creed, sex (including pregnancy, sexual orientation, or gender identity), age, national origin or ancestry, physical or mental disability, veteran status, marital status, genetic information, HIV-positive status, as well as any other characteristic protected by federal, state, or local law. One of Hays’ guiding principles is ‘do the right thing’.
We also believe that actions speak louder than words.
In that regard, we train our staff on ensuring inclusivity throughout the entire recruitment process and counsel our clients on these principles. If you have any questions about Hays or any of our processes, please contact us.

In accordance with applicable federal, state, and local law protecting qualified individuals with known disabilities, Hays will attempt to reasonably accommodate those individuals unless doing so would create an undue hardship on the company. Any qualified applicant or consultant with a disability who requires an accommodation in order to perform the essential functions of the job should call or text 813.336.5570.

Drug testing may be required; please contact a recruiter for more information.

#LI-DNI