Azure Databricks Engineer Job at Diverse Lynx, Louisville, KY

YWhXOWtmclhqbmkyV0YyL25sOVUvbzU3WEE9PQ==
  • Diverse Lynx
  • Louisville, KY

Job Description

Role: Azure Databricks Engineer Location: Louisville, Kentucky (Day 1 Onsite) Number of opening - 3 Job Description: The Senior Data Engineer will be responsible for the build of Enterprise Data platform. Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data. Build Azure Data Lake leveraging Databricks technology to consolidate all data across the company and serve the data to various products and services. The scope of this role will include working with engineering, product management, program management and operations teams in delivering pipeline platform, foundational and application-specific pipelines and building the Data Lake in collaboration with business and other teams. Responsibilities Design, Develop, Operate and drive scalable and resilient data platform to address the business requirements Drive technology and business transformation through the creation of the Azure Data Lake Ensure industry best practices around data pipelines, metadata management, data quality, data governance and data privacy Partner with Product Management and Business leaders to drive Agile delivery of both existing and new offerings; assist with the Leadership and collaboration with engineering organizations within Change to manage and optimize the portfolio Required Skills 10+ years working experience in Data processing 4+ years working experience in Databricks (essential) and Python Experience with Cloud / Azure architectural components Experience building data pipelines and infrastructure Deep understanding of Data warehousing concepts, reporting and Analytical concepts Experience with Big Data tech stack, including Spark, Scala, and SQL Bachelor's degree in Mathematics, Physical Sciences, Engineering or Computer Science Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company. Diverse Lynx

Job Tags

Work experience placement,

Similar Jobs

Adam Kase - State Farm Agent

Customer Service Representative - State Farm Agent Team Member Job at Adam Kase - State Farm Agent

 ...time off ~ Training & development ROLE DESCRIPTION: As Customer Service Representative - State Farm Agent Team Member for Adam Kase -...  ...skills. Previous experience in insurance or a related field preferred. Flexible work from home options available.... 

Furniture Medic

Furniture Repair Technician Job at Furniture Medic

Furniture Medic is a leading Furniture and Cabinet Restoration Company serving both residential and commercial clients in the Denver Metro...  ...occasionJob Requirements: 10+ years experience with furniture repairs, restoration, and finishing - from start to finishAbility to... 

Sanford Health

RN Clinical Research Coordinator - Diabetes Job at Sanford Health

 ...participation in educating patients, physicians, nurses and other personnel to the research process. Advanced nursing position that involves clinical patient contact, research study coordination and study data management. Must be able to organize complex components of... 

Apmc Moving & Delivery Llc

Courier Driver Independent Contractor Job at Apmc Moving & Delivery Llc

 ...Flexible schedule Free uniforms Opportunity for advancement Training & development Join Our Team as a 1099 Independent Contractor Courier Driver! There is a reason why our contractor's average tenure is over 8 years, we take care of our drivers! If you... 

Minnesota Pollution Control Agency

Document Services Administrator - Office & Admin Specialist Sr Job at Minnesota Pollution Control Agency

 ...Agency, this position is the agency's expert in document file reviews. This position will lead a team of associates in the agency's response...  ...retention. Experience training others to perform tasks. Physical Requirements Requires occasionally lifting such articles as...