Data Engineer - Snowflake and Databricks Job at Expedite Technology Solutions, Seattle, WA

WlI2MGwvM2VpMzY4V0ZxNm4xaFUrbzUrWFE9PQ==
  • Expedite Technology Solutions
  • Seattle, WA

Job Description

Primary Skill: DBT Labs Snowflake Secondary Skill: Databricks Databricks Unity Catalog Responsibilities: Develop, optimize, and maintain data pipelines using Azure Data Factory (ADF), DBT Labs, Snowflake, and Databricks. Develop reusable jobs and configuration-based integration framework to optimize development and scalability. Manage data ingestion for structured and unstructured data (landing/lake house: ADLS, Sources: ADLS, Salesforce, SharePoint Documents Libraries, Partner Data: Client, IHME, WASDE, etc.). Implement and optimize ELT processes, source-to-target mapping, and transformation logic in DBT Labs, Azure Data Factory, Databricks Notebook, Snow SQL, etc. Collaborate with data scientists, analysts, data engineers, report developers, and infrastructure engineers for end-to-end support. Co-develop CI/CD best practices, automation, and pipelines with Infrastructure engineers for code deployments using GitHub Actions. Bring in automation from source-to-target mappings to data pipelines and data lineage in Collibra. Required Experience: Hands-on experience building pipelines with ADF, Snowflake, Databricks, and DBT Labs. Expertise in Azure Cloud with Databricks, Snowflake, and ADLS Gen2 integration. Data Warehousing and Lakehouse Knowledge: Proficient with ELT processes, *** Tables, and External Tables for structured/unstructured data. Experience with Databricks Unity Catalog and data sharing technologies. Strong skills in CI/CD (Azure DevOps, GitHub Actions) and version control (GitHub). Strong cross-functional collaboration and technical support experience for data scientists, report developers, and analysts. #J-18808-Ljbffr Expedite Technology Solutions

Job Tags

Similar Jobs

TA Group Financial

B2B Sales Manager Job at TA Group Financial

 ...experience, servant mentality, but also strive to coach and train their peers to progress into next steps of their careers. As a B2B Sales Manager you will receive comprehensive resources to swiftly grasp our operations and excel in using our proven sales structure.... 

Presbyterian Healthcare Services

Radiographer - PRESNow - ABQ - 24/7 ED/UC Paseo Job at Presbyterian Healthcare Services

 ...Essential: NM Radiography Tech Rad Tech-Radiography Temp NM Radiography Tech Current BLS is required. Responsibilities...  ...account a wide range of factors, including but not limited to experience and training, internal equity, and other business and... 

Bosch Group

Industrial Engineering Intern Job at Bosch Group

 ...of mobility solutions, consumer goods, industrial technology or energy and building technology...  ...Description This is not a summer internship. It is a year round, part-time position...  ..., North Carolina. As an Industrial Engineering Intern at LctP Manufacturing (Robert... 

Virginia Hospital Center

Epic HIM Applications Analyst II Job at Virginia Hospital Center

Position Title: Epic HIM Applications Analyst IIPurpose & Scope: The HIM Applications Analyst will serve as the primary contact in the development and functionality of the Epic system/application. This role provides consultation and coordinates design, build, testing,... 

Solventum

Machine Operator Job at Solventum

 ...disability, or status as a protected veteran. Job Description: 3M Health Care is now Solventum Solventum is seeking Machine Operator candidates to join our team in Brookings SD! Starting Pay: $24.39/hour + Shift Differentials Shift: 8, 10, or 12 hour...