Data Engineer - Snowflake and Databricks Job at Expedite Technology Solutions, Seattle, WA

WlI2MGwvM2VpMzY4V0ZxNm4xaFUrbzUrWFE9PQ==
  • Expedite Technology Solutions
  • Seattle, WA

Job Description

Primary Skill: DBT Labs Snowflake Secondary Skill: Databricks Databricks Unity Catalog Responsibilities: Develop, optimize, and maintain data pipelines using Azure Data Factory (ADF), DBT Labs, Snowflake, and Databricks. Develop reusable jobs and configuration-based integration framework to optimize development and scalability. Manage data ingestion for structured and unstructured data (landing/lake house: ADLS, Sources: ADLS, Salesforce, SharePoint Documents Libraries, Partner Data: Client, IHME, WASDE, etc.). Implement and optimize ELT processes, source-to-target mapping, and transformation logic in DBT Labs, Azure Data Factory, Databricks Notebook, Snow SQL, etc. Collaborate with data scientists, analysts, data engineers, report developers, and infrastructure engineers for end-to-end support. Co-develop CI/CD best practices, automation, and pipelines with Infrastructure engineers for code deployments using GitHub Actions. Bring in automation from source-to-target mappings to data pipelines and data lineage in Collibra. Required Experience: Hands-on experience building pipelines with ADF, Snowflake, Databricks, and DBT Labs. Expertise in Azure Cloud with Databricks, Snowflake, and ADLS Gen2 integration. Data Warehousing and Lakehouse Knowledge: Proficient with ELT processes, *** Tables, and External Tables for structured/unstructured data. Experience with Databricks Unity Catalog and data sharing technologies. Strong skills in CI/CD (Azure DevOps, GitHub Actions) and version control (GitHub). Strong cross-functional collaboration and technical support experience for data scientists, report developers, and analysts. #J-18808-Ljbffr Expedite Technology Solutions

Job Tags

Similar Jobs

Apache Logistics

2nd Shift Local Truck Driver Class A Job at Apache Logistics

 ...Saturday rotation - 2:00 pm start time - Guaranteed 40 hours per week - Day cab tractor with 42' - 48' dry van trailer and straight trucks - Covering on various routes - Delivery and pickups of linens at medical facilities - Operate lift gate when needed -... 

Providence at Home with Compassus

Nursing Tech / CNA Job at Providence at Home with Compassus

 ...patient-centered healthcare. We are seeking a Certified Nursing Assistant (CNA) who is passionate about making a meaningful impact in...  ...with a supportive team using the latest tools and technologies to deliver exceptional care. Enhanced Benefits: Enjoy competitive... 

Christus Health

IT Engineer - Data Center Services Job at Christus Health

 ...with backup solutions and architecture, including administration, configuration, and troubleshooting of EMC Networker Applications and Data Domain/Quantum hardware. Familiarity with VMware or Microsoft Hyper-V virtualization technologies. Experience maintaining a... 

HORTA-SANTINI EYE CARE

Optometrist (New York) Job at HORTA-SANTINI EYE CARE

 ...Horta-Santini Eye Care is excited to announce an opening for a skilled optometrist to join our team. We are a well established solo ophthalmology (glaucoma specialist) in Corona, Queens. 3 minutes walking from the 7-line subway station (103rd st). Why join us? Work... 

Elevance Health

Remote work | Nurse Reviewer I (US) Job at Elevance Health

1 day ago Be among the first 25 applicantsNurse Reviewer INurse Reviewer ILocation: Virtual: This role enables associates to work virtually...  ...experience preferred.For candidates working in person or remotely in the below location(s), the salary* range for this specific...