Lead Data Engineer Job at Incedo Inc., Atlanta, GA

WnhTMWtQSGRpWDI4VVZ5OG5GcFg5WUo5Vmc9PQ==
  • Incedo Inc.
  • Atlanta, GA

Job Description

Job Title: : Lead Data Engineer

Location : Encino CA /LA California /Atlanta GA

Duration : Fulltime

Role Overview:

We are seeking a Lead Data Engineer with expertise in data modeling , Data Vault architecture , and cloud data warehouse (CDW) architecture utilizing the Kimball model . The ideal candidate will have hands-on experience with data fabric technologies (e.g., Databricks), Spark , and Python on Azure Cloud . This role involves designing, implementing, and optimizing data pipelines and data platforms to support business intelligence and advanced analytics.

Key Responsibilities:

  • Design and implement scalable and efficient data models, including Data Vault and Kimball dimensional modeling for cloud-based data warehouses.
  • Architect and manage Azure Cloud -based data infrastructure, ensuring scalability, security, and performance.
  • Develop and optimize data pipelines using Databricks , Spark , and other data fabric tools to process large volumes of data.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver high-quality solutions.
  • Implement best practices for data engineering, including data quality, governance, and lifecycle management.
  • Build and maintain infrastructure-as-code using Terraform or other DevOps tools.
  • Create reusable data engineering components for ingestion, transformation, and orchestration.
  • Troubleshoot, optimize, and maintain existing data systems to meet evolving business needs.

Required Skills and Experience:

  • 10+ years of experience in Data Engineering or a similar role, with a proven track record of leading data projects.
  • Expertise in Data Vault 2.0 architecture and Kimball modeling for data warehouse design.
  • Proficiency with Azure Data Services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks).
  • Hands-on experience with Databricks and Spark for distributed data processing.
  • Strong programming skills in Python for ETL/ELT development and automation.
  • Deep understanding of CDW architecture and data fabric frameworks .
  • Experience with CI/CD pipelines and infrastructure-as-code tools like Terraform .
  • Solid knowledge of data governance, security, and compliance best practices.

Educational Qualifications:

  • Bachelor’s degree in Computer Science, Data Engineering, or related fields. Master’s degree preferred.
  • Certifications in Data Engineering , Azure Cloud , or Databricks are highly desirable.

Job Tags

Full time,

Similar Jobs

Yale New Haven Health

Registered Nurse - Sign-on Bonus Job at Yale New Haven Health

 ...professionals, every day.As an integral member of the Yale New Haven Health System (YNHHS) healthcare team, the Registered Professional...  ...delivery and transitions in care. Health Teaching and Health Promotion: The RN employs strategies to promote health and a safe... 

Global Channel Management, Inc.

Training Coordinator Job at Global Channel Management, Inc.

Training Coordinator needs 4+ years experience Training Coordinator requires: Hybrid. Report in office 1 day a week on Wednesday WebEx Teams Articulate 360 - Rise Word, PowerPoint, Excel Video Editing Software (e.g., Camtasia, Filmora, etc.) Time... 

Entech Network Solutions, LLC.

Junior Project Manager (Asphalt/Paving) Job at Entech Network Solutions, LLC.

 ...Position Overview: The Estimator will play a key role in preparing accurate cost estimates for projects, analyzing project documents, and collaborating with project managers, clients, and subcontractors to ensure comprehensive and competitive proposals. Key... 

Paladin Consulting

2nd shift Legal Office Services Clerk Job at Paladin Consulting

 ...Job Description & Responsibilities : ~3pm-12 am ~ This role takes place in a law firm. ~ The role requires working in a duplicating center completing printing and scanning projects. Skills & Qualifications : The manager is looking for someone with experience... 

Minnesota Pollution Control Agency

County Feedlot Program Development Lead - Environmental Specialist 4 Job at Minnesota Pollution Control Agency

 ...Title: County Feedlot Program Development Lead Job Class: Environmental Specialist 4 Agency: Pollution Control Agency Job ID :...  ...State of Minnesota, employees play a critical role in developing policies, providing essential services, and working to improve the...