Lead Data Engineer Job at SRM Digital LLC, Warren, NJ

WlI2N2xQSFhqM20yVlZ5OG5GbFU5SVYyVlE9PQ==
  • SRM Digital LLC
  • Warren, NJ

Job Description

Key Responsibilities:

  • Design, develop, and maintain scalable and reliable ETL/ELT pipelines on Azure.
  • Work closely with data scientists, analysts, and other stakeholders to deliver end-to-end data solutions.
  • Build and optimize big data pipelines using PySpark and Azure Databricks.
  • Orchestrate data workflows using Apache Airflow or Azure Data Factory.
  • Implement and support MLOps frameworks and deployment pipelines.
  • Monitor, troubleshoot, and ensure data quality and reliability across systems.
  • Drive architectural decisions for data platform components, ensuring best practices are followed.
  • Mentor junior data engineers and contribute to knowledge sharing within the team.

Key Skills and Technologies:

  • Cloud Platforms: Microsoft Azure (Azure Data Lake, Azure Databricks, Azure Synapse, Azure Blob Storage)
  • Programming Languages: Python (strong), SQL
  • Big Data Technologies: PySpark, Spark
  • ETL Tools: Azure Data Factory, custom ETL development
  • Workflow Orchestration: Apache Airflow
  • DevOps/MLOps: Azure ML, MLflow, CI/CD pipelines for ML models
  • Version Control: Git, GitHub/Azure DevOps
  • Other Tools (Preferred): Terraform, Docker, Kubernetes

Job Tags

Similar Jobs

Almost Family

RN Home Care Visit Nurse Job at Almost Family

 ...We are hiring an RN Visit Nurse in Mondovi and the surrounding areas. We have part-timeand...  ...of LHC Group, we embrace a culture of caring, belonging, and trust and enjoy themeaningful...  ...all about helping people.You can find a home for your career here. As a... 

Jackson Hewitt - 2416

Experienced Tax Preparer Job at Jackson Hewitt - 2416

Experienced Tax Preparer Location Brooklyn, NY : Your Purpose: At Jackson Hewitt, we provide an invaluable service in guiding our clients...  ...are highly encouraged to apply! What you'll do here: As a Seasonal Experienced Tax Preparer, you will be responsible for providing... 

Gentle Dental

Dental Assistant, Ortho Job at Gentle Dental

 ...At Gentle Dental, we value our teammates smile as much as our patients smile. Our vision is to provide exceptional, lifelong, integrated oral healthcare services. We enhance the quality of our patients lives by providing accessible oral healthcare, which is paramount... 

Onward Search

Search Engine Optimization Analyst [78250] Job at Onward Search

**1 year contract with a strong chance to extend **Must go onsite 4 days a week; 1 day remote **This role will focus on digital media, search optimization, social media marketing and analytics for the customer engagement team. Summary: Were looking for an SEO... 

AdvisaCare

1st Shift High Tech Home Health Aide or Certified Nursing Assistant Job at AdvisaCare

 ...Strives to be YOUR first choice for employment! AdvisaCare is seeking Top of Line * High Tech Home Health Aides / Certified Nursing Assistants* to service a male client with a Traumatic Brain Injury for Private Duty In-Home Care in the Holland, MI and surrounding...