Back to All Positions
Senior Data Engineer (Databricks Certification)
Data & AIRemoteFull-timeID: REQ-43672
N2P Systems
Memphis, TN8+ years$0 - $0 USDPosted 1 week ago
Role Overview
## Role Overview
We are seeking an experienced Senior Data Engineer to design and deliver scalable cloud-based data solutions for healthcare analytics. The role requires strong hands-on expertise across Azure Databricks, Spark, Azure data services, modern lakehouse architecture, and healthcare data environments.
The engineer will build enterprise-scale data pipelines and storage solutions, support machine learning and predictive analytics initiatives, maintain data quality and security, and contribute to cloud data architecture decisions. Databricks Certification is mandatory.
## Key Responsibilities
- Build scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Synapse Analytics.
- Work with healthcare data including EHR and claims data.
- Implement Azure Databricks, Data Lake, Azure SQL, and Synapse storage solutions.
- Develop and deploy machine learning and predictive analytics solutions.
- Ensure data quality, security, and HIPAA compliance.
- Collaborate with data scientists, analysts, and engineers.
- Automate workflows using CI/CD and cloud tools.
- Monitor and troubleshoot data pipelines and contribute to architecture decisions.
## What We Are Looking For
- 8+ years of Data Engineering experience with Azure cloud services.
- Strong hands-on expertise with Azure Databricks, Spark, PySpark, SQL, and Python.
- Strong knowledge of Delta Lake and Lakehouse Architecture.
- Experience with Azure Data Factory, Synapse, Data Lake, Azure SQL, and Power BI.
- Experience working with healthcare data and healthcare machine learning/data science use cases.
- Knowledge of FHIR and HL7 healthcare data standards.
- Experience with DevOps and CI/CD practices.
- Mandatory Databricks Certification.
## Preferred & Bonus Experience
- Additional Azure certifications or specialized healthcare analytics credentials.
- Experience delivering production-grade healthcare analytics platforms and predictive modeling solutions in enterprise cloud environments.
Key Responsibilities
- Build scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Synapse Analytics.
- Work with healthcare data including EHR and claims data.
- Implement Azure Databricks, Data Lake, Azure SQL, and Synapse storage solutions.
- Develop and deploy machine learning and predictive analytics solutions.
- Ensure data quality, security, and HIPAA compliance.
- Collaborate with data scientists, analysts, and engineers.
- Automate workflows using CI/CD and cloud tools.
- Monitor and troubleshoot data pipelines and contribute to architecture decisions.
- ## What We Are Looking For
- 8+ years of Data Engineering experience with Azure cloud services.
- Strong hands-on expertise with Azure Databricks, Spark, PySpark, SQL, and Python.
- Strong knowledge of Delta Lake and Lakehouse Architecture.
- Experience with Azure Data Factory, Synapse, Data Lake, Azure SQL, and Power BI.
- Experience working with healthcare data and healthcare machine learning/data science use cases.
- Knowledge of FHIR and HL7 healthcare data standards.
- Experience with DevOps and CI/CD practices.
- Mandatory Databricks Certification.
- ## Preferred & Bonus Experience
- Additional Azure certifications or specialized healthcare analytics credentials.
- Experience delivering production-grade healthcare analytics platforms and predictive modeling solutions in enterprise cloud environments.
Required Skills & Qualifications
- Strong proficiency and experience with Azure Databricks
- Strong proficiency and experience with Spark
- Strong proficiency and experience with PySpark
- Strong proficiency and experience with Synapse Analytics
- Strong proficiency and experience with Delta Lake
- Strong proficiency and experience with Lakehouse Architecture
- Strong proficiency and experience with SQL
- Strong proficiency and experience with Python
- Strong proficiency and experience with Azure Data Factory
- Strong proficiency and experience with Azure Data Lake
- Strong proficiency and experience with Azure SQL
- Strong proficiency and experience with Power BI
- Strong proficiency and experience with Healthcare Data
- Strong proficiency and experience with Machine Learning
- Strong proficiency and experience with Predictive Analytics
- Strong proficiency and experience with FHIR
- Strong proficiency and experience with HL7
- Strong proficiency and experience with DevOps
- Strong proficiency and experience with CI/CD
- Strong proficiency and experience with Azure Cloud Services
- Strong proficiency and experience with Databricks Certification
- Strong proficiency and experience with Apache Spark
- Strong proficiency and experience with Azure Synapse Analytics
Target Tech Stack
Azure DatabricksSparkPySparkSynapse AnalyticsDelta LakeLakehouse ArchitectureSQLPythonAzure Data FactoryAzure Data LakeAzure SQLPower BIHealthcare DataMachine LearningPredictive AnalyticsFHIRHL7DevOpsCI/CDAzure Cloud ServicesDatabricks CertificationApache SparkAzure Synapse Analytics
Quick Details
- Location
- Memphis, TN
- Employment Type
- Full-time
- Work Arrangement
- Remote
- Experience Level
- 8+ years
- Compensation
- $0 - $0 USD
- Domain Focus
- Data & AI
- Requisition Ref
- REQ-43672
Ready to Apply?
Submit your resume and contact information. Our recruitment lead for this role will review your dossier and connect with you.
Apply for this Role