Senior Data Engineer
Posted
Job Overview:
- On-site in Washington, DC (locals preferred).
- Expected projected duration: 12+ Months
- 40 hours/week.
- Requires Bachelor's degree and 7+ years of experience.
- Medicaid/Medicare data structures (MMIS, EDI 837/835, claims processing; 3+ years) will be given priority.
- Maintain, troubleshoot, and modify complex SSIS packages for high-volume Medicaid claims, provider, and member data.
- Manage code deployments and branching strategies in Team Foundation Server (TFS) for continuous integration of legacy SQL assets.
- Support and optimize SSRS report queries and SSAS tabular/multidimensional models for federal and state compliance reporting.
- Implement Medallion Architecture (Bronze/Silver/Gold) using Azure Databricks (PySpark/SQL).
- Lead transition of legacy SSIS logic into Azure Data Factory (ADF) and Databricks notebooks.
- Facilitate migration of source control and CI/CD pipelines from TFS to Azure DevOps (Git).
- Build and tune Dedicated and Serverless SQL Pools in Azure Synapse for advanced analytics and AI-readiness.
- Implement Row-Level Security (RLS) and automated data masking for PHI/PII per HIPAA, CMS MARS-E, and NIST standards.
- Develop automated data validation frameworks to ensure data parity between legacy SQL systems and Cloud Lakehouse.
- SQL Server including SSIS, SSAS, SSRS while deploying Azure cloud solutions.
- Expert SSIS and T-SQL.
- Advanced Azure Databricks (Unity Catalog, Delta Lake) and Azure Synapse.
- TFS with migration to Git/Azure DevOps.
- SQL and Python (PySpark).
- Leading advanced technology or service projects.
- Full system engineering lifecycle.
- ITIL practices.
- End-to-end project delivery and consulting leadership.
- English (native or bilingual).
- Microsoft Purview for data cataloging (3+ years).
- Medicaid/Medicare data structures (MMIS, EDI 837/835, claims processing; 3+ years).
- Microsoft Certified: Azure Data Engineer Associate or Databricks Certified Professional Data Engineer.
- Government or highly regulated environment experience (7+ years).
