Senior Data Engineer

New Canaan, Connecticut

Silver Hill Hospital
Apply for this Job
The Senior Data Engineer architects and optimizes data infrastructure to support both clinical operations and marketing initiatives, ensuring seamless data flow from EHRs, patient records, and digital marketing platforms. This position enables personalized patient engagement, compliance reporting, and ROI analysis for outreach campaigns. This position requires deep expertise in Google Big Query, ETL/ELT pipelines, and data warehousing, coupled with experience in the Mental Health Hospital sector and familiarity with marketing systems (CDPs, CRMs, campaign analytics). The Senior Data Engineer reports to the Director of IT.

Duties/Responsibilities:
  • Design, build, and maintain scalable ETL/ELT pipelines in Google BigQuery for mental health data, including EHRs, claims, and IoT sources.
  • Architect and manage data warehouses using dimensional modeling techniques (star schema, data vault).
  • Ensure high performance of BigQuery environments through query optimization, partitioning, and cost control strategies.
  • Ingest and integrate data from Meditech, Health Cloud, HL7/FHIR streams, and digital marketing platforms (Salesforce, HubSpot, Google Analytics).
  • Develop real-time data pipelines using technologies like Kafka, Spark, Fivetran, and Supermetrics.
  • Implement and maintain strict data governance practices ensuring HIPAA, GDPR, and 42 CFR Part 2 compliance.
  • Maintain data lineage, metadata management, and audit trails across systems involving PHI.
  • Integrate CRM/CDP data with clinical systems to enable targeted patient outreach and personalization.
  • Support marketing attribution models (multi-touch, MMM) and campaign ROI tracking.
  • Analyze marketing and operational data to derive insights on patient acquisition costs, lifetime value, and engagement.
  • Collaborate cross-functionally with IT, clinical teams, and marketing stakeholders to align data strategies with organizational goals.
Required Skills/Abilities:
  • Must have the ability to function optimally in a stressful environment, and the ability to remain calm in emotionally charged situations
  • Proficient in Microsoft Office applications.
  • Strong proficiency in SQL, Python, and data infrastructure tools (BigQuery, Fivetran, Spark, dbt, Airflow).
  • Experience with CDPs, CRMs, and marketing analytics platforms.
  • Knowledge of data security standards including HIPAA, GDPR, and CCPA.
  • Familiarity with data visualization tools like Looker or Tableau.
  • Excellent communication and collaboration skills, especially across interdisciplinary teams.
Education and Experience:
  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field.
  • Minimum of 5 years of experience in Data Engineering, with a strong focus on cloud data platforms and healthcare datasets.
  • Experience working in or with mental health or behavioral healthcare organizations is strongly preferred.
Physical Requirements:
  • Ability to move light objects weighing less than 20 pounds for short distances.
  • Ability to sit at a desk and walk around for different periods of time.
  • Ability to occasionally work beyond regular business hours or on weekends to resolve critical issues, as needed.
All qualified candidates will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national or ethnic origin, age, disability, veteran status or any other characteristic protected by law.
Date Posted: 05 May 2025
Apply for this Job