The Lead Data Engineer serves as a senior technical leader within cross-functional teams, providing strategic direction and delivering robust data solutions across complex environments. This role involves designing scalable data infrastructures, managing client relationships, guiding governance processes, and promoting the adoption of emerging technologies. The ideal candidate will have expertise in biomedical informatics, metadata management, regulatory compliance (HIPAA), and team mentorship. The Data Engineer IV ensures that data engineering efforts are aligned with business needs, compliant with policy, and positioned to adapt to future advancements.
RESPONSIBILITIES:
- Strategic Leadership and Governance Serve as a senior data strategist and advisor to internal stakeholders and partners. Lead the governance of prioritizing partner work, ensuring transparency and strategic alignment.
- Form tactical strategies that scale across multiple clients and business units.
- Evaluate and champion emerging technologies through proof-of-concepts and innovation pilots.
- Mentor junior engineers and analysts, particularly in regulatory compliance and development standards.
- Technical Execution and Infrastructure Design
- Design and maintain complex data systems, pipelines, and ETL processes across heterogeneous data sources.
- Develop scalable reporting infrastructures to support various client needs and use cases.
- Define and maintain enterprise data standards and metadata across projects.
- Apply biomedical informatics methodologies to support research-specific and operational goals.
- Generate and maintain standardized architecture templates and documentation for current and proposed informatics solutions. Collaboration and Delivery
- Actively participate as a senior technical resource on cross-disciplinary teams of analysts, project managers, and data architects.
- Guide solution development and support structure design for various business units.
- Deliver applications and components within scope, timeline, and budget, ensuring high-quality output.
- Communicate technical findings and strategies effectively to technical and non-technical audiences.
Preferred Qualifications:
- Proven experience managing and scaling data systems within research or healthcare environments Demonstrated success leading cross-functional technical teams and mentoring professionals Expert-level proficiency with data engineering tools (e.g., Python, Spark, SQL, Airflow, dbt)
- In-depth understanding of HIPAA and regulatory compliance standards in healthcare Experience designing and implementing enterprise-level data governance models Familiarity with metadata management tools, data catalogs, and data lineage tracking Ability to rapidly adopt and promote new technologies and best practices
- Knowledge, Skills, and Abilities Requirements
- Strong leadership and communication skills, with the ability to influence across all levels of the organization
- Advanced problem-solving skills and a strategic mindset
- Proficient in developing architecture templates and infrastructure standards Ability to balance short-term project demands with long-term strategic initiatives
- Commitment to collaboration, innovation, and compliance in all aspects of data engineering
MINUMUM QUALIFICATIONS:
- Bachelor's degree in a related field (e.g., Computer Science, Biomedical Informatics, Data Science, or Healthcare discipline)
- At least 7 years of related experience, OR an equivalent combination of education, training, and experience