Jobs · Engineering · Pennsylvania

Principal Machine Learning Engineer

Medical Guardian · Philadelphia, PA · 1 wk ago
HybridEngineeringFull-time

About Medical Guardian

Founded in 2005, Medical Guardian is a fast-growing digital health and safety company on a mission to help people live a life without limits. With 13 consecutive years on the Inc. 5000 list of Fastest Growing Companies, we're redefining what it means to age confidently and independently. We support over 625,000 members nationwide with life-saving emergency response systems and remote patient monitoring solutions. Trusted by families, healthcare providers, and care managers, our work is powered by a culture of innovation, compassion, and purpose. Medical Guardian boasts a 95% customer satisfaction rate, a #1 ranking on 16 medical alert consumer choice sites and achieves a 4.7+ star rating on Google Reviews.

Key Responsibilities

  • Hands-On Model Development
  • Build, test, validate, and improve machine learning models for scoring, prediction, prioritization, risk detection, engagement, intervention targeting, and decision support.
  • Perform exploratory data analysis, data quality assessment, feature engineering, model training, model selection, and performance evaluation.
  • Design and implement predictive scores, risk tiers, score bands, thresholds, cut points, and intervention logic.
  • Evaluate models for accuracy, calibration, stability, drift, fairness, interpretability, and operational usefulness.
  • Help stakeholders understand what a score represents, how it should be used, how it should not be used, and how changes in the score should be interpreted.
  • Document model logic, features, assumptions, limitations, validation results, and recommended usage in a way that business and technical stakeholders can understand.
  • Define the evidence needed to show that a model or score is valid, stable, explainable, actionable, and useful.
  • Production ML and MLOps
  • Partner with data engineering, analytics engineering, platform engineering, and application engineering teams to move models from experimentation into reliable production workflows.
  • Support model deployment, batch scoring, real-time or near-real-time inference, model versioning, monitoring, retraining, and performance tracking.
  • Ensure models are observable, supportable, secure, scalable, and aligned with enterprise architecture and governance expectations.
  • Establish practical monitoring and feedback loops to determine whether models continue to perform and create value over time.
  • Product and Rapid-Build Execution
  • Operate effectively in a rapid-build, startup-like environment where speed, ownership, and pragmatic decision-making are important.
  • Turn early-stage ideas, ambiguous business needs, and rough concepts into working ML products, scores, prototypes, and production capabilities.
  • Drive work forward without waiting for perfect requirements, while still identifying critical assumptions, risks, dependencies, and evidence needed before scaling.
  • Partner with business and product stakeholders to define MVPs, iterate quickly, learn from usage, and improve models over time.
  • Make smart tradeoffs between quick prototypes, durable platforms, transparent models, GenAI-enabled workflows, and longer-term ML architecture.
  • Generative AI and AI Automation
  • Support the design and development of GenAI-enabled solutions, including LLM-powered workflows, RAG, summarization, conversational agents, document intelligence, and decision-support tools.
  • Help evaluate when GenAI is appropriate versus when traditional ML, rules, analytics, or transparent scoring models are a better fit.
  • Partner with product, engineering, and business stakeholders to integrate predictive models, scores, and GenAI outputs into practical workflows.
  • Apply appropriate evaluation, guardrails, monitoring, privacy controls, and human-in-the-loop processes for GenAI use cases.
  • Help the organization balance innovation with explainability, safety, reliability, privacy, and operational usefulness.
  • Requirement Shaping and Stakeholder Partnership
  • Work directly with business, product, analytics, operations, and engineering stakeholders to clarify what a model is intended to predict, explain, recommend, or trigger.
  • Translate business questions into measurable ML objectives, target variables, features, validation approaches, and success metrics.
  • Ask practical questions early: who will use the score, what action will it inform, what does a false positive or false negative mean, and how will we know the model is creating value?
  • Communicate model behavior, tradeoffs, limitations, and recommended usage clearly to both technical and non-technical audiences.
  • Help the team avoid becoming an AI ticket factory by shaping solutions, not just executing requests.
  • Principal-Level Technical Leadership
  • Provide technical leadership through hands-on example, strong engineering judgment, and clear recommendations.
  • Proactively identify model risks, data gaps, unclear requirements, design issues, and opportunities for improvement.
  • Help establish practical standards for model development, validation, documentation, monitoring, and production readiness.
  • Mentor other engineers and data scientists through code reviews, design reviews, modeling guidance, and shared best practices.
  • Demonstrate high ownership by driving clarity, execution, and continuous improvement.

Required Qualifications

  • 8+ years of professional experience in machine learning, data science, software engineering, analytics engineering, applied AI, or related technical fields.
  • 5+ years of hands-on machine learning model development experience, including feature engineering, model training, validation, evaluation, and iteration.
  • 3+ years of experience deploying, operationalizing, or supporting models in production or business-critical environments.
  • Strong hands-on experience with Python and SQL.
  • Experience with modern ML and data platforms such as Databricks, Spark, MLflow, Snowflake, Azure, AWS, or similar technologies.
  • Strong understanding of model evaluation, calibration, thresholding, score interpretation, monitoring, drift, retraining, and production ML lifecycle management.
  • Experience translating ambiguous business problems into concrete ML designs, model requirements, validation plans, and measurable outcomes.
  • Ability to explain model behavior, model performance, assumptions, limitations, and tradeoffs to both technical and non-technical stakeholders.
  • Strong engineering discipline, including clean code, reproducibility, versioning, testing, documentation, and maintainability.
  • Ability to work independently as a senior hands-on contributor while also providing technical leadership and modeling judgment.

Preferred Qualifications

  • 10+ years of relevant professional experience in ML, data science, applied AI, software engineering, decisioning systems, commercial software, or production analytics.
  • Experience building scorecards, risk scores, health scores, engagement scores, churn scores, fraud scores, credit-style models, prioritization models, or operational decision-support models.
  • Experience with transparent or interpretable models such as logistic regression, GLMs, GAMs, decision trees, monotonic models, calibrated models, scorecard-based models, or Explainable Boosting Machines.
  • Experience designing score bands, thresholds, risk tiers, intervention rules, recommended actions, or decision logic based on model outputs.
  • Experience working in commercial software, SaaS, digital products, gaming, fintech, healthtech, consumer technology, marketplace, or other product-driven environments.
  • Experience building ML, AI, analytics, or decisioning capabilities embedded into customer-facing products, operational workflows, commercial platforms, or revenue-impacting systems.
  • Experience in healthcare, population health, remote patient monitoring, insurance, financial services, safety, operations, or other domains where model trust and explainability are important.
  • Experience with MLOps practices including model registries, deployment pipelines, monitoring, drift detection, retraining strategies, and model governance.

Similar jobs