AI Engineer I

Information and Transform If you are a current Duly/SBC/QMG employee, please apply through the Internal Career Site. At Duly Health and Care, you are supported to do your best work and make a meaningful impact every day. You will be part of a collaborative, physician-led team that works as one and puts patients at the center of everything we do. With a connected network of providers, care teams, and services across primary and specialty care, surgery centers, imaging, lab, and therapy, you are part of a system designed to deliver high-quality, coordinated care.

Together, we create an environment where you can grow, contribute, and help improve the experience and outcomes for every patient we serve. Benefits: • Comprehensive medical, dental, and vision benefits that include healthcare navigation assistance. • Access to a mental health benefit at no cost. • Employer provided life and disability insurance. • $5,250 Tuition Reimbursement per year. • Immediate 401(k) match. • 40 hours paid volunteer time off. • A culture committed to community engagement and social impact.

• Up to 12 weeks parental leave at 100% pay and a financial benefit for adoption and surrogacy for non-physician team members once eligibility requirements are met. Primary Purpose The AI Engineer I is an early-career role within the Data & Analytics team, working with the AI/ML team to implement, deploy, and support the AI platforms and models that improve patient care, operations, and the colleague experience.

This position focuses on conversational AI and generative AI solutions, including the Kore.ai platform and large language model (LLM) applications built on Claude, and on the automation, monitoring, and operational practices that keep those solutions reliable, secure, and cost-effective. This role is a strong fit for someone with solid programming and cloud fundamentals who wants to grow into AI engineering and MLOps in a healthcare setting. No prior healthcare or Epic experience is required; we will train you.

Major Responsibilities AI platform implementation and integration (40%) Help configure, build, and integrate conversational AI and virtual assistant solutions on the Kore.ai platform Support the implementation of Claude-powered applications, including API integrations, prompt and system configuration, retrieval-augmented generation (RAG) pipelines, and tool or agent workflows Integrate AI solutions with enterprise systems, data sources, and APIs in collaboration with data engineers and application teams Support testing of AI solutions, including functional testing, regression testing, and

evaluation of output quality, accuracy, and safety Document solution designs, configurations, integrations, and release notes Deployment, monitoring, and operational support (40%) Build and maintain CI/CD pipelines and infrastructure-as-code for the deployment of models, prompts, and AI applications across environments Monitor the performance, availability, usage, latency, and cost of AI solutions, and respond to alerts and incidents Provide day-to-day support and troubleshooting for AI platforms and the users who depend on them, escalating to vendors and senior engineers as needed Support

model and prompt versioning, evaluation, and retraining or refresh using the organization's ML platform and MLOps practices Follow organizational standards for responsible AI, data privacy, security, and the protection of PHI/PII, including access control and audit practices Collaboration and continuous improvement (20%) Partner with data scientists, data engineers, architects, application teams, and business stakeholders to define requirements and deliver reliable AI solutions Communicate technical concepts to non-technical audiences, including clinical and operational leaders Learn from

senior engineers and data scientists through code reviews and mentoring Stay current with advances in generative AI, conversational AI, and MLOps practices and share learnings with the team All other duties as assigned Minimum Education and Experience Bachelor's degree in computer science, data science, information systems, engineering, or a related field; or 2 years of related experience; or an equivalent combination of education and experience 0-2 years of experience in software development, data engineering, DevOps, or machine learning (internships, co-ops, research, and academic projects

count) Proficiency in Python and working knowledge of SQL Experience working with REST APIs and JSON Experience with LLMs, prompt engineering, or GenAI frameworks beneficial Experience with conversational AI or chatbot platforms, such as Kore.ai, beneficial Experience with Git, CI/CD, and cloud platforms (Azure preferred), Databricks, or MLflow beneficial Healthcare or Epic experience not required; training provided Minimum Knowledge, Skills, and Abilities (KSA) Solid foundation in software engineering practices, including version control, testing, and code review Understanding of how LLMs

work, including their strengths and limitations Understanding of the machine learning lifecycle, including deployment, monitoring, and retraining Strong analytical, organizational, and problem-solving skills, including troubleshooting production issues Strong communication skills and the ability to explain technical concepts to all levels of the organization Ability to work both independently and in a team-oriented environment Intellectual curiosity and a desire to learn and adopt new AI and MLOps techniques Awareness of ethical AI, data privacy, and information security considerations

helpful If you are committed to putting our patients first and helping shape the future of care, you belong at Duly. The compensation for this role includes a base pay range of $65,000 - $85,000, with the actual pay determined by factors such as skills, experience, education, certifications, geographic location, and internal equity. Additional compensation may be available through shift differentials, bonuses, and other incentives. Base pay is only a portion of the total rewards package.

Artificial Intelligence Disclosure Artificial Intelligence (AI) tools may be used in some portions of the candidate review process for this position, however, all employment decisions will be made by a person. Let’s start with what matters. People. Purpose. Care. At Duly Health and Care, we believe healthcare works best when it’s personal, connected, and led by people who truly care. We are a physician-led medical group built on trusted relationships, teamwork, and a shared commitment to putting patients first in every decision we make.

Our team members are caregivers, collaborators, problem-solvers, and leaders. Together, we show up with compassion, act with purpose, and take ownership of the care we deliver and the experience we create. Whether you’re caring directly for patients or supporting the teams who do, your role matters here, and your voice is valued. We listen with intention, work as one, and challenge ourselves to keep improving, not for recognition, but because our patients, families, and communities count on us. Innovation at Duly isn’t about chasing what’s next for its own sake.

It’s about finding better ways to deliver high-quality, affordable, and accessible care, today and into the future. If you’re looking for meaningful work, supportive teammates, and the opportunity to help shape the future of care while staying grounded in compassion and community, you’ll find your place at Duly. Current Duly Health and Care team members: Please do not apply through this external site. To be considered, log in to Workday through the OneDuly intranet and click on Career Opportunities to apply. This ensures your application is reviewed appropriately.

If you have questions, please connect with your leader or HR Business Partner for support.