Hippocratic AI is developing the first safety-focused Large Language Model (LLM) for healthcare, and has announced a significant investment from NVentures, NVIDIA’s venture capital arm. This investment, part of an extended Series A round, brings the total funding to an impressive $137 million. The collaboration between Hippocratic AI and NVIDIA is centered on advancing healthcare through cutting-edge AI technology. Hippocratic AI is leveraging NVIDIA NIM microservices to scale its production platform, delivering low-latency and long-context conversational capabilities. This partnership, launched at the NVIDIA GTC global AI conference, includes several advanced techniques tailored for real-time, long-context conversational AI, such as prefix caching, speculative decoding, and prefill/decode disaggregation.
The partnership between Hippocratic AI and NVIDIA aims to revolutionize healthcare by dramatically improving accessibility and patient care. Munjal Shah, Co-Founder and CEO of Hippocratic AI, emphasized the potential of their collaboration with NVIDIA to deliver “healthcare abundance” through low-latency, empathetic AI interactions. He noted that their deep technical collaboration has helped build an LLM with extremely low latency, leading to more empathetic inference capabilities. Kimberly Powell, VP of Healthcare at NVIDIA, highlighted how Hippocratic AI’s safety-focused approach utilizes advanced NVIDIA technologies to create more natural and capable patient interactions. This innovative approach has the potential to expand healthcare services, increase access to care, and build trust among patients and clinicians alike. By harnessing the power of generative AI, Hippocratic AI and NVIDIA are at the forefront of a healthcare revolution that promises to bring deep healthcare expertise to every human.