Skip to main content

On This Page

Google AI Releases MedGemma-1.5: A New Open Medical AI Model

2 min read
Share

These articles are AI-generated summaries. Please check the original sources for full details.

MedGemma 1.5, Small Multimodal Model for Real Clinical Data

Google Research released MedGemma-1.5, a new family of medical generative models built on Gemma, designed to support developers building custom medical AI solutions. The model, MedGemma-1.5-4B, is a compact, 4 billion parameter model capable of processing real clinical data across multiple modalities.

Why This Matters

Current AI model development often requires massive, specialized datasets and compute resources, creating a barrier to entry for many healthcare organizations. Ideal models assume clean, labeled data, while clinical data is often noisy, unstructured, and subject to strict regulations. This discrepancy leads to significant costs and delays in deploying effective AI solutions, potentially delaying accurate diagnoses and treatment plans.

Key Insights

  • Accuracy Gains: MedGemma-1.5 improves CT disease finding accuracy from 58% to 61% and MRI disease findings from 51% to 65% on internal benchmarks.
  • Multimodal Input: The model accepts text, 2D images, 3D CT/MRI volumes, and whole slide pathology images, expanding its potential applications.
  • DICOM Support: Applications on Google Cloud can now directly process DICOM files, simplifying integration with existing hospital systems.

Working Example

# Example of interacting with MedGemma-1.5 via Vertex AI (Conceptual)
from google.cloud import aiplatform

def analyze_image(project_id, location, image_path, prompt):
    """
    Analyzes a medical image using MedGemma-1.5 on Vertex AI.
    """
    aiplatform.init(project=project_id, location=location)

    model = aiplatform.Endpoint.from_endpoint_name(
        endpoint_name="projects/{}/locations/{}/endpoints/{}".format(
            project_id, location, "medgemma-1.5-endpoint"
        )
    )

    response = model.predict(
        instances=[{"image": image_path, "prompt": prompt}]
    )
    return response

# Example Usage
project_id = "your-gcp-project-id"
location = "us-central1"
image_path = "gs://your-bucket/chest_xray.jpg"
prompt = "Describe any potential findings in this chest X-ray."

results = analyze_image(project_id, location, image_path, prompt)
print(results)

Practical Applications

  • Radiology Report Generation: A hospital system could use MedGemma-1.5 to automatically draft preliminary radiology reports from CT and MRI scans.
  • Pitfall: Relying solely on AI-generated reports without radiologist review could lead to misdiagnosis due to the model’s inherent limitations and potential biases.

References:

Continue reading

Next article

2 Separate Campaigns Probe Corporate LLMs for Secrets

Related Content