Skip to main content

๐Ÿฉบ MedSAM3-v1

A text/concept-guided medical adaptation of SAM 3 released as LoRA weights. It uses medical language prompts rather than requiring the traditional box/point interaction for its primary workflow.

Official codePaperWeights

โ† Model atlas

At a glanceโ€‹

FieldDetails
Model typeText-guided medical SAM adapter
Research team / organizationHong Kong University of Science and Technology (Guangzhou), University of Illinois Urbana-Champaign and collaborators
Input / modalityThe authors describe radiology, optical/microscopy, pathology and procedure imagery; the first release's exact supported category list is still being documented.
Prompt / interactionText prompt; LoRA medical adapter on top of the SAM 3 model.
Code licenseThe MedSAM3 README does not state a separate license for the LoRA weights. SAM 3 base materials use Meta's SAM License; confirm the adapter/model-card terms before redistribution.

๐Ÿ“š Paper and publicationโ€‹

MedSAM3: Delving into Segment Anything with Medical Concepts โ€” arXiv:2511.19046 (2025 preprint).

๐Ÿ“ฆ Checkpoints and accessโ€‹

The v1 LoRA is hosted at lal-Joey/MedSAM3_v1. It is an adapter: the gated SAM 3 base checkpoint and access approval are also required.

The code, model checkpoint and any required foundation-model checkpoint can have different terms. Review each linked source before use or redistribution.

โš™๏ธ Official setup and inferenceโ€‹

git clone https://github.com/Joey-S-Liu/MedSAM3.git
cd MedSAM3
pip install -e .
hf auth login # required for gated SAM 3 base weights
python3 infer_sam.py \
--config configs/full_lora_config.yaml \
--image path/to/image.jpg --prompt "skin lesion" \
--threshold 0.5 --nms-iou 0.5 --output prediction.png

Set the LoRA checkpoint path in configs/full_lora_config.yaml as directed by the upstream README.

โš ๏ธ Version and practical notesโ€‹

Keep this LoRA release distinct from Meta's SAM 3 and the separate Medical-SAM3 project. The authors note that the exact v1 supported-task list is still being documented.

๐Ÿ“œ Licenseโ€‹

The MedSAM3 README does not state a separate license for the LoRA weights. SAM 3 base materials use Meta's SAM License; confirm the adapter/model-card terms before redistribution.

Citation: Cite the paper above and the upstream project as directed by its authors. This repository links to the original paper; it does not redistribute the code or weights.

Source pages checked: 27 October 2026. Upstream environments, weights and access policies may change; use the linked project as the source of truth.