๐ฉบ MedSAM3-v1
A text/concept-guided medical adaptation of SAM 3 released as LoRA weights. It uses medical language prompts rather than requiring the traditional box/point interaction for its primary workflow.
At a glanceโ
| Field | Details |
|---|---|
| Model type | Text-guided medical SAM adapter |
| Research team / organization | Hong Kong University of Science and Technology (Guangzhou), University of Illinois Urbana-Champaign and collaborators |
| Input / modality | The authors describe radiology, optical/microscopy, pathology and procedure imagery; the first release's exact supported category list is still being documented. |
| Prompt / interaction | Text prompt; LoRA medical adapter on top of the SAM 3 model. |
| Code license | The MedSAM3 README does not state a separate license for the LoRA weights. SAM 3 base materials use Meta's SAM License; confirm the adapter/model-card terms before redistribution. |
๐ Paper and publicationโ
MedSAM3: Delving into Segment Anything with Medical Concepts โ arXiv:2511.19046 (2025 preprint).
๐ฆ Checkpoints and accessโ
The v1 LoRA is hosted at lal-Joey/MedSAM3_v1. It is an adapter: the gated SAM 3 base checkpoint and access approval are also required.
The code, model checkpoint and any required foundation-model checkpoint can have different terms. Review each linked source before use or redistribution.
โ๏ธ Official setup and inferenceโ
git clone https://github.com/Joey-S-Liu/MedSAM3.git
cd MedSAM3
pip install -e .
hf auth login # required for gated SAM 3 base weights
python3 infer_sam.py \
--config configs/full_lora_config.yaml \
--image path/to/image.jpg --prompt "skin lesion" \
--threshold 0.5 --nms-iou 0.5 --output prediction.png
Set the LoRA checkpoint path in configs/full_lora_config.yaml as directed by the upstream README.
โ ๏ธ Version and practical notesโ
Keep this LoRA release distinct from Meta's SAM 3 and the separate Medical-SAM3 project. The authors note that the exact v1 supported-task list is still being documented.
๐ Licenseโ
The MedSAM3 README does not state a separate license for the LoRA weights. SAM 3 base materials use Meta's SAM License; confirm the adapter/model-card terms before redistribution.
Citation: Cite the paper above and the upstream project as directed by its authors. This repository links to the original paper; it does not redistribute the code or weights.
Source pages checked: 27 October 2026. Upstream environments, weights and access policies may change; use the linked project as the source of truth.