DoctoBERT-fr - a doctolib-lab Collection

doctolib-lab 's Collections

DoctoBERT-fr

updated Jul 6

French medical encoders pretrained from scratch on curated and LLM-rephrased medical web data.

doctolib-lab/doctomodernbert-fr-base

Fill-Mask • 0.1B • Updated Jul 2 • 595

Note ModernBERT-based French medical encoder.
doctolib-lab/doctobert-fr-base

Fill-Mask • 0.1B • Updated Jul 2 • 700 • 7

Note RoBERTa-based French medical encoder.
doctolib-lab/doctomodernbert-fr-large

Fill-Mask • 0.4B • Updated Jul 6 • 12

Note ModernBERT-based French medical encoder.
doctolib-lab/doctobert-fr-ckpts

Updated Jul 6 • 1

Note Per-stage checkpoints for both models.
Sleeping

Agents

1

DoctoBERT Fill-Mask

🩺

1

Fill-mask demo for a French medical ModernBERT
Where Does the Signal Live? A Web Data Recipe for Medical Encoder Pretraining

Paper • 2606.22079 • Published Jun 20 • 2