Korean PLM

1. BERT

modelsizelink

KoBERT(SKT)	base	https://github.com/SKTBrain/KoBERT
KorBERT(ETRI)	base	https://aiopen.etri.re.kr/service_dataset.php
HanBERT	base	https://github.com/monologg/HanBert-Transformers
KcBERT	base, large	https://github.com/Beomi/KcBERT
KR-BERT(SNU)		https://github.com/snunlp/KR-BERT
Ko-Char-BERT	base	https://github.com/MrBananaHuman/KoreanCharacterBert
LMKor-BERT	base	https://github.com/kiyoungkim1/LMkor
DistilKoBERT(SKT 경량화)		https://github.com/monologg/DistilKoBERT
KLUE-BERT	base	https://huggingface.co/klue/bert-base
KPFBERT	base	https://github.com/KPFBERT/kpfbert
brainsbert(kakaobrain)	base	https://huggingface.co/hyunwoongko/brainsbert-base
KalBert	base	https://github.com/MrBananaHuman/KalBert
LMKor-Albert	base	https://github.com/kiyoungkim1/LMkor
KLUE-RoBERTa	small, base, large	https://huggingface.co/klue
KoBigBird	base	https://github.com/monologg/KoBigBird

 

2. ELECTRA

modelsizelink

TUNiB-Electra(TUNiB)	small, base	https://github.com/tunib-ai/tunib-electra
KoELECTRA	small++, base	https://github.com/monologg/KoELECTRA
KcELECTRA	small, base	https://github.com/Beomi/KcELECTRA
KoCharELECTRA	small, base	https://github.com/monologg/KoCharELECTRA
LMKor-ELECTRA	base	https://github.com/kiyoungkim1/LMkor

 

3. GPT

modelsizelink

LMKor-KoGPT2	base	https://github.com/kiyoungkim1/LMkor
KoGPT2(SKT)	base	https://github.com/SKT-AI/KoGPT2
KoGPT-Trinity 1.2B(SKT)	1.2B	https://huggingface.co/skt/ko-gpt-trinity-1.2B-v0.5
KoGPT(kakaobrain)	6B	https://github.com/kakaobrain/kogpt

 

4. Encoder-Decoder(T5, BART)

T5

modelsizelink

KE-T5	small, base, large	https://github.com/AIRC-KETI/ke-t5
LMKor-T5	small	https://github.com/kiyoungkim1/LMkor
KcT5(개발 중 추측)	base	https://huggingface.co/beomi/KcT5-dev
pko-t5	base, large	https://github.com/paust-team/pko-t5
KoT5(Wisenut)	base	https://github.com/wisenut-research/KoT5
ET5(ETRI)		https://aiopen.etri.re.kr/service_dataset.php

 

BART

modelsizelink

KoBART	base	https://github.com/SKT-AI/KoBART
Korean-BART	mini, small, base	https://cosmoquester.github.io/huggingface-bart-train/

출처: https://velog.io/@seoyeon96/PLM을-이용한-한국어-혐오-표현-탐지-1.-현황-파악