KB ALBERT Download - KB ALBERT Source code download

Download

KB-ALBERT

Korean ALBERT language model specialized for economic/financial domains provided by KB Kookmin Bank

KB-ALBERT is a pre-learning language model that learned a large amount of Korean based on the ALBERT (A Lite BERT) architecture proposed by Google.
- ALBERT is a type of BERT-family PLM (Pretrained Language Model) architecture and is characterized by a lightweight design.
- If you have a language model learned with a large amount of language data, fine-tuning learning to suit the task is possible even with a relatively small amount of training data.
KB-ALBERT shows excellent performance not only when learning financial Korean but also general Korean tasks.
NSMC (Acc) KorQuAD (EM/F1) Financial MRC (EM/F1) Size
Bert base multi-lingual 87.32 68.43 / 88.43 39.48 / 64.74 681M
KB-ALBERT-CHAR-v2 89.62 84.14 / 92.13 50.12 / 68.21 36M

	NSMC (Acc)	KorQuAD (EM/F1)	Financial MRC (EM/F1)	Size
Bert base multi-lingual	87.32	68.43 / 88.43	39.48 / 64.74	681M
KB-ALBERT-CHAR-v2	89.62	84.14 / 92.13	50.12 / 68.21	36M

For model usage and examples, please refer to the README.md file in the subdirectory.
KB-ALBERT may be used for non-profit purposes only.
If you wish to use the model, please send it to the email address below by briefly stating your affiliation, name, and purpose of use .
- [email protected]

Codes related to older version models may be deleted in the future.

KB-ALBERT's 모델 파일 and 코드 are subject to separate licensing policies.
코드 in this repository is released under the Apache-2.0 license. The full license can be found in the LICENSE file.
모델 파일 will be sent individually only to those who request them for non-profit purposes. The licensing policy for model files will be delivered together with the model.

(Reference) Please also refer to the Korean PLM published elsewhere.