論文サマリ

acl2021
tag: pre-training

Are Pretrained Convolutions Better than Pretrained Transformers?
by: Shintaro Yamamoto
pre-training CNN
LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding
by: Yoshiki Kubotani
pre-training two-stream transformer layout multimodality