BYOL

class mmpretrain.models.selfsup.BYOL(backbone, neck, head, base_momentum=0.004, pretrained=None, data_preprocessor=None, init_cfg=None)

BYOL.

Implementation of Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning.

参数:

• backbone (dict) – Config dict for module of backbone.

• neck (dict) – Config dict for module of deep features to compact feature vectors.

• head (dict) – Config dict for module of head functions.

• base_momentum (float) – The base momentum coefficient for the target network. Defaults to 0.004.

• pretrained (str, optional) – The pretrained checkpoint path, support local path and remote path. Defaults to None.

• data_preprocessor (dict, optional) – The config for preprocessing input data. If None or no specified type, it will use “SelfSupDataPreprocessor” as type. See SelfSupDataPreprocessor for more details. Defaults to None.

• init_cfg (Union[List[dict], dict], optional) – Config dict for weight initialization. Defaults to None.

loss(inputs, data_samples, **kwargs)

The forward function in training.

参数:

• inputs (List[torch.Tensor]) – The input images.

• data_samples (List[DataSample]) – All elements required during the forward function.

返回:

A dictionary of loss components.

返回类型:

Dict[str, torch.Tensor]