mwptoolkit.data.utils¶
- mwptoolkit.data.utils.create_dataloader(config)[source]¶
Create dataloader according to config
- Parameters
config (mwptoolkit.config.configuration.Config) – An instance object of Config, used to record parameter information.
- Returns
Dataloader module
- mwptoolkit.data.utils.create_dataset(config)[source]¶
Create dataset according to config
- Parameters
config (mwptoolkit.config.configuration.Config) – An instance object of Config, used to record parameter information.
- Returns
Constructed dataset.
- Return type
Dataset
- mwptoolkit.data.utils.get_dataloader_module(config: Config) Type[Union[DataLoaderMultiEncDec, DataLoaderEPT, DataLoaderHMS, DataLoaderGPT2, PretrainDataLoader, SingleEquationDataLoader, MultiEquationDataLoader, AbstractDataLoader]][source]¶
Create dataloader according to config
- Parameters
config (mwptoolkit.config.configuration.Config) – An instance object of Config, used to record parameter information.
- Returns
Dataloader module
- mwptoolkit.data.utils.get_dataset_module(config: Config) Type[Union[DatasetMultiEncDec, DatasetEPT, DatasetHMS, DatasetGPT2, PretrainDataset, SingleEquationDataset, MultiEquationDataset, AbstractDataset]][source]¶
return a dataset module according to config
- Parameters
config – An instance object of Config, used to record parameter information.
- Returns
dataset module