mwptoolkit.data.dataloader.dataloader_hms

class mwptoolkit.data.dataloader.dataloader_hms.DataLoaderHMS(config: Config, dataset: DatasetHMS)

Bases: TemplateDataLoader

Parameters

• config –

• dataset –

expected that config includes these parameters below:

model (str): model name.

equation_fix (str): [infix | postfix | prefix], convert equation to specified format.

train_batch_size (int): the training batch size.

test_batch_size (int): the testing batch size.

symbol_for_tree (bool): build output symbols for tree or not.

share_vocab (bool): encoder and decoder of the model share the same vocabulary, often seen in Seq2Seq models.

max_len (int|None): max input length.

max_equ_len (int|None): max output length.

add_sos (bool): add sos token at the head of input sequence.

add_eos (bool): add eos token at the tail of input sequence.

device (torch.device):

build_batch_for_predict(batch_data: List[dict])

mwptoolkit.data.dataloader.dataloader_hms.get_num_mask(num_size_batch, generate_nums)