mwptoolkit.data.dataloader.dataloader_multiencdec

class mwptoolkit.data.dataloader.dataloader_multiencdec.DataLoaderMultiEncDec(config: Config, dataset: DatasetMultiEncDec)[source]

Bases: TemplateDataLoader

dataloader class for deep-learning model MultiE&D

Parameters

  • config –

  • dataset –

expected that config includes these parameters below:

model (str): model name.

equation_fix (str): [infix | postfix | prefix], convert equation to specified format.

train_batch_size (int): the training batch size.

test_batch_size (int): the testing batch size.

symbol_for_tree (bool): build output symbols for tree or not.

share_vocab (bool): encoder and decoder of the model share the same vocabulary, often seen in Seq2Seq models.

max_len (int|None): max input length.

max_equ_len (int|None): max output length.

add_sos (bool): add sos token at the head of input sequence.

add_eos (bool): add eos token at the tail of input sequence.

device (torch.device):

build_batch_for_predict(batch_data: List[dict])[source]
get_parse_graph_batch(input_length, parse_tree_batch)[source]
num_order_processed(num_list)[source]