mwptoolkit.evaluate.evaluator

class mwptoolkit.evaluate.evaluator.AbstractEvaluator(config)

Bases: object

abstract evaluator

result()

result_multi()

class mwptoolkit.evaluate.evaluator.InfixEvaluator(config)

Bases: AbstractEvaluator

evaluator for infix equation sequnence.

_compute_expression_by_postfix_multi(expression)

return solves and unknown number list

result(test_exp, tar_exp)

evaluate single equation.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): iist of target expression.

result_multi(test_exp, tar_exp)

evaluate multiple euqations.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

class mwptoolkit.evaluate.evaluator.MultiEncDecEvaluator(config)

Bases: PostfixEvaluator, PrefixEvaluator

evaluator for deep-learning model MultiE&D.

postfix_result(test_exp, tar_exp)

evaluate single postfix equation.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

postfix_result_multi(test_exp, tar_exp)

evaluate multiple postfix euqations.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

prefix_result(test_exp, tar_exp)

evaluate single prefix equation.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

prefix_result_multi(test_exp, tar_exp)

evaluate multiple prefix euqations.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

result(test_exp, tar_exp)

evaluate single equation.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

result_multi(test_exp, tar_exp)

evaluate multiple euqations.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

class mwptoolkit.evaluate.evaluator.MultiWayTreeEvaluator(config)

Bases: AbstractEvaluator

_compute_expression_by_postfix_multi(expression)

return solves and unknown number list

result(test_exp, tar_exp)

evaluate single equation.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

result_multi(test_exp, tar_exp)

evaluate multiple euqations.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

class mwptoolkit.evaluate.evaluator.PostfixEvaluator(config)

Bases: AbstractEvaluator

evaluator for postfix equation.

eval_source()

result(test_exp, tar_exp)

evaluate single equation.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

result_multi(test_exp, tar_exp)

evaluate multiple euqations.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

class mwptoolkit.evaluate.evaluator.PrefixEvaluator(config)

Bases: AbstractEvaluator

evaluator for prefix equation.

eval_source(test_res, test_tar, num_list, num_stack=None)

result(test_exp, tar_exp)

evaluate single equation.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

result_multi(test_exp, tar_exp)

evaluate multiple euqations.

Parameters

• test_exp (list) – list of test expression.

• tar_exp (list) – list of target expression.

Returns

(tuple(bool,bool,list,list))

val_ac (bool): the correctness of test expression answer compared to target expression answer.

equ_ac (bool): the correctness of test expression compared to target expression.

test_exp (list): list of test expression.

tar_exp (list): list of target expression.

class mwptoolkit.evaluate.evaluator.Solver(func, equations, unk_symbol)

Bases: Thread

time-limited equation-solving mechanism based threading.

This constructor should always be called with keyword arguments. Arguments are:

group should be None; reserved for future extension when a ThreadGroup class is implemented.

target is the callable object to be invoked by the run() method. Defaults to None, meaning nothing is called.

name is the thread name. By default, a unique name is constructed of the form “Thread-N” where N is a small decimal number.

args is the argument tuple for the target invocation. Defaults to ().

kwargs is a dictionary of keyword arguments for the target invocation. Defaults to {}.

If a subclass overrides the constructor, it must make sure to invoke the base class constructor (Thread.__init__()) before doing anything else to the thread.

get_result()

return the result

run()

run equation solving process

mwptoolkit.evaluate.evaluator.get_evaluator(config)

build evaluator

Parameters

config (Config) – An instance object of Config, used to record parameter information.

Returns

Constructed evaluator.

Return type

Evaluator

mwptoolkit.evaluate.evaluator.get_evaluator_module(config: Config) → Type[Union[PrefixEvaluator, InfixEvaluator, PostfixEvaluator, MultiWayTreeEvaluator, AbstractEvaluator, MultiEncDecEvaluator]]

return a evaluator module according to config

Parameters

config – An instance object of Config, used to record parameter information.

Returns

evaluator module