prompttools.experiment.widgets package#

Submodules#

prompttools.experiment.widgets.comparison module#

class prompttools.experiment.widgets.comparison.ComparisonWidgetProvider(completion_fn, agg_fn, eval_listener_fn)#

Bases: object

Provides functionality for widgets to compare models. This includes displaying widgets, and recording evaluations in the experiment.

display(items)#
get_header_widgets()#
Return type:

List[object]

get_row_widgets(index, row)#
set_models(models)#
Parameters:

models (List[str]) –

Return type:

None

prompttools.experiment.widgets.feedback module#

class prompttools.experiment.widgets.feedback.FeedbackWidgetProvider(completion_fn, agg_fn, eval_listener_fn)#

Bases: object

Provides functionality for widgets to evaluate models. This includes displaying widgets, and recording evaluations in the experiment.

display(items)#
get_header_widgets()#
Return type:

List[object]

get_row_widgets(index, row)#
set_pivot_columns(pivot_columns)#
Parameters:

pivot_columns (List[str]) –

Return type:

None

prompttools.experiment.widgets.utility module#

prompttools.experiment.widgets.utility.is_interactive()#

Used to determine if we are in a jupyter notebook, which determines how we present the visualizations.

Return type:

bool

Module contents#