Skip to content

Add #737 #772

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
PGijsbers merged 9 commits into from
Sep 2, 2019
Merged

Add #737 #772

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
fcc2049
changes in list_evaluations_setups
sahithyaravi Aug 21, 2019
1921ed9
fixed some flake8 erros
sahithyaravi Aug 21, 2019
39f1627
PEP8 errors
sahithyaravi Aug 21, 2019
55be331
shorten line
sahithyaravi Aug 21, 2019
00d59f2
change equals check to isin
sahithyaravi Aug 21, 2019
5ea8904
review comments
sahithyaravi Aug 28, 2019
e317894
pep8 and mypy errors
sahithyaravi Aug 28, 2019
f825d59
change comment
sahithyaravi Aug 29, 2019
454f297
fix example fetch_evaluations
sahithyaravi Sep 2, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
fix example fetch_evaluations
  • Loading branch information
@sahithyaravi
sahithyaravi committed Sep 2, 2019
commit 454f2973bf561ffb72ffae6778a6e0d885b57b3c
12 changes: 7 additions & 5 deletions examples/fetch_evaluations_tutorial.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -149,21 +149,23 @@ def plot_flow_compare(evaluations, top_n=10, metric='predictive_accuracy'):
for i in range(top_n):
print((flow_ids[i], flow_names[i]))

###############################################################################
#############################################################################
# Obtaining evaluations with hyperparameter settings
# ==========================================
# ==================================================
# We'll now obtain the evaluations of a task and a flow with the hyperparameters

# List evaluations in desc order based on predictive_accuracy with hyperparameters
# List evaluations in descending order based on predictive_accuracy with
# hyperparameters
evals_setups = openml.evaluations.list_evaluations_setups(function='predictive_accuracy', task=[31],
size=100, sort_order='desc')

""
print(evals_setups.head())

""
# Return evaluations for flow_id in desc order based on predictive_accuracy with hyperparameters
# parameters_in_separate_columns returns parameters in separate columns
# Return evaluations for flow_id in descending order based on predictive_accuracy
# with hyperparameters. parameters_in_separate_columns returns parameters in
# separate columns
evals_setups = openml.evaluations.list_evaluations_setups(function='predictive_accuracy',
flow=[6767],
size=100,
Expand Down