Skip to content

Create a non-linear retry policy. #1065

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
PGijsbers merged 7 commits into from
May 10, 2021
Merged

Create a non-linear retry policy. #1065

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
5e0d214
Create a non-linear retry policy.
PGijsbers Apr 28, 2021
761ad9d
Add retry_policy documentation
PGijsbers May 3, 2021
40e3493
Remove max_retries, add retry_policy to config
PGijsbers May 3, 2021
9f522f3
Add retry_policy so cli config
PGijsbers May 3, 2021
f857d53
Merge branch 'develop' into retry_policy
PGijsbers May 6, 2021
94927bc
Use policy to determine wait time
PGijsbers May 6, 2021
b7f73b4
Merge branch 'develop' into retry_policy
PGijsbers May 10, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add retry_policy documentation
  • Loading branch information
@PGijsbers
PGijsbers committed May 3, 2021
commit 761ad9d7f76e4eef78ab0d01ac946bb7a396b3c1
1 change: 1 addition & 0 deletions doc/progress.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ Changelog
0.12.2
~~~~~~

* ADD #1065: Add a ``retry_policy`` configuration option that determines the frequency and number of times to attempt to retry server requests.
* DOC: Fixes a few broken links in the documentation.
* MAINT/DOC: Automatically check for broken external links when building the documentation.
* MAINT/DOC: Fail documentation building on warnings. This will make the documentation building
Expand Down
9 changes: 7 additions & 2 deletions doc/usage.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,9 +52,14 @@ which are separated by newlines. The following keys are defined:
* if set to ``True``, when ``run_flow_on_task`` or similar methods are called a lookup is performed to see if there already exists such a run on the server. If so, download those results instead.
* if not given, will default to ``True``.

* retry_policy:
* Defines how to react when the server is unavailable or experiencing high load. It determines both how often to attempt to reconnect and how quickly to do so. Please don't use ``human`` in an automated script that you run more than one instance of, it might increase the time to complete your jobs and that of others.
* human: For people running openml in interactive fashion. Try only a few times, but in quick succession.
* robot: For people using openml in an automated fashion. Keep trying to reconnect for a longer time, quickly increasing the time between retries.

* connection_n_retries:
* number of connection retries.
* default: 2. Maximum number of retries: 20.
* number of connection retries
* default depends on retry_policy (5 for ``human``, 50 for ``robot``)
Comment thread
PGijsbers marked this conversation as resolved.

* verbosity:
* 0: normal output
Expand Down