Skip to content

pythonthings/client

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

384 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation



Experimental Client - Next Generation

This repo contains experimental changes to the production wandb client at github.com/wandb/client.

Primary Features

  • Better support for different operating environments including windows and juypter
  • Improved configurability (Documentation coming soon)
  • Improved syncing and offline mode to support compute nodes without internet connection (Not in current release)

Support

This package is considered experimental but it is Actively Supported. Issues will be responded to within 1 working day.

File issues in this repository. Please specify the version when reporting issues: wandb --version

Alternatively you can discuss problems in the Public Slack Forum in channel #wandb-cling.

Compatibility status

  • Only online mode is supported. Only use this on a machine with a stable internet connection.
  • No tensorboard_sync option, no from wandb import magic
  • No wandb.init() context manager
  • Only supported commandline options: login, sweep, agent, controller
  • No code saving support for jupyter
  • No resume support
  • No anonymous support

All these compatibility issues will be addressed in upcoming releases.

Known issues

Problem Bug Estimated fix date
Console logs have extra linefeed
python2 occasionally throws spurious exception at end of script execution

Weights and Biases ci pypi Coverage Status

Use W&B to organize and analyze machine learning experiments. It's framework-agnostic and lighter than TensorBoard. Each time you run a script instrumented with wandb, we save your hyperparameters and output metrics. Visualize models over the course of training, and compare versions of your models easily. We also automatically track the state of your code, system metrics, and configuration parameters.

Sign up for a free account →

Features

  • Store hyper-parameters used in a training run
  • Search, compare, and visualize training runs
  • Analyze system usage metrics alongside runs
  • Collaborate with team members
  • Replicate historic results
  • Run parameter sweeps
  • Keep records of experiments available forever

Documentation →

Quickstart

pip install wandb-ng

In your training script:

import wandb
# Your custom arguments defined here
args = ...

wandb.init(config=args, project="my-project")
wandb.config["more"] = "custom"

def training_loop():
    while True:
        # Do some machine learning
        epoch, loss, val_loss = ...
        # Framework agnostic / custom metrics
        wandb.log({"epoch": epoch, "loss": loss, "val_loss": val_loss})

If you're already using Tensorboard or TensorboardX, you can integrate with one line:

wandb.init(sync_tensorboard=True)

Running your script

Run wandb login from your terminal to signup or authenticate your machine (we store your api key in ~/.netrc). You can also set the WANDB_API_KEY environment variable with a key from your settings.

Run your script with python my_script.py and all metadata will be synced to the cloud. You will see a url in your terminal logs when your script starts and finishes. Data is staged locally in a directory named wandb relative to your script. If you want to test your script without syncing to the cloud you can set the environment variable WANDB_MODE=dryrun.

If you are using docker to run your code, we provide a wrapper command wandb docker that mounts your current directory, sets environment variables, and ensures the wandb library is installed. Training your models in docker gives you the ability to restore the exact code and environment with the wandb restore command.

Web Interface

Sign up for a free account → Watch the video Introduction video →

Detailed Usage

Framework specific and detailed usage can be found in our documentation.

Testing

To run the tests we use pytest tests. If you want a simple mock of the wandb backend and cloud storage you can use the mock_server fixture, see tests/test_cli.py for examples.

We use circleci and appveyor for CI.

Academic Researchers

If you'd like a free academic account for your research group, reach out to us →

We make it easy to cite W&B in your published paper. Learn more →

About

🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.

Resources

Contributing

Stars

Watchers

Forks

Packages

 
 
 

Contributors

Languages

  • Python 99.3%
  • Other 0.7%