1. model_free.py contains different algorithm implements
2. experiment_* are the experiments scripts

-experiment_comprehensive.py is for the comprehensive experiment (chapter 5.3 in the blog)

-experiment_epsilon_greedy.py is for the epsilon greedy experiment (chapter 5.2 in the blog)

-experiment_near_optimal.py (chapter 2 in the blog)

-experiment_variance.py is for the stability experiment (chapter 5.1 in the blog)

-matplotlib-1.5.0