-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathdocs.atom.xml
More file actions
135 lines (95 loc) · 6.59 KB
/
Copy pathdocs.atom.xml
File metadata and controls
135 lines (95 loc) · 6.59 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
<?xml version="1.0" encoding="utf-8"?>
<feed xmlns="http://www.w3.org/2005/Atom"><title>The CodeCx Blog - docs</title><link href="/" rel="alternate"></link><link href="/feeds/docs.atom.xml" rel="self"></link><id>/</id><updated>2017-08-20T00:00:00+05:30</updated><entry><title>Floydhub Documentation</title><link href="/floydhub-documentation.html" rel="alternate"></link><published>2017-08-20T00:00:00+05:30</published><updated>2017-08-20T00:00:00+05:30</updated><author><name>Aditya Arora</name></author><id>tag:None,2017-08-20:/floydhub-documentation.html</id><summary type="html"><h1>Floyd Documentation</h1>
<p>Floyd is a great cloud computing platform.</p>
<h2>Python Machine Learning Setting up floyd</h2>
<p>Setting up floyd for using on Windows</p>
<h2>Installation</h2>
<div class="highlight"><pre><span></span>$ pip install -U floyd-cli
</pre></div>
<h2>Login</h2>
<div class="highlight"><pre><span></span>$ floyd login
</pre></div>
<p>Copy and paste your authentication token in your terminal</p>
<h2>Run project</h2>
<p><strong>Make a project folder</strong></p>
<div class="highlight"><pre><span></span>$ mkdir myproject
</pre></div>
<p><strong>Change to project …</strong></p></summary><content type="html"><h1>Floyd Documentation</h1>
<p>Floyd is a great cloud computing platform.</p>
<h2>Python Machine Learning Setting up floyd</h2>
<p>Setting up floyd for using on Windows</p>
<h2>Installation</h2>
<div class="highlight"><pre><span></span>$ pip install -U floyd-cli
</pre></div>
<h2>Login</h2>
<div class="highlight"><pre><span></span>$ floyd login
</pre></div>
<p>Copy and paste your authentication token in your terminal</p>
<h2>Run project</h2>
<p><strong>Make a project folder</strong></p>
<div class="highlight"><pre><span></span>$ mkdir myproject
</pre></div>
<p><strong>Change to project folder</strong></p>
<div class="highlight"><pre><span></span>$ <span class="nb">cd</span> myproject
</pre></div>
<p><strong>Make a folder for data</strong></p>
<div class="highlight"><pre><span></span>$ mkdir mydata
</pre></div>
<p><strong>Make a folder for code</strong></p>
<div class="highlight"><pre><span></span>$ mkdir mycode
</pre></div>
<p>Paste all your data in <code>mydata</code></p>
<p>Paste all your code in <code>mycode</code></p>
<p><strong>Change to data directory</strong></p>
<div class="highlight"><pre><span></span>$ <span class="nb">cd</span> mydata
</pre></div>
<h1>Initialise data</h1>
<div class="highlight"><pre><span></span>$ floyd data init sent-data
</pre></div>
<p>Then you can upload your dataset to Floyd.</p>
<div class="highlight"><pre><span></span>$ floyd data upload
</pre></div>
<p>Floyd will generate a data id for the uploaded dataset. This uploaded dataset can be used in your future experiments, if needed, using this data id.</p>
<p><strong>Output</strong></p>
<div class="highlight"><pre><span></span>Creating data source. Uploading files ...
DATA ID NAME VERSION
---------------------- -------------------- ---------
GY3QRFFUA8KpbnqvroTPPW alice/sent-data:1 1
</pre></div>
<p><strong>Change to main directory</strong></p>
<div class="highlight"><pre><span></span>$ <span class="nb">cd</span> ..
</pre></div>
<p><strong>Change to code directory</strong></p>
<div class="highlight"><pre><span></span>$ <span class="nb">cd</span> mycode
</pre></div>
<p><strong>Run the code</strong></p>
<div class="highlight"><pre><span></span>$ floyd run --data &lt;DATA_KEY&gt;:&lt;MOUNT&gt; --env theano-0.9:py2 <span class="s2">&quot;python filename.py&quot;</span>
</pre></div>
<p><strong>Example code</strong></p>
<div class="highlight"><pre><span></span>$ floyd run --data GY3QRFFUA8KpbnqvroTPPW:mydata --env theano-0.9:py2 <span class="s2">&quot;python mlp.py&quot;</span>
</pre></div>
<p><strong>Check the status of code</strong></p>
<div class="highlight"><pre><span></span>$ floyd logs &lt;RUN_ID&gt;
</pre></div>
<h1>Some common problems:</h1>
<ul>
<li>Should I put my code and data in separate folders</li>
</ul>
<p>NOTE: Adding the codes in a separate folder prevents re-loading of data in the memory of floyd server.
Floyd server synchronizes the WHOLE FOLDER in which the code is located when you run the code using the above command, which is actually a waste of (upload) time and a problem of data redundancy as you have already uploaded the data on the server.</p>
<ul>
<li>How to link data in my script</li>
</ul>
<div class="highlight"><pre><span></span>x_data = np.load(&#39;/nfiles/fileone.npy&#39;)
y_data = np.load(&#39;/nfiles/filetwo.npy&#39;)
</pre></div>
<p>Here, nfiles is my MOUNT point.</p>
<ul>
<li>If you are using Anaconda prompt and you come across the following error after running the command: "pip install -U floyd-cli": scandir could not be installed</li>
</ul>
<div class="highlight"><pre><span></span>$ conda install -c conda-forge <span class="nv">scandir</span><span class="o">=</span><span class="m">1</span>.5
</pre></div>
<p><em>Contributors:</em>
<em> Aditya Arora
</em> Piyush Jha
* Akshita Gupta</p></content><category term="floyd"></category></entry></feed>