Skip to content

Commit 6837174

Browse files
authored
Update README.md
1 parent 956e376 commit 6837174

1 file changed

Lines changed: 3 additions & 11 deletions

File tree

Scrapy/README.md

Lines changed: 3 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -67,23 +67,19 @@ for i in range(2, npages +1 ):
6767
start_urls.append("https://fundrazr.com/find?category=Health&page="+str(i)+"")
6868
```
6969

70-
## Finding out where on the page individual Campaign Links Are
71-
72-
![](https://github.com/mGalarnyk/Python_Tutorials/blob/master/Scrapy/Tutorial_Images/inspectCampaigns.png)
73-
<br>
74-
7570
## Scrapy Shell for finding Individual Campaign Links
7671
The best way to learn how to extract data with Scrapy is trying selectors using the shell Scrapy shell. We will use XPaths which can be used to select elements from HTML documents.
7772

78-
The first thing we will try and get the xpaths for are the individual campaign links.
73+
The first thing we will try and get the xpaths for are the individual campaign links. First we do inspect to see roughly where the campaigns are in the HTML.
7974

8075
![](https://github.com/mGalarnyk/Python_Tutorials/blob/master/Scrapy/Tutorial_Images/inspectCampaigns.png)
8176
<br>
8277

78+
We will use xpaths to extract the part enclosed in the red rectangle below.
8379
![](https://github.com/mGalarnyk/Python_Tutorials/blob/master/Scrapy/Tutorial_Images/campaignLink.png)
8480
<br>
8581

86-
Our first learning is extracting links to individual campaigns.
82+
The best way to see if our to make xpaths and to check if they work is to test it inside scrapy shell.
8783

8884
In terminal type (mac/linux):
8985

@@ -97,10 +93,6 @@ In command line type (windows):
9793
scrapy shell "https://fundrazr.com/find?category=Health"
9894
```
9995

100-
1. Our first learning is extracting links to individual campaigns.
101-
102-
103-
10496
The image below is inside scrapy shell
10597

10698
![](https://github.com/mGalarnyk/Python_Tutorials/blob/master/Scrapy/Tutorial_Images/individualCampaignLinks.png)

0 commit comments

Comments
 (0)