File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -75,7 +75,8 @@ feaplat支持对feapder爬虫的运行情况进行监控,除了数据监控和
7575
7676注:需 feapder>=1.6.6
7777
78- ![ ] ( http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/09/13/16315073567832.jpg )
78+ ![ ] ( http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/09/14/16316112326191.jpg )
79+
7980
8081
8182## 部署
Original file line number Diff line number Diff line change @@ -85,6 +85,6 @@ DEBUG级别的报警包含一些运行信息,ERROR级别的报警都是有问
8585
8686支持对爬虫运行情况进行监控,除了数据监控和请求监控外,用户还可自定义监控内容,详情参考[ 自定义监控] ( source_code/监控打点?id=自定义监控 )
8787
88- ![ ] ( http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/09/13/16315073567832 .jpg )
88+ ![ ] ( http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/09/14/16316112326191 .jpg )
8989
9090需 feapder>=1.6.6, 需配合feaplat爬虫管理平台
Original file line number Diff line number Diff line change 1010
1111feapder内置了监控打点,只需要部署到feaplat爬虫管理系统即可实现对请求和数据监控
1212
13- ![ ] ( http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/09/13/16315073567832 .jpg )
13+ ![ ] ( http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/09/14/16316112326191 .jpg )
1414
1515- 注意使用 ` yield item ` 的方式入库的数据,才能看到数据监控的指标,图表的title是表名,折线图展示了每个字段是否有值的情况以及数据总量(total count)
1616
Original file line number Diff line number Diff line change @@ -103,7 +103,7 @@ def run(self):
103103 self ._thread_stop = False
104104 while not self ._thread_stop :
105105 self .flush ()
106- tools .delay_time (0.5 )
106+ tools .delay_time (1 )
107107
108108 self .close ()
109109
You can’t perform that action at this time.
0 commit comments