Commits

Breadcrumbs

History for

ondevelop

User selector

All users

All time

Commit history

Commits on Jan 24, 2022

• 日志友好化

  Boris-code

  committed
  ca4299d

  Copy full SHA for ca4299d

Commits on Dec 30, 2021

• 爬虫集成支持传参

  Boris-code

  committed
  3a1afb2

  Copy full SHA for 3a1afb2

Commits on Nov 18, 2021

• 适配python3.10

  Boris-code

  committed
  aa3df59

  Copy full SHA for aa3df59

Commits on Aug 27, 2021

• 框架主线程捕获异常，防止爬虫某个线程死掉 1.6.7-beta2

  Boris-code

  committed
  744608a

  Copy full SHA for 744608a

Commits on Aug 25, 2021

• 优化 redis锁，修复转字符串cookie为json时的bug，添加cookie池，response的源码支持重新赋值，以便浏览器渲染时使用

  Boris-code

  committed
  d1e0c78

  Copy full SHA for d1e0c78

Commits on Aug 17, 2021

• 数据入库失败 自动重试

  Boris-code

  committed
  1b00eb3

  Copy full SHA for 1b00eb3

Commits on Aug 15, 2021

• auto_stop_when_spider_done参数改为keep_alive

  Boris-code

  committed
  21d1737

  Copy full SHA for 21d1737

Commits on Aug 4, 2021

• 解决jion报错问题

  Boris-code

  committed
  32721c6

  Copy full SHA for 32721c6

• 集成打点监控

  Boris-code

  committed
  f5f17f9

  Copy full SHA for f5f17f9

Commits on Jul 20, 2021

• 钉钉报警支持提示所有人

  Boris-code

  committed
  07f350c

  Copy full SHA for 07f350c

Commits on Jul 15, 2021

• 优化锁的问题

  Boris-code

  committed
  15ed732

  Copy full SHA for 15ed732

• 重置丢失任务

  Boris-code

  committed
  931b514

  Copy full SHA for 931b514

Commits on Jun 18, 2021

• 日志支持带颜色输出

  Boris-code

  committed
  3f7491f

  Copy full SHA for 3f7491f

Commits on May 28, 2021

• 修改邮箱

  Boris-code

  committed
  1ef34e2

  Copy full SHA for 1ef34e2

Commits on May 13, 2021

• 线程可重复启动

  Boris-code

  committed
  b423722

  Copy full SHA for b423722

Commits on Apr 16, 2021

• 接入企业微信报警

  Boris-code

  committed
  ee28d8a

  Copy full SHA for ee28d8a

Commits on Apr 15, 2021

• 修改个错别词

  s0ing

  committed
  8f9160d

  Copy full SHA for 8f9160d

Commits on Apr 7, 2021

• 修改提示

  

  Boris

  committed
  748c496

  Copy full SHA for 748c496

Commits on Mar 26, 2021

• 支持邮件报警

  

  Boris

  committed
  12a2c57

  Copy full SHA for 12a2c57

Commits on Mar 23, 2021

• 修复阿里云redis集群调用Lua脚本报错的问题

  

  Boris

  committed
  421f281

  Copy full SHA for 421f281

Commits on Mar 18, 2021

• 支持浏览器渲染下载

  

  Boris

  committed
  7b1e067

  Copy full SHA for 7b1e067

• 完善文档, update_items改为非必须实现接口

  

  Boris

  committed
  e017bdd

  Copy full SHA for e017bdd

Commits on Mar 15, 2021

• 只删除本空间下的key

  

  Boris

  committed
  591a906

  Copy full SHA for 591a906

• 删除无用的process_num参数

  

  Boris

  committed
  22a813e

  Copy full SHA for 22a813e

Commits on Mar 12, 2021

• 修复日志等级问题

  

  Boris

  committed
  1fa8c85

  Copy full SHA for 1fa8c85

Commits on Mar 11, 2021

• delete_tabs 改为 delete_keys，添加常见问题-运行问题

  

  Boris

  committed
  b7f8bff

  Copy full SHA for b7f8bff

Commits on Mar 6, 2021

• 完成 request response文档

  

  Boris

  committed
  be9b03e

  Copy full SHA for be9b03e

Commits on Mar 3, 2021

• 修改爬虫parser函数为parse， 添加集成爬虫示例

  

  Boris

  committed
  416dd13

  Copy full SHA for 416dd13

Commits on Feb 8, 2021

• delete parser_args parser_kwargs

  

  Boris

  committed
  973dc66

  Copy full SHA for 973dc66

• rename parser to spider, rename parser_count to thread_count

  

  Boris

  committed
  88a244d

  Copy full SHA for 88a244d

• 支持AirSpider Spider BatchSpider 爬虫模板, 重命名table_folder 为 redis_key, 重命名SingleSpider为AirSpider

  

  Boris

  committed
  3519dd4

  Copy full SHA for 3519dd4

• boris-spider重命名为feapder

  

  Boris

  committed
  b65f081

  Copy full SHA for b65f081

Loading