Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit history

Commits on Sep 25, 2024

• 修复response 判空问题

  Boris-code

  committed
  df1d2d3

  Copy full SHA for df1d2d3

Commits on Jun 28, 2023

• 完善代理池，支持删除代理

  Boris-code

  committed
  a1aa394

  Copy full SHA for a1aa394

Commits on Mar 29, 2023

• 修复exception_request及failed_request参数适配问题

  Boris-code

  committed
  a937378

  Copy full SHA for a937378

Commits on Nov 29, 2022

• response为空时不经过校验函数

  Boris-code

  committed
  6f97e5b

  Copy full SHA for 6f97e5b

Commits on Nov 2, 2022

• 修复下载中间件中自定义返回response时，response.browser属性不存在导致异常的bug

  Boris-code

  committed
  d539ce6

  Copy full SHA for d539ce6

Commits on Oct 25, 2022

• air spider 支持去重

  Boris-code

  committed
  051c2ae

  Copy full SHA for 051c2ae

Commits on Sep 28, 2022

• exception_request及failed_request透传异常参数e

  Boris-code

  committed
  9b2d1a7

  Copy full SHA for 9b2d1a7

Commits on Sep 22, 2022

• 优化代码

  Boris-code

  committed
  6570d3f

  Copy full SHA for 6570d3f

Commits on Sep 15, 2022

• response 添加浏览器对象

  Boris-code

  committed
  78fabd3

  Copy full SHA for 78fabd3

Commits on Aug 15, 2022

• 修复AirSpider 内存任务队列限制maxsize后，重试请求或者下发子请求时卡死的问题

  Boris-code

  committed
  4ce959a

  Copy full SHA for 4ce959a

Commits on Jul 31, 2022

• 1. request支持是否拼接绝对连接参数 2. 下载方法单独抽离出来，方便扩展

  Boris-code

  committed
  245bc93

  Copy full SHA for 245bc93

Commits on Jun 7, 2022

• 优化日志

  Boris-code

  committed
  75300f8

  Copy full SHA for 75300f8

Commits on May 17, 2022

• 优化collector

  Boris-code

  committed
  f2afac2

  Copy full SHA for f2afac2

Commits on Apr 22, 2022

• collector使用Queue队列

  Boris-code

  committed
  0a92099

  Copy full SHA for 0a92099

Commits on Feb 12, 2022

• 优化好提示

  Boris-code

  committed
  dba0d0b

  Copy full SHA for dba0d0b

Commits on Nov 18, 2021

• 适配python3.10

  Boris-code

  committed
  aa3df59

  Copy full SHA for aa3df59

Commits on Sep 8, 2021

• 下载中间件支持指定多个

  Boris-code

  committed
  80aa40c

  Copy full SHA for 80aa40c

Commits on Aug 27, 2021

• 框架主线程捕获异常，防止爬虫某个线程死掉 1.6.7-beta2

  Boris-code

  committed
  744608a

  Copy full SHA for 744608a

Commits on Aug 4, 2021

• 解决jion报错问题

  Boris-code

  committed
  32721c6

  Copy full SHA for 32721c6

• 集成打点监控

  Boris-code

  committed
  f5f17f9

  Copy full SHA for f5f17f9

Commits on Jul 8, 2021

• 去掉特殊的空白符

  Boris-code

  committed
  928e196

  Copy full SHA for 928e196

Commits on May 28, 2021

• 修改邮箱

  Boris-code

  committed
  1ef34e2

  Copy full SHA for 1ef34e2

Commits on May 26, 2021

• 下载时间间隔支持随机 添加爬虫文档

  Boris-code

  committed
  a73682c

  Copy full SHA for a73682c

Commits on May 13, 2021

• 线程可重复启动

  Boris-code

  committed
  b423722

  Copy full SHA for b423722

Commits on May 8, 2021

• update tip

  Boris-code

  committed
  24f858c

  Copy full SHA for 24f858c

Commits on Apr 19, 2021

• download_midware 支持自定义下载

  Boris-code

  committed
  b198c2a

  Copy full SHA for b198c2a

• 浏览器渲染模式下response携带browser, 可操控浏览器

  Boris-code

  committed
  fee5e61

  Copy full SHA for fee5e61

Commits on Apr 16, 2021

• 添加校验函数

  Boris-code

  committed
  2f4b551

  Copy full SHA for 2f4b551

Commits on Mar 30, 2021

• AirSpider 支持itemz自动入库

  

  Boris

  committed
  a410275

  Copy full SHA for a410275

Commits on Mar 20, 2021

• 修改提示parser为parse

  

  Boris

  committed
  0a4af38

  Copy full SHA for 0a4af38

Commits on Mar 12, 2021

• 修复日志等级问题

  

  Boris

  committed
  1fa8c85

  Copy full SHA for 1fa8c85

Commits on Mar 3, 2021

• 修改爬虫parser函数为parse， 添加集成爬虫示例

  

  Boris

  committed
  416dd13

  Copy full SHA for 416dd13

Commits on Feb 8, 2021

• rename parser to spider, rename parser_count to thread_count

  

  Boris

  committed
  88a244d

  Copy full SHA for 88a244d

• 支持AirSpider Spider BatchSpider 爬虫模板, 重命名table_folder 为 redis_key, 重命名SingleSpider为AirSpider

  

  Boris

  committed
  3519dd4

  Copy full SHA for 3519dd4

• boris-spider重命名为feapder

  

  Boris

  committed
  b65f081

  Copy full SHA for b65f081

Loading