Commit Graph

221 Commits

Author SHA1 Message Date
shmilylty f9117ff795 添加resp.json()异常处理 2019-08-11 20:10:23 +08:00
shmilylty d2219bdf8c 添加搜索退出判断 2019-08-11 20:08:06 +08:00
shmilylty 3c8627035d 设置域传送超时为30秒 2019-08-11 19:58:10 +08:00
shmilylty 4bb52f4183 参数调优 2019-08-11 15:53:49 +08:00
shmilylty f426b8f2f6 重构 2019-08-11 03:48:36 +08:00
shmilylty ebd81b83e9 pep8 2019-08-10 14:54:08 +08:00
shmilylty d10bc9c8d9 默认不使用代理 2019-08-10 03:30:52 +08:00
shmilylty a7b189f311 调整执行finish函数位置 2019-08-10 00:48:51 +08:00
shmilylty 98642da4f3 拆分出执行域传送函数 2019-08-09 23:46:09 +08:00
shmilylty f17aea1f44 删除无用日志输出 2019-08-09 23:20:21 +08:00
shmilylty 611580aa97 修正模块名字 2019-08-09 21:02:27 +08:00
shmilylty b21e31a223 database.py修改为类 2019-08-09 18:47:01 +08:00
shmilylty 4c63bd672f 修正valid参数使用描述 2019-08-09 16:56:03 +08:00
shmilylty c026dc550e 新增检查sitemap收集子域名模块 2019-08-09 16:43:09 +08:00
shmilylty f2b08f6b02 新增检查robots.txt收集子域名模块 2019-08-09 16:42:03 +08:00
shmilylty c2679a6ceb 暂时不探测https 2019-08-09 15:13:22 +08:00
shmilylty 9197aaf52b pep8 2019-08-09 14:25:21 +08:00
shmilylty 05040d3b8d resolve_callback函数添加说明并做容错处理 2019-08-09 01:12:52 +08:00
shmilylty e248826327 v0.0.3 2019-08-08 23:37:09 +08:00
shmilylty 07de3ecc2b 解决报WRONG_VERSION_NUMBER问题 2019-08-08 22:34:56 +08:00
shmilylty 8148c56fbc 不使用回调 2019-08-08 17:30:02 +08:00
shmilylty d4e77aeac2 设置系统变量PYTHONIOENCODING为utf-8 去掉使用reconfigure函数设置 2019-08-08 13:59:20 +08:00
shmilylty f1fdb32b56 添加终端输出为utf-8编码 2019-08-08 12:11:40 +08:00
shmilylty f5ba141097 终端日志输出改为sys.stderr 2019-08-08 11:53:38 +08:00
shmilylty 3e004dd069 pip8 2019-08-08 01:23:34 +08:00
shmilylty 47cfaca9ee pep8 2019-08-07 23:52:02 +08:00
shmilylty 28bfb80dc4 移除fake-useragent依赖 2019-08-07 18:28:36 +08:00
shmilylty 0fee65dd36 except BaseException 2019-08-07 15:50:13 +08:00
shmilylty cfd60b366c pip8 2019-08-07 15:49:27 +08:00
shmilylty 18851408c2 pip8格式化 使用ssl=False 2019-08-07 15:17:40 +08:00
shmilylty f74c45a67d pep6 2019-08-07 15:16:55 +08:00
shmilylty 85aa7d2ec4 添加字典 2019-08-07 01:44:08 +08:00
shmilylty b628859d32 pep8 2019-08-07 01:32:49 +08:00
shmilylty 8ba3b926ce pep8 2019-08-06 22:52:44 +08:00
shmilylty d9c12ef9c3 deal_results函数里添加响应结果判断 2019-08-06 12:07:02 +08:00
shmilylty f17a2636ae 修改为默认不使用代理,默认请求超时30秒。 2019-08-06 02:14:45 +08:00
shmilylty 84dd464a02 添加任务分组参数 2019-08-06 02:13:39 +08:00
shmilylty 62d2b1e4bd 修改默认使用字典文件 2019-08-06 01:09:29 +08:00
shmilylty ca09ea5870 移除参数ssl=False 2019-08-06 00:43:30 +08:00
shmilylty 365162a474 修改程序入口为fire 2019-08-06 00:42:49 +08:00
shmilylty 60d8a2a88a 向TCPConnector函数添加ssl=False禁用SSL证书检查 2019-08-06 00:22:28 +08:00
shmilylty cd22034415 修改为正确执行resp.json()的条件 2019-08-06 00:13:35 +08:00
shmilylty 8420258ff7 增加判断响应体不为空才执行resp.json() 2019-08-06 00:00:55 +08:00
shmilylty 31666fdd75 移除aiobrute向aiodns_query_a()函数传semaphore参数 2019-08-05 23:38:53 +08:00
shmilylty e3f9d5e149 修复aiobrute中没有传semaphore参数问题 2019-08-05 22:28:17 +08:00
shmilylty e8781c7a29 添加响应判断 2019-08-05 19:11:40 +08:00
shmilylty d8b3fe4bd8 new_table_name使用双引号包裹 2019-08-05 18:12:39 +08:00
shmilylty 5ccf57d595 表名用双引号包裹 解决issues/2 2019-08-05 18:01:48 +08:00
shmilylty 11642edf6e 优化代码结构 删除无用队列结果集参数 2019-08-05 18:00:01 +08:00
shmilylty 53213304e2 修改为api调用 2019-08-05 17:58:35 +08:00