From 82fb8e9b3c7da857f9b06bd2f7809c5e0e2eef5a Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?=E6=80=9D=E9=80=9A=E6=95=B0=E7=A7=91=20StoneDT?= <13913853100@163.com> Date: Mon, 21 Feb 2022 08:55:29 +0000 Subject: [PATCH] update dataCollection.md. --- dataCollection.md | 24 ++++++++++-------------- 1 file changed, 10 insertions(+), 14 deletions(-) diff --git a/dataCollection.md b/dataCollection.md index 48f4847..d258ed1 100644 --- a/dataCollection.md +++ b/dataCollection.md @@ -37,20 +37,16 @@

## 开源技术栈 -- Java EE -- SpringBoot -- HttpClient -- webMagic -- Spider-flow -- Redis -- MySQL -- VUE -- Tomcat -- Nginx -- Zookeeper -- Kafka -- RabbitMQ -- Bootstrap + +- 开发平台:Java EE & SpringBoot +- 爬虫框架:Spider-flow & WebMagic & HttpClient +- APP爬虫:Xposed框架 +- URL仓库:Redis +- web应用服务器:Nginx&Tomcat +- 数据处理和储存任务发送:Kafka&Zookeeper +- 抓取任务发送:RabbitMQ +- 配置管理:MySQL +- 前端展示:Bootstrap & VUE ## 总体架构