1 Star 0 Fork 50

ivan118 / RuiJi.Net

forked from 朱平齐 / RuiJi.Net 
加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
克隆/下载
technology.txt 1.38 KB
一键复制 编辑 Web IDE 原始数据 按行查看 历史
朱平齐 提交于 2018-07-10 20:36 . s
https://www.iana.org/assignments/media-types/media-types.xhtml
xcopy "$(ProjectDir)www" "$(SolutionDir)RuiJi.Net.Cmd\bin\debug\www" /E /Y
open source projects that may be possible to use in the future
cassandra
Cassandra is a high performance distributed key value store.
Install-Package Cassandra -Version 2.2.5
Phantomjs
PhantomJS is a headless WebKit scriptable with a JavaScript API. It has fast and native support for various web standards: DOM handling, CSS selector, JSON, Canvas, and SVG.
Install-Package PhantomJS -Version 2.1.1
casperjs
Hadoop
Spark
数据采集
Sqoop
Flume
HUB web管理
Oozie 工作流调度
数据存储 ✓X
函数添加 ✓
Selector结果处理函数 ✓
日志 ✓X
代理服务器管理 ✓
Web Ui ✓X
Seed需要分两种类型:检测更新型/即时抓取型 ✓X
Cookie信道 ✓
Cookie API X
自动化登陆 X (https://slimerjs.org/ or https://github.com/ariya/phantomjs/blob/master/examples/phantomwebintro.js )
动态类生成 X
分离config文件 X
Redis X
Orc(Tesseract orc) X
RuiJi Expresss advanced setting X
https proxy X
Java/PHP/C# SDK X
Download result to be packaged into zip X
--------------------------------------------
Storage
Spider
Cookie Chanel ✓
Post Ajax ✓
Logger
RuiJi Expresss advanced parser
https proxy
File Func ✓
RTS X
MessageQueue iisue
-------------------------------------------
Zk cluster/HA
任务调度
规则缓存
C#
1
https://gitee.com/ivan118/RuiJi.Net.git
git@gitee.com:ivan118/RuiJi.Net.git
ivan118
RuiJi.Net
RuiJi.Net
master

搜索帮助