webmagicx一款基于webmagic的可配置化的爬虫框架
almost 2 years ago v1.1-alpha updated on Jan 25
59466_lizhengxian_1578915844
用Scala写的小爬虫,用到Java里的HttpClient,Jsoup等包,由于Scala基于Java,且作为Spark的源语言,以后可以考虑用集群来跑
almost 5 years ago
一个简单的web爬虫,采用scala akka实现
5 years ago

Help Search