Categorygithub.com/Leosocy/IntelliProxy
modulepackage
0.0.0-20230215061254-6e903284d096
Repository: https://github.com/leosocy/intelliproxy.git
Documentation: pkg.go.dev

# README

IntelliProxy: Provide durable, real-time, high-quality proxies as a middleman or datasource server

Build Status codecov

The client can simply use IntelliProxy as a proxy server to achieve random ip access to the target host. IntelliProxy acts as a middleman to forward client requests to real proxy servers according to certain strategies. middleman

Or the client can use IntelliProxy as a data source to request the required proxy through the RESTful API.

组织架构

  • Proxy: http(s)代理对象,包括ip, port, geo info, anonymity, latency, speed等属性。
  • Spider: 免费代理资源爬取器。
  • Checker: 检验代理质量,包括时延、网速等等,同时给代理打分。
  • Storage: 存储Proxy的介质,例如InMemory、MySQL、Mongo、Redis等等。
  • Scheduler: 负责调度Spider, Checker, Storage之间的合作。
  • Service
    • middleman: client可以直接将代理服务器指向middleman监听的端口,IntelliProxy会选出最佳的代理服务器转发出去。
    • datasource: 提供RESTful API,支持查询符合条件的proxy。

主要用到的开源包

  • colly,用于发起请求,解析响应等等。

免费代理资源列表

启动

Usage

middleman

datasource

APIMethodDescriptionArgsTry
http://localhost:8000/proxies?ipp=10&page=1GET根据Score.Desc,返回指定页的10个代理ipp:一页返回n条记录,range(0, 50] page:第n页
http://localhost:8000/proxies?ipp=10&page=1&geo.country_code=CNGET根据Geo信息的国家码返回中国的代理geo.xxx: xxx

TODO List

  • Spiders支持从config文件加载

# Packages

No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author