Hoe Crawler

A personal research tool for analyzing escort services data in Vietnam.

Vision & Planned Features

• Data Collection

  • Track available services and providers
  • Monitor price changes
  • Save detailed service information
  • Get notifications for new listings

• Advanced Analytics

  • Hotel-based filtering
  • Price history tracking
  • Work history across different locations
  • Visual analytics
    • Price trend charts
    • Location heat maps
    • Availability patterns
    • Custom data reports

Note: Currently in early development. This tool is for personal research purposes only. Please follow your local laws and regulations.

System Requirements

• Go 1.23+
• Docker & Docker Compose
• MariaDB 11.6

Setup

1. Environment Configuration

Create .env file from example:

cp .env.example .env

Update environment variables in .env:

2. Run setup script

chmod +x setup.sh
./setup.sh

3. Install Dependencies

go mod download

Usage

Crawl List Page

go run cmd/list/main.go --site=gaito

Crawl Detail Page

go run cmd/detail/main.go --site=gaito

Parameters

• --site: Target site name (default: "gaito")
• --log-level: Logging level (default: "INFO")