Web Analyzer Tool

Overview

The Web Analyzer Tool is a comprehensive Python-based application designed for domain analysis, including WHOIS information retrieval, DNS records, subdomain discovery, SEO analysis, web technology detection, and advanced security analysis.

---

Features

1. Domain Information Retrieval

   • Fetches WHOIS information (registrar, creation date, expiry date, etc.)
   • Detects privacy protection, DNSSEC status, and SSL details.
   • Retrieves server provider and physical location information.

2. DNS Records Analysis

   • Resolves A (IPv4), AAAA (IPv6), MX (Mail Servers), TXT (Verification), and NS (Name Server) records.
   • Measures DNS response time.

3. Subdomain Discovery

   • Uses Subfinder to discover subdomains of a given domain.
   • Saves results in the corresponding domain folder under logs/.

4. SEO and Analytics Analysis

   • Extracts meta tags (description, keywords, canonical links).
   • Identifies Open Graph and Twitter tags.
   • Detects verification tags (Google, Bing, Yandex).
   • Recognizes analytics tools (Google Analytics, Tag Manager, Facebook Pixel, etc.).
   • Evaluates JavaScript frameworks and structured data.
   • Measures page load time and checks performance metrics.
   • Analyzes robots.txt and sitemap.xml files.

5. Web Technology Detection

   • Detects backend technologies (PHP, Django, Node.js, etc.).
   • Identifies frontend frameworks (React, Angular, Bootstrap, etc.).
   • Recognizes CDN services and checks for compression and caching policies.

6. Advanced Security Analysis

   • Detects Web Application Firewalls (WAFs).
   • Analyzes HTTPS enforcement and SSL certificates.
   • Examines security headers (CSP, HSTS, etc.).
   • Checks Cross-Origin Resource Sharing (CORS) policy.

---

Installation

Requirements

Ensure the following dependencies are installed:

• Python 3.x
• Go (for Subfinder)
• Git

Installation Steps

1. Clone the repository:

   git clone https://github.com/frkndncr/WebAnalyzer.git
   cd WebAnalyzer

2. Run the Install Python Dependencies:

   pip install -r requirements.txt

3. Run the setup script:

   ./setup.sh

   This script will:

   • Install required system packages.
   • Install and configure Subfinder.

4. Verify the installation:

   • Ensure subfinder is available in your PATH.
   • Ensure all Python modules are installed successfully.

---

Usage

1. Run the main script:

   python main.py

2. Enter the domain name when prompted:

   Please enter a domain name (e.g., example.com): yourdomain.com
   

3. The tool will:

   • Perform all analyses.
   • Display results on the terminal.
   • Save all results in a structured JSON file under logs/{domain}/results.json.

---

Project Structure

.
├── main.py                 # Entry point of the application
├── setup.sh                # Installation script
├── requirements.txt        # Python dependencies
├── logs/                   # Directory to store analysis results
├── modules/                # Directory containing all analysis modules
│   ├── domain_dns.py       # DNS record analysis module
│   ├── domain_info.py      # WHOIS information retrieval module
│   ├── seo_analysis.py     # SEO and analytics analysis module
│   ├── security_analysis.py# Security analysis module
│   ├── subfinder_tool.py   # Subdomain discovery module
│   ├── web_technologies.py # Web technology detection module
└── tests/                  # Test scripts for the project
    └── test_main.py        # Unit tests for main.py

---

Example Output Screenshot

JSON Output:

The results are saved as results.json in the corresponding domain folder:

{
  "Domain Information": {
    "Domain": "example.com",
    "Registrar Company": "Registrar Name",
    "Creation Date": "2020-01-01",
    "End Date": "2025-01-01",
    "Privacy Protection": "Effective",
    "Server Provider": "Cloudflare",
    "Physical Location": "San Francisco, US"
  },
  "DNS Records": {
    "A Records (IPv4)": ["192.168.0.1"],
    "MX Records (Mail Servers)": ["mail.example.com"],
    "Response Time (ms)": 35.5
  },
  "Subdomains": ["www.example.com", "blog.example.com"],
  "SEO Analysis": {
    "Meta Tags": {"Description": "Example description"},
    "Analytics Tools": {"Google Analytics IDs": ["UA-123456-7"]}
  },
  "Web Technologies": {
    "Backend Technologies": ["PHP", "WordPress"],
    "Frontend Technologies": ["Bootstrap"],
    "Content Delivery Network (CDN)": "Cloudflare"
  },
  "Security Analysis": {
    "Web Application Firewall": "Cloudflare",
    "SSL Info": {"Issuer": "Let's Encrypt"}
  }
}

---

Contribution

Feel free to contribute to this project by:

• Reporting issues.
• Suggesting features.
• Submitting pull requests.

---

License

This project is licensed under the MIT License.

Contact

• İnstagram: https://www.instagram.com/f3rrkan/
• LinkedIn: https://www.linkedin.com/in/furkan-dincer/
• Mail: [email protected]

---