Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
byt3hx authored Nov 7, 2023
1 parent 0bbd399 commit 417e322
Showing 1 changed file with 8 additions and 82 deletions.
90 changes: 8 additions & 82 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,88 +1,14 @@
# webanalyze
# Introduction

This is a port of [Wappalyzer](https://github.com/AliasIO/Wappalyzer) in Go. This tool is designed to be performant and allows to test huge lists of hosts.
I made this script to output as one single line for the result.

## Installation and usage


### Precompiled releases
Precompiled releases can be downloaded directly [here](https://github.com/rverton/webanalyze/releases).

### Build
If you want to build for yourself:

$ go install -v github.com/rverton/webanalyze/cmd/webanalyze@latest
$ webanalyze -update # loads new technologies.json file from wappalyzer project
$ webanalyze -h
Usage of webanalyze:
-apps string
app definition file. (default "technologies.json")
-crawl int
links to follow from the root page (default 0)
-host string
single host to test
-hosts string
filename with hosts, one host per line.
-output string
output format (stdout|csv|json) (default "stdout")
-search
searches all urls with same base domain (i.e. example.com and sub.example.com) (default true)
-silent
avoid printing header (default false)
-update
update apps file
-worker int
number of worker (default 4)


The `-update` flags downloads a current version of `technologies.json` from the [wappalyzer repository](https://github.com/AliasIO/Wappalyzer) to the current folder.

### Docker

```bash
# Clone the repo
git clone https://github.com/rverton/webanalyze.git
# Build the container
docker build -t webanalyze:latest webanalyze
# Run the container
docker run -it webanalyze:latest -h
Example:
```
https://www.google.com : [Google Web Server, (Web servers) | HTTP/3, (Miscellaneous)]
```

## Development / Usage as a lib

See `cmd/webanalyze/main.go` for an example on how to use this as a library.

## Example

$ ./webanalyze -host robinverton.de -crawl 1
:: webanalyze : v1.0
:: workers : 4
:: apps : technologies.json
:: crawl count : 1
:: search subdomains : true

https://robinverton.de/hire/ (0.5s):
Highlight.js, (Miscellaneous)
Netlify, (Web Servers, CDN)
Google Font API, (Font Scripts)
http://robinverton.de (0.8s):
Highlight.js, (Miscellaneous)
Netlify, (Web Servers, CDN)
Hugo, 0.42.1 (Static Site Generator)
Google Font API, (Font Scripts)
Thanks to rverton!

$ ./webanalyze -host robinverton.de -crawl 1 -output csv
:: webanalyze : v1.0
:: workers : 4
:: apps : technologies.json
:: crawl count : 1
:: search subdomains : true
# Original Repo

Host,Category,App,Version
https://robinverton.de/hire/,Miscellaneous,Highlight.js,
https://robinverton.de/hire/,Font Scripts,Google Font API,
https://robinverton.de/hire/,"Web Servers,CDN",Netlify,
http://robinverton.de,"Web Servers,CDN",Netlify,
http://robinverton.de,Static Site Generator,Hugo,0.42.1
http://robinverton.de,Miscellaneous,Highlight.js,
http://robinverton.de,Font Scripts,Google Font API,
https://github.com/rverton/webanalyze

0 comments on commit 417e322

Please sign in to comment.