forked from rverton/webanalyze
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
1 changed file
with
8 additions
and
82 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,88 +1,14 @@ | ||
# webanalyze | ||
# Introduction | ||
|
||
This is a port of [Wappalyzer](https://github.com/AliasIO/Wappalyzer) in Go. This tool is designed to be performant and allows to test huge lists of hosts. | ||
I made this script to output as one single line for the result. | ||
|
||
## Installation and usage | ||
|
||
|
||
### Precompiled releases | ||
Precompiled releases can be downloaded directly [here](https://github.com/rverton/webanalyze/releases). | ||
|
||
### Build | ||
If you want to build for yourself: | ||
|
||
$ go install -v github.com/rverton/webanalyze/cmd/webanalyze@latest | ||
$ webanalyze -update # loads new technologies.json file from wappalyzer project | ||
$ webanalyze -h | ||
Usage of webanalyze: | ||
-apps string | ||
app definition file. (default "technologies.json") | ||
-crawl int | ||
links to follow from the root page (default 0) | ||
-host string | ||
single host to test | ||
-hosts string | ||
filename with hosts, one host per line. | ||
-output string | ||
output format (stdout|csv|json) (default "stdout") | ||
-search | ||
searches all urls with same base domain (i.e. example.com and sub.example.com) (default true) | ||
-silent | ||
avoid printing header (default false) | ||
-update | ||
update apps file | ||
-worker int | ||
number of worker (default 4) | ||
|
||
|
||
The `-update` flags downloads a current version of `technologies.json` from the [wappalyzer repository](https://github.com/AliasIO/Wappalyzer) to the current folder. | ||
|
||
### Docker | ||
|
||
```bash | ||
# Clone the repo | ||
git clone https://github.com/rverton/webanalyze.git | ||
# Build the container | ||
docker build -t webanalyze:latest webanalyze | ||
# Run the container | ||
docker run -it webanalyze:latest -h | ||
Example: | ||
``` | ||
https://www.google.com : [Google Web Server, (Web servers) | HTTP/3, (Miscellaneous)] | ||
``` | ||
|
||
## Development / Usage as a lib | ||
|
||
See `cmd/webanalyze/main.go` for an example on how to use this as a library. | ||
|
||
## Example | ||
|
||
$ ./webanalyze -host robinverton.de -crawl 1 | ||
:: webanalyze : v1.0 | ||
:: workers : 4 | ||
:: apps : technologies.json | ||
:: crawl count : 1 | ||
:: search subdomains : true | ||
|
||
https://robinverton.de/hire/ (0.5s): | ||
Highlight.js, (Miscellaneous) | ||
Netlify, (Web Servers, CDN) | ||
Google Font API, (Font Scripts) | ||
http://robinverton.de (0.8s): | ||
Highlight.js, (Miscellaneous) | ||
Netlify, (Web Servers, CDN) | ||
Hugo, 0.42.1 (Static Site Generator) | ||
Google Font API, (Font Scripts) | ||
Thanks to rverton! | ||
|
||
$ ./webanalyze -host robinverton.de -crawl 1 -output csv | ||
:: webanalyze : v1.0 | ||
:: workers : 4 | ||
:: apps : technologies.json | ||
:: crawl count : 1 | ||
:: search subdomains : true | ||
# Original Repo | ||
|
||
Host,Category,App,Version | ||
https://robinverton.de/hire/,Miscellaneous,Highlight.js, | ||
https://robinverton.de/hire/,Font Scripts,Google Font API, | ||
https://robinverton.de/hire/,"Web Servers,CDN",Netlify, | ||
http://robinverton.de,"Web Servers,CDN",Netlify, | ||
http://robinverton.de,Static Site Generator,Hugo,0.42.1 | ||
http://robinverton.de,Miscellaneous,Highlight.js, | ||
http://robinverton.de,Font Scripts,Google Font API, | ||
https://github.com/rverton/webanalyze |