WhatWeb has no caching so if you use aggressive plugins on redirecting URLs you may fetch the same files multiple times.
Performance & Stability
WhatWeb features several options to increase performance (https://www.kitploit.com/search/label/Performance) and stability.
--max-threads, -t Number of simultaneous threads. Default: 25.--open-timeout Time in seconds. Default: 15--read-timeout Time in seconds. Default: 30--wait=SECONDS Wait SECONDS between connections This is useful when using a single thread.The --wait and --max-threads commands can be used to assist in IDS evasion.
Changing the user-agent using the -U or --user-agent command line option will avoid the Snort IDS rule for WhatWeb.
If you are scanning ranges of IP addresses, it is much more efficient to use a port scanner (https://www.kitploit.com/search/label/Port%20Scanner) like massscan to discover which have port 80 open before scanning with WhatWeb.
Character set detection, with the Charset plugin dramatically decreases performance by requiring more CPU. This is required by JSON and MongoDB logging.
Optional Dependencies
To enable MongoDB logging install the mongo gem. gem install mongo
To enable character set detection and MongoDB logging install the rchardet gem. gem install rchardet cp plugins-disabled/charset.rb my-plugins/
Writing Plugins
Plugins are easy to write. Start by going through the plugin tutorials in the my-plugins/ folder.
Plugin Tutorials (https://github.com/urbanadventurer/WhatWeb/tree/master/my-plugins).After progressing through the tutorials read through the Development section of the wiki (https://github.com/urbanadventurer/WhatWeb/wiki/).
Sources for Plugin Writing (https://github.com/urbanadventurer/WhatWeb/wiki/Sources-for-Plugin-Writing)How to Develop WhatWeb Plugins (not up to date) (https://github.com/urbanadventurer/WhatWeb/wiki/How-to-develop-WhatWeb-plugins)
Updates & Additional Information
The WhatWeb development build features regular updates.
Check the development branches for unreleased updates.Browse the wiki for more documentation and advanced usage techniques.
Wiki: https://github.com/urbanadventurer/WhatWeb/wiki/
Release History
Version 0.5.0 Released June 9th, 2019Version 0.4.9 Released November 23rd, 2017Version 0.4.8-dev (Continuous release from 2012 to 2017)Version 0.4.7 Released April 5th, 2011Version 0.4.6 Released March 25th, 2011Version 0.4.5 Released August 17th, 2010Version 0.4.4 Released June 29th, 2010Version 0.4.3 Released May 24th, 2010Version 0.4.2 Released April 30th, 2010Version 0.4.1 Released April 28th, 2010Version 0.4 Released March 14th, 2010Version 0.3 Released at Kiwicon III (kiwicon.org), November 2nd, 2009
Credits
Developers
Andrew Horton (@urbanadventurer)Brendan Coles (@bcoles)
Contributors
Thank you to the following people who have contributed to WhatWeb.
Emilio CasbasLouis NyffeneggerPatrik Wallström (@pawal)Caleb Anderson (@dirtyfilthy)Tonmoy SaikiaAung Khant (@yehgdotnet)Erik Inge Bolsønk@dsigned.gr (mailto:nk@dsigned.gr)Steve Milner (@ashcrow)Michal AmbrozGremwellSagar Prakash Junnarkar (@sagarjunnarkar)GertBergerQuintin PoirierEric Sesterhenndengjw (@jawa)Pedro Worcel (@droop)Matthieu Keller (@maggick)Peter (2pvdl)Napz (@RootCon)@nilx042Fabian Affolter (@fabaff)Andrew Silvernail (@buff3r)Andre Ricardo (@andrericardo)nikoskPatrick Thomas (@coffeetocode)Guillaume Delcaour (@guikcd)Sean (@wiifm69)Matthieu Keller (@maggick)Raul (@raurodse)Andrew Petro (@apetro)Artem Taranyuk (@610)Matti Paksula (@matti)Tim Smith (@tas50)Sarthak Munshi (@saru95)@rdubourguais@SlivTaMere@Code0x58@iGeek098@andreas-becker@csalazar@golewski@Allactaga@lins05@eliasdorneles@sigitdewanto@elcodigok@SlivTaMere@anozoozianBhavin Senjaliya (@bhavin1223)Janosch Maier (@Phylu)@rmaksimovNaglis Jonaitis (@naglis)Igor Rzegocki (@ajgon)Please let me know if I need to add any more names.
Performance & Stability
WhatWeb features several options to increase performance (https://www.kitploit.com/search/label/Performance) and stability.
--max-threads, -t Number of simultaneous threads. Default: 25.--open-timeout Time in seconds. Default: 15--read-timeout Time in seconds. Default: 30--wait=SECONDS Wait SECONDS between connections This is useful when using a single thread.The --wait and --max-threads commands can be used to assist in IDS evasion.
Changing the user-agent using the -U or --user-agent command line option will avoid the Snort IDS rule for WhatWeb.
If you are scanning ranges of IP addresses, it is much more efficient to use a port scanner (https://www.kitploit.com/search/label/Port%20Scanner) like massscan to discover which have port 80 open before scanning with WhatWeb.
Character set detection, with the Charset plugin dramatically decreases performance by requiring more CPU. This is required by JSON and MongoDB logging.
Optional Dependencies
To enable MongoDB logging install the mongo gem. gem install mongo
To enable character set detection and MongoDB logging install the rchardet gem. gem install rchardet cp plugins-disabled/charset.rb my-plugins/
Writing Plugins
Plugins are easy to write. Start by going through the plugin tutorials in the my-plugins/ folder.
Plugin Tutorials (https://github.com/urbanadventurer/WhatWeb/tree/master/my-plugins).After progressing through the tutorials read through the Development section of the wiki (https://github.com/urbanadventurer/WhatWeb/wiki/).
Sources for Plugin Writing (https://github.com/urbanadventurer/WhatWeb/wiki/Sources-for-Plugin-Writing)How to Develop WhatWeb Plugins (not up to date) (https://github.com/urbanadventurer/WhatWeb/wiki/How-to-develop-WhatWeb-plugins)
Updates & Additional Information
The WhatWeb development build features regular updates.
Check the development branches for unreleased updates.Browse the wiki for more documentation and advanced usage techniques.
Wiki: https://github.com/urbanadventurer/WhatWeb/wiki/
Release History
Version 0.5.0 Released June 9th, 2019Version 0.4.9 Released November 23rd, 2017Version 0.4.8-dev (Continuous release from 2012 to 2017)Version 0.4.7 Released April 5th, 2011Version 0.4.6 Released March 25th, 2011Version 0.4.5 Released August 17th, 2010Version 0.4.4 Released June 29th, 2010Version 0.4.3 Released May 24th, 2010Version 0.4.2 Released April 30th, 2010Version 0.4.1 Released April 28th, 2010Version 0.4 Released March 14th, 2010Version 0.3 Released at Kiwicon III (kiwicon.org), November 2nd, 2009
Credits
Developers
Andrew Horton (@urbanadventurer)Brendan Coles (@bcoles)
Contributors
Thank you to the following people who have contributed to WhatWeb.
Emilio CasbasLouis NyffeneggerPatrik Wallström (@pawal)Caleb Anderson (@dirtyfilthy)Tonmoy SaikiaAung Khant (@yehgdotnet)Erik Inge Bolsønk@dsigned.gr (mailto:nk@dsigned.gr)Steve Milner (@ashcrow)Michal AmbrozGremwellSagar Prakash Junnarkar (@sagarjunnarkar)GertBergerQuintin PoirierEric Sesterhenndengjw (@jawa)Pedro Worcel (@droop)Matthieu Keller (@maggick)Peter (2pvdl)Napz (@RootCon)@nilx042Fabian Affolter (@fabaff)Andrew Silvernail (@buff3r)Andre Ricardo (@andrericardo)nikoskPatrick Thomas (@coffeetocode)Guillaume Delcaour (@guikcd)Sean (@wiifm69)Matthieu Keller (@maggick)Raul (@raurodse)Andrew Petro (@apetro)Artem Taranyuk (@610)Matti Paksula (@matti)Tim Smith (@tas50)Sarthak Munshi (@saru95)@rdubourguais@SlivTaMere@Code0x58@iGeek098@andreas-becker@csalazar@golewski@Allactaga@lins05@eliasdorneles@sigitdewanto@elcodigok@SlivTaMere@anozoozianBhavin Senjaliya (@bhavin1223)Janosch Maier (@Phylu)@rmaksimovNaglis Jonaitis (@naglis)Igor Rzegocki (@ajgon)Please let me know if I need to add any more names.