Technology Education Blog

A directory is called a directory of folders and files. We want to find the directories of a site to get the information we want
Work with the CrawlBox tool (scan the directory)

First, enter the command in your terminal to install the tool

git clone https://github.com/abaykan/CrawlBox.git

Go to the downloaded folder
cd crawlbox

Install the tool prefix with the following command

pip install -r requirements.txt

To run the main file using Python, enter the following command

python crawlbox.py

To view the help, you can click the following command

python crawlbox.py

-h
To scan, enter the following command

python crawlbox.py site.com -w list.txt