Skip to content

X4BNet Search Engine List

Category: Enrichment / Network

Homepage: https://github.com/X4BNet/lists_searchengine

Vendor: X4BNet

License: See repository

Source: Enrichment

Profiles: Full, Basic

Tags: search, network, blocklist

X4BNet list of known search engine crawler IP addresses.

Tips

Use this list to identify search engine crawlers in network traffic or access logs.

Usage

The repository is cloned to enrichment\git\lists_searchengine and updated via git pull.