The crawl-to-index funnel.
Follows the pages from what was generated, through the sitemap, to what each search engine has actually indexed — and reports where they were lost. Given a Bing Webmaster Tools AI Performance export, it adds the step after the index: which pages Microsoft Copilot actually cites, which of them you have closed from search, and which you left out of the sitemap.
usage: indexgap doctor [-h] [--site SITE] [--home HOME] [--config CONFIG]
[--profile PROFILE] [--sitemap SITEMAP] [--live]
[--indexed [engine=]file.csv] [--gsc GSC] [--out OUT]
[--lang {en,ru}]
[root]
positional arguments:
root directory of pages; taken from indexgap.json by
default
options:
-h, --help show this help message and exit
--site SITE the full site address; taken from indexgap.json by
default
--home HOME URL of the home page; defaults to --site itself
--config CONFIG path to indexgap.json; looked for next to the pages by
default
--profile PROFILE content type: catalog, events, ugc, product. Changes
thresholds and which checks run — see `indexgap
profiles`
--sitemap SITEMAP path or URL of sitemap.xml
--live check live the addresses the engine knows but the site
does not contain: is there a redirect, is the host
closed. Uses the network
--indexed [engine=]file.csv
an indexation export or Copilot citations from Bing AI
Performance; repeat it for different sources
--gsc GSC the same as --indexed google=... (kept for
compatibility)
--out OUT where to write the HTML report; the machine-readable
data goes next to it with a .json extension. A name
ending in .json names the data, and the report goes
next to it as .html
--lang {en,ru} output language: en or ru. By default from
INDEXGAP_LANG or the system locale, otherwise English