Prompt
How do I know which internal docs are not being found in search?
Latest observation
To figure out which internal docs are not being found in search, you usually want to compare:
- What exists in your source of truth
- What your search index can actually return
Here’s a practical way to do it.
1) Build a list of all internal docs
Get a complete inventory from wherever docs live, for example:
- SharePoint / Confluence / Google Drive / Notion
- A CMS or document repository
- A file system or database
Include metadata like:
- doc ID / URL
- title
- last updated date
- owner
- folder / space / collection
- permissions
2) Get the search index coverage
Export the documents currently indexed by your search system, including:
- indexed doc ID / URL
- title
- crawl/index timestamp
- status if available
- access/permission info
3) Compare the two lists
The docs that exist in your source but are missing from the search index are the ones not being found at all.
Common reasons:
- not crawled yet
- excluded by robots/noindex rules
- permission issues
- unsupported file type
- ingestion failure
- outdated or broken links
- indexing pipeline lag
4) Test from a user perspective
Even if a doc is indexed, it may still be “not found” because search relevance is poor. Check:
- does the doc appear for its exact title?
- does it appear for unique keywords inside it?
- does it appear for synonyms people actually use?
- is it buried beyond the first page?
Track:
- query
- result rank
- clicks
- zero-result queries
5) Use search logs and analytics
Look for:
- zero-result queries
- queries that should match existing docs but don’t
- docs with high views from direct links but no search impressions
- queries that return the wrong doc instead
This helps separate:
- not indexed
- indexed but not retrievable
- retrievable but poorly ranked
6) Automate a gap report
A useful report often includes:
- missing from index
- indexed but stale
- indexed but low visibility
- restricted by permissions
- failed ingestion
Example output columns:
- Document Title
- Source URL
- In Index? (Y/N)
- Last Indexed
- Searchable? (Y/N)
- Permission Issue?
- Notes
7) If you use an internal search platform
Most enterprise search tools provide ways to audit coverage:
- crawl/index status dashboards
- ingestion error logs
- content source reports
- query analytics
- “zero results” reports
- document-level visibility reports
If you tell me what system you use for docs and search, I can suggest the exact steps or queries to identify missing docs.