Install Website Crawler — Markdown Pages, Sitemaps & RAG Provenance in Codex
What you need first
- Codex, installed.
- Nothing else: the server runs on its publisher's machines and Codex connects to it.
Steps
- Run this in a terminal. It writes the server into
~/.codex/config.toml, which the Codex CLI, its IDE extension and the ChatGPT desktop app share.
codex mcp add website-to-markdown --url 'https://mcp.apify.com/?tools=hermeskd/website-to-markdown' - Start Codex again and type
/mcp: the server is listed.
Check it worked
Ask Codex: List the tools of website-to-markdown.
If it does not start
- 401 Unauthorized
- The endpoint wants a sign-in or a key. Sign in when Codex asks.
Back to Website Crawler — Markdown Pages, Sitemaps & RAG Provenance