Install CrawlKit Scrapers in Agenvoy
What you need first
- Agenvoy, installed.
- Nothing else: the server runs on its publisher's machines and Agenvoy connects to it.
Steps
- Open
~/.codex/config.toml, or create it. The Codex CLI, its IDE extension and the ChatGPT desktop app share this file. - Add this table at the end of the file.
{
"servers": {
"crawlkit-scrapers": {
"url": "https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp"
}
}
}- Save the file and restart Agenvoy.
Check it worked
Ask Agenvoy: List the tools of crawlkit-scrapers.
If it does not start
- 401 Unauthorized
- The endpoint wants a sign-in or a key. Sign in when Agenvoy asks.
- Nothing changes after a restart
- The file is not valid JSON any more. Look for a missing comma where the block was added.