Install CrawlKit Scrapers in oterm
What you need first
- oterm, installed.
- Nothing else: the server runs on its publisher's machines and oterm connects to it.
Steps
- Open
~/.codex/config.toml, or create it. The Codex CLI, its IDE extension and the ChatGPT desktop app share this file. - Add this table at the end of the file.
{
"mcpServers": {
"crawlkit-scrapers": {
"url": "https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/wayfair-scraper,sweet_stickball/bestbuy-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/grubhub-scraper,sweet_stickball/offerup-scraper,sweet_stickball/vinted-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp,sweet_stickball/airbnb-reviews-scraper,sweet_stickball/amazon-bestsellers-scraper,sweet_stickball/amazon-product-scraper,sweet_stickball/app-store-reviews-scraper,sweet_stickball/ats-jobs-scraper,sweet_stickball/bluesky-scraper,sweet_stickball/booking-reviews-scraper,sweet_stickball/contact-details-scraper,sweet_stickball/eventbrite-scraper,sweet_stickball/glassdoor-scraper,sweet_stickball/google-ads-transparency-scraper,sweet_stickball/google-hotels-scraper,sweet_stickball/google-images-scraper,sweet_stickball/google-maps-scraper,sweet_stickball/google-patents-scraper,sweet_stickball/google-play-apps-scraper,sweet_stickball/google-play-reviews-scraper,sweet_stickball/google-trends-scraper,sweet_stickball/investing-scraper,sweet_stickball/realtor-scraper,sweet_stickball/remote-jobs-scraper,sweet_stickball/resy-scraper,sweet_stickball/sec-edgar-yahoo-finance,sweet_stickball/seek-job-scraper,sweet_stickball/spotify-scraper,sweet_stickball/substack-scraper,sweet_stickball/tech-stack-scanner,sweet_stickball/ted-tenders-scraper,sweet_stickball/thefork-scraper,sweet_stickball/thumbtack-scraper,sweet_stickball/ticketmaster-scraper,sweet_stickball/trustpilot-reviews,sweet_stickball/walmart-scraper,sweet_stickball/youtube-channel-scraper,sweet_stickball/youtube-comments-scraper,sweet_stickball/youtube-search-scraper,sweet_stickball/youtube-shorts-scraper,sweet_stickball/youtube-transcripts"
}
}
}- Save the file and restart oterm.
Check it worked
Ask oterm: List the tools of crawlkit-scrapers.
If it does not start
- 401 Unauthorized
- The endpoint wants a sign-in or a key. Sign in when oterm asks.
- Nothing changes after a restart
- The file is not valid JSON any more. Look for a missing comma where the block was added.