Hi everyone! I built Crawly because I needed a good API to directly ask questions about any webpage or even an entire website. But that’s not all—I also wanted high-quality full-page screenshots in the response. Everything is neatly structured through one simple API.
The idea is simple: provide a link, specify what you want, and get a real-time response.
I’m planning to add many new features soon, including different models and deeper crawling to extract more information from websites.
Right now, you can ask about a specific page or an entire website. In the latter case, Crawly will automatically fetch 5–10 of the most important pages and include them in the context.
JustCMS
Hi everyone! I built Crawly because I needed a good API to directly ask questions about any webpage or even an entire website. But that’s not all—I also wanted high-quality full-page screenshots in the response. Everything is neatly structured through one simple API.
The idea is simple: provide a link, specify what you want, and get a real-time response.
I’m planning to add many new features soon, including different models and deeper crawling to extract more information from websites.
Right now, you can ask about a specific page or an entire website. In the latter case, Crawly will automatically fetch 5–10 of the most important pages and include them in the context.
I hope it will be useful for developers!