Product Hunt logo dark
  • Launches
    Coming soon
    Upcoming launches to watch
    Launch archive
    Most-loved launches by the community
    Launch Guide
    Checklists and pro tips for launching
  • Products
  • News
    Newsletter
    The best of Product Hunt, every day
    Stories
    Tech news, interviews, and tips from makers
    Changelog
    New Product Hunt features and releases
  • Forums
    Forums
    Ask questions, find support, and connect
    Streaks
    The most active community members
    Events
    Meet others online and in-person
  • Advertise
Subscribe
Sign in
Subscribe
Sign in
ForumsForum General categoryp/generalForum AMA categoryp/amaForum Introduce yourself categoryp/introduce-yourselfForum Self-Promotion categoryp/self-promotion
Product Forumsp/lovableProduct Huntp/producthuntKraftfulp/kraftfulWispr Flowp/wisprflowp/posthogScreaming Frog SEO Spiderp/screaming-frog-seo-spiderXnapper p/xnapperp/bucketGoogle Chromep/google-chromeFinep/fineOpenAIp/openai-apibolt.newp/bolt-newElevenLabsp/elevenlabsNotionp/notionAttiop/attio
ScraperAI
p/scraperaiExtract Structured data from any website
Start new thread
Xavier Geerinck

Scraper AI - Automate website data extraction in a few clicks

by
Xavier Geerinck
ScraperAI

ScraperAI

•

4yr ago

Scraper.AI is a data extraction tool that allows you to scrape and extract data from any website. Automate your data gathering process now through features such as data exporting, scheduled monitoring, API endpoints, webhooks and change detection.

Add a comment

Replies

Best
Xavier Geerinck
Xavier Geerinck
ScraperAI

ScraperAI

Maker
Hi ProductHunt Community! After being stuck ourselves to gather insights from websites in a structured way, we decided that it was time to take control of data yourself. By releasing our first tool called Scraper.AI, you can now open any website, click the relevant data points you would like to extract and get the extracted and structured data delivered to you in just a couple of minutes between sign-up to receiving your first data points. Our core feature set includes: ⏳ Scheduling: Schedule your data points to be updated in an interval that you choose (hourly, daily, weekly, monthly) 🔄 Change monitoring: Detect changes to data, allowing you to monitor pricing updates, articles, ... and create your own subscribe functionality 📩 Export: export your gathered data in a format you like (.json, .csv, .xlsx) 💻 App integration through an API Endpoint and Webhooks Let us know what you think! We're here to answer any questions you might have. Kind Regards, Xavier
Report
Share
4yr ago
Pietz Prove
Pietz Prove
This seems to focus on pages that change on a regular basis. What if I want to scrape all 573 result pages of a custom site a single time?
Report
Share
4yr ago
Xavier Geerinck
Xavier Geerinck
ScraperAI

ScraperAI

Maker
@gopietz Hi Pietz! Great question! We do support pagination allowing you to select the "Next Page" button which will then scrape all the 573 result pages
Report
Share
4yr ago
Stephen Campbell
Stephen Campbell
Interested. Any PH discount? 🤔
Report
Share
4yr ago
Xavier Geerinck
Xavier Geerinck
ScraperAI

ScraperAI

Maker
@stephenalan Hi Stephen! Please contact us once you subscribed and we can offer 10% off for the first 5 PH subscribers :)
Report
Share
4yr ago
Pepa P
Pepa P
Congrats on the launch. Can this be used to scrap Google maps and extract all the businesses information in a specific area?
Report
Share
4yr ago
Edmund Cinco
Edmund Cinco
@waikiki maybe but why not use places api? want to see a ready made gmaps scraper? 😎
Report
Share
4yr ago
Maxim
Maxim
ScraperAI

ScraperAI

Maker
@waikiki It could be used to extract business information. But it doesn't crawl right now. I would also suggest to use places API for this
Report
Share
4yr ago
David kart
David kart
Kudos for the launch!!
Report
Share
4yr ago
Maxim
Maxim
ScraperAI

ScraperAI

Maker
@david_kart1 Thanks!
Report
Share
4yr ago
Xavier Geerinck
Xavier Geerinck
ScraperAI

ScraperAI

Maker
Hi All, Thanks a lot for upvoting our product! To thank you all we are also giving away a 25% off coupon for everyone that registers through ProductHunt: https://scraper.ai/dashboard/pro... go check it out and let us know through comments or Twitter (@scraper_ai) on what you think!
Report
Share
4yr ago
Pawel Blazejewski
Pawel Blazejewski
Stocksignal

Stocksignal

Hey @xavier_geerinck i get this error all the time: failed: timeout 10000ms exceeded ??
Report
Share
4yr ago
Xavier Geerinck
Xavier Geerinck
ScraperAI

ScraperAI

Maker
@pawel_blazejewski Hi Pawel, to prevent abuse we have limits in place of the resources customers can utilize. Currently we have a 10s timeout for initial DOM load + 10s timeout for subsequent SPA requests (for dynamic pages). After this we have a 500ms timeout for each selector that you have. We could help you with these limits, for that please feel free to reach out to me at xavier@scraper.ai!
Report
Share
4yr ago
Anna Filou
Anna Filou
Does it work on websites that require login/authentication? (provided the user has the password, of course)
Report
Share
4yr ago