🚀 New Features in PulpMiner: Dynamic URL Variables & Scraper Selection!
Hey everyone! 👋
We’re excited to announce two powerful new features in PulpMiner that make API creation from webpages even more flexible and accurate.
Check them out below 👇
🧩 1. Dynamic URL Variables

Now you can create dynamic APIs from a single webpage URL by converting static URL parts into variables.
🔧 How it works:
Choose any segment in your URL (like a product ID or slug).
Replace it with a dynamic variable (e.g., {{ PRODUCT_ID }}).
Get an API endpoint that accepts dynamic inputs in real-time.
➡️ Example:
https://www.amazon.com/dp/B0CMDL3H3P →
https://www.amazon.com/dp/{{ PRODUCT_ID }}
Perfect for scraping pages with the same structure but different data. 💯
🛠️ 2. Dual Scraper Selection

You can now choose from 2 powerful scrapers when generating JSON from webpages. Each scraper is optimized for different page structures and content types.
Bonus: There's also a toggle to enable JavaScript rendering for pages that require it.
🎯 Use the best scraper for each use case and get more accurate structured data with zero code.
🧪 Why This Matters
These updates give you:
More control over how URLs are used as API inputs.
More reliability in data extraction from different webpage formats.
Faster workflows with less manual intervention.
🔗 Ready to try them out?
Head to your dashboard and play around with the new options!
Got feedback? Drop it below 👇 or DM us — we’d love to hear what you build with this!
— Team PulpMiner 🧃🛠️
Replies
The dynamic URL feature looks super helpful. I have been hacking together scripts to monitor blogs and this might finally simplify things. Any plans to add scheduled fetches?
PulpMiner
@hamza_afzal_butt Thank you, Hamza. Yes fetching latest content and storing in cache on a scheduled basis so that data will be updated. This feature is in roadmap. 😃
PulpMiner
@cristian_stoian_urzica Thank you, Cristian.
URL flexibility has always been a problem for me because I develop solutions that depend on extracting data from many e-commerce websites. That is exactly what this update fixes. fantastic release.
🔥 This is slick! Love how dynamic URL vars + dual scrapers = supercharged flexibility. Makes scraping feel way less messy. Can already see cool indie use cases for dashboards + auto-updating lists. Nice one, Melvin! 👏
The dynamic URL variable functionality is really efficient, based on my recent testing. makes creating APIs for websites with standardized design really easy. I adore how quickly you can now transition between use cases.
Purposeful Poop
looks cool! tbh i don't understand this testimonal on your pricing page
PulpMiner
@catt_marroll Yes we use Cloudflare workers infrastructure to host the apis and the data is served from the edge functions. I hope this clears any confusion.