MELVIN GEORGE

🚀 New Features in PulpMiner: Dynamic URL Variables & Scraper Selection!

Hey everyone! 👋

We’re excited to announce two powerful new features in PulpMiner that make API creation from webpages even more flexible and accurate.

Check them out below 👇


🧩 1. Dynamic URL Variables


Now you can create dynamic APIs from a single webpage URL by converting static URL parts into variables.

🔧 How it works:

  1. Choose any segment in your URL (like a product ID or slug).

  2. Replace it with a dynamic variable (e.g., {{ PRODUCT_ID }}).

  3. Get an API endpoint that accepts dynamic inputs in real-time.

➡️ Example:

https://www.amazon.com/dp/B0CMDL3H3P

https://www.amazon.com/dp/{{ PRODUCT_ID }}

Perfect for scraping pages with the same structure but different data. 💯

🛠️ 2. Dual Scraper Selection


You can now choose from 2 powerful scrapers when generating JSON from webpages. Each scraper is optimized for different page structures and content types.

Bonus: There's also a toggle to enable JavaScript rendering for pages that require it.

🎯 Use the best scraper for each use case and get more accurate structured data with zero code.

🧪 Why This Matters

These updates give you:

  • More control over how URLs are used as API inputs.

  • More reliability in data extraction from different webpage formats.

  • Faster workflows with less manual intervention.



🔗 Ready to try them out?

Head to your dashboard and play around with the new options!

Got feedback? Drop it below 👇 or DM us — we’d love to hear what you build with this!

— Team PulpMiner 🧃🛠️

126 views

Add a comment

Replies

Best
Launching soon!

The dynamic URL feature looks super helpful. I have been hacking together scripts to monitor blogs and this might finally simplify things. Any plans to add scheduled fetches?

MELVIN GEORGE

@hamza_afzal_butt Thank you, Hamza. Yes fetching latest content and storing in cache on a scheduled basis so that data will be updated. This feature is in roadmap. 😃

Cristian Stoian Urzica
That's a cool feature! Good job! 😁
MELVIN GEORGE

@cristian_stoian_urzica Thank you, Cristian.

Athar Jatoi

URL flexibility has always been a problem for me because I develop solutions that depend on extracting data from many e-commerce websites. That is exactly what this update fixes. fantastic release.

Emiliano Dominguez

🔥 This is slick! Love how dynamic URL vars + dual scrapers = supercharged flexibility. Makes scraping feel way less messy. Can already see cool indie use cases for dashboards + auto-updating lists. Nice one, Melvin! 👏

Talbot Wilhite

The dynamic URL variable functionality is really efficient, based on my recent testing. makes creating APIs for websites with standardized design really easy. I adore how quickly you can now transition between use cases.

Matt Carroll

looks cool! tbh i don't understand this testimonal on your pricing page

MELVIN GEORGE

@catt_marroll Yes we use Cloudflare workers infrastructure to host the apis and the data is served from the edge functions. I hope this clears any confusion.