panda{·}etl — Automate your document workflows

👋 Hey Product Hunt community! We're excited to share something we've been working on at Sinaptik (YC W24). After creating pandas-ai (chat with your tables), we've had countless conversations with data analysts and business experts about their daily struggles. These chats revealed some common frustrations: 1. Valuable insights buried in messy, hard-to-read files 2. The headache of managing documents with different permission settings 3. RAG chatbots that seemed promising but ended up being costly data dumps 4. And the ever-present challenge of bridging the gap between business experts and developers These weren't just abstract problems - we saw how they affected real people trying to do their jobs efficiently. So, we rolled up our sleeves and got to work. We talked to analysts, data scientists, and business users to understand their needs. The result is panda{·}etl, a tool we hope will make life easier for anyone dealing with document-heavy workflows. With panda{·}etl, you can: 1. Upload those tricky files (you know, the PDFs, images, and audio files that usually cause headaches) 2. Define exactly what data you need (whether it's ESG metrics, competitors data, market trends, risk engineering reports, insurance claims) 3. Get spreadsheets where you can actually trace where each piece of data came from 4. Easily validate and export your data 5. And use our pandas-ai powered chat to explore your extractions, plot charts and add them to drafts We've built panda{·}etl with flexibility in mind, offering solutions ranging from SaaS to On-Premise: 1. For individuals, we offer a free personal plan with limited documents processed and extractions per month. It's perfect for trying out the tool and for smaller projects. 2. For businesses, we have scalable plans that grow with your needs, files size and amount of docs. 3. For enterprises, we provide custom solutions, including on-premise deployments for those with specific security or compliance requirements. We're still learning and improving, and that's why we're here. We'd love to hear your thoughts, experiences, or even your data horror stories. How do you deal with unstructured data in your work? What solutions have you tried? Let's chat - we're genuinely curious to learn from this community! 🙌

Congrats! Do you have an API? My use case: I want to build a QA system for my CSV tables with survey results (some cells may contain numbers, and some contain text), and it needs to work within my product

I've tried a few RAG enabled tools, but none of them seem to be effective. Will try this out - looks very promising. I like how it's open source, free (with a limit) and how you can create workflows to automate file processing. Would be cool to see how others are handling files - if they want to share workflows they built! Congrats on the launch @gdc and team!

I love the design and the idea is solid. How would you distinguish yourself from Deepnote's AI features?

Congrats! The product seems very successful. Are you able to extract information from tables in PDFs?

Read in one of the comments that u offer an API… I run a copier dealership with 100s of copier scanners that produce 1000s of PDFs, pretty sure our clients (banks, insurance cos, BPOs, car dealerships, hospitals, etc) would find it useful. How can we get in touch?

Congrats on the launch, @gabriele_venturi ! I love that there's also an open-source version. It will be useful across a variety of fields in different industries. Wishing your team great success! - I'll definitely give it a try. :)

Congrats to the panda.etl team! This tool sounds like a fantastic way to simplify turning unstructured data into actionable insights. Looking forward to seeing how it helps streamline data extraction!

Congrats on the launch @gdc! I'm really looking forward to trying this. Working with several clients in the past years, I can see how much value they could get from more open access to data! 👏

Panda{·}etl looks useful for turning messy files into structured data. It handles various input types, uses AI for extraction, and provides results in spreadsheets with source links. The added analysis features could save time. However, its real-world performance and pricing would determine its actual value to users.

This is really interesting, I think the summary of the 4 main issue is exactly it with data scientist/analyst. Especially permission setting, it took us a week to just pass out the right credential and permission for different database access. I've checked out your pricing and I was not too sure how much the 500 credits are going to get me through, if it was in terms of number of files, or sizes of files altogether, how much would you say that is ? Again, congratulation Giuseppe !

Congratulations on the launch. What is your accuracy as far as numbers go ?

Congrats on the launch! Turning messy files into actionable data sounds incredibly useful. How does the AI handle different file formats like PDFs and audio for data extraction? 🔍 @gdc

I'm really looking forward to using this amazing tool in my daily work. I'm expecting a huge increase in productivity and performance, especially when lots of messy data is being used! Thanks for the amazing job you are putting on your products!

Congrats on the launch! I still have a hard time extracting information from PDFs recently... But with panda{·}etl, I believe my problems can be solved!!! That's brilliant! Can't wait to try it out! Gook look and I look forward to your future update!

Congrats on the launch! This looks really good! Do you plan to add cloud services too in the future?

Nice product @gabriele_venturi , can you share a bit more about how it works? Does it extract text from the PDF or does it do OCR? If it extract text strings, how do you deal with tables which can turn out all messed up with newlines and weird formatting?

This is amazing guys!

This sounds like a great idea, I hope to see this project come to fruition soon. PDFs are useful but with panda{·}etl they could be powerful. Good luck guys!

This looks really amazing! Looking forward to try it out! Not only will it save me a lot of time and effort, but it will provide even more insights that will help me it will probably find myself!! Great job 👏