Subscribe
Sign in
General
p/generalShare and discuss tech, products, business, startups, or product recommendations
Start new thread
Sagar Patel

How hard is it to find a dataset to train an AI model?

by
I am curious about the experience of all other Founders who built their own AI. How hard was finding a dataset for your specific use case? Did you build it from scratch or did you buy it/out sourced it??

1 view

Add a comment

Replies

Best
Jake Harrison
You can check the kaggle
Sagar Patel
@jakeharr True, there is also hugging face which is a really good resource to find datasets. You should still inspect the dataset and make sure it is giving you accurate information!
AmazingSylvia
Actually I thought this question yesterday, I think if you want your product standout you must give a huge database to it, then make it understand and processing. However, it is hard because only big companies can get large data base, and you are just a owner of a small startup. I mean, cooperation is based on the premise that there are benefits for both parties. And clearly in this stage you can offer basically nothing.
Sagar Patel
@sylvia_sheng true! The landscape favors those with big datasets, and already captured market share! I think startups with Ex-Meta or Ex-Big-Name company have an edge. They can get funding to close the gap. The way I am closing the gap is by leveraging my network, and connections!
AmazingSylvia
@sagarpatel10 Yesss, I also think in this way. But some times connections not means everything. Big database is also a digital asset, so I think startups must think altruistically and imagine what they can bring to the table.
David Rawlinson
What type of AI model is it? Usually if you know the domain closely enough to understand the problem, you'll have access to at least one dataset either through knowledge of public domain problems or private data. If you don't understand the problem domain, you're unlikely to be ready to produce an AI model for it.
Sagar Patel
@david_rawlinson I agree! Domain expertise is important to be able to build a functional model! As for me, I am using datasets from hugging face, and Kaggle. This got me wondering though, where do other people find datasets if not on one of these two.
David Rawlinson
@sagarpatel10 I don't know where to start to be honest. There are so many places. What type of dataset/ problem are you looking for?
Sagar Patel
@david_rawlinson assistant type dataset. You know like an AI assistant. There are quite a few on hugging face so I’m good. I was just wondering what other developers use, and if there are any higher quality datasets out there that they would recommend!