Quantcast
Channel: Data Science, Analytics and Big Data discussions - Latest topics
Viewing all articles
Browse latest Browse all 4448

Harvesting Big Data (500TB+)

$
0
0

@sindhukem49 wrote:

How can we collect/ mine textual data to the order of 1000TB in Ebglish and other languages from the internet? All the readily available data dumps when extracted barely yield 10TB text data put together. What strategies can be used to collect 1000TB data by crawling the internet?

Posts: 3

Participants: 2

Read full topic


Viewing all articles
Browse latest Browse all 4448

Trending Articles