I am writing a program to crawl the web and find frequently used words. What would be a good way to store the data? I was thinning of using an RDBMS with a single table (with columns 'word' and 'count') but for something so simple it seems like overkill.
I need to achieve some functionality like sort by count/find n letter words etc.
Is there a better way to do it? Or is using RDBMS the way to go?