New answers tagged

2

For only reading 10 MB of data out of a 600 GB file, you don't need a distributed filesystem, you need a way of reading only what you're interested in. Databases with indexes come to mind or even performing binary search on the file if it doesn't change often (requires the rows to be sorted by the search key and rows of equal size so you can quickly jump to ...


Top 50 recent answers are included