I plan on using Scrapy to crawl a local website for a LOT of data and store it in a file. Then I plan to parse that file and put some of the data in a SQL database.
Will my computer use less CPU and RAM to read and parse a big CSV file or JSON file?
Or maybe it would make more sense to store the data in a bunch of smaller CSV or JSON files?
Either way, which is less taxing on my machine?