I am working on a project to save external credit bureau reports in database. These reports are typically big and could go from 0.5MB to 5.0 MB. Number of files will grow exponentially over the time based on incoming traffic. Estimated file size would be 1TB in 3 months. Files will be read immediately and multiple times by other services/applications once its retrieved from external bureau in real time and saved it in data store. These files will be associated with an uniqueId and file / credit report retrieval will be based on that uniqueId. Response time is one of the critical factor as online experience is associated with it.
We are searching couple of options like: 1. SQL blob store with uniqueId 2. NoSQL column or document store with uniqueId 3. Object store with a path mapping in SQL DB against an uniqueId.
Backup / Archive / overall maintenance would play a critical role down the line as our app should be up 24x7 with 99.9999 %.
Need some input and guidance here to finalize a potential database option based on above scenario.