I've got an extremely oniony(deep) folder structure which contains Appx 1,000,000 text-based files on a network share. Using windows search is extremely slow and unreliable. I've created some text files which lists of all the files and have searched that text file to speed up searching, but it's time to mature this and make it a little more automated and accessible to more users.
The index/cache will contain the file path and some additional meta data which I extract from the files upon indexing. Appx 10 fields. This is all searchable.
I'm leaning towards a sql or sqlite database table but not sure what else I should be looking that.
What type of database or data structure is best suited for this purpose? What other topics/keywords can I research regarding this?
For front end, I'll just wrap up a console application or simple winform to search the index.