I have to develop a logging system for my project which has multiple features. I am stuck at a choice. I could either make a centralized database and front end for everything. Or I could have one log table for each feature and a common front-end none the less.
Centralized seems like the way to go but it has its disadvantages.
Some features create more log entries while others don't. So the ultimate table can have a million log entries for feature x and 23 for feature y. So every feature pays cost of access time for greedy use of one feature.
Also one table can grow pretty big.
And I will have to standardize one single log format and I cannot mold it for individual feature while still making use of DBMS's capabilities like sort, join, group etc. I'll have to store all the feature details in a json data field.
Downsides of a distributed system include
I'll have to maintain multiple tables.
There will be no standardized schema so building a common front-end will be that much troublesome.
Does anyone have any experience with this sort of thing?