We’re building a platform of different APIs (every API is written by different team, different timezone). We want to implement unified analytics for all of the APIs to have one data lake as a single source of truth. We are using Apigee as our API proxy for all of the APIs. Now the question is: where would you implement the analytics layer?
Our first thought was to implement it in Apigee and log events for every API call - but we encounter problems with providing full request, response payloads since we’re using streaming configurations for performance reasons what prevents Apigee from having access to the payload.
The other approach we considered was to obligate all services to send their own events - but is it really possible? Every team has their own schedule and it seems that analytics would always get lower priority, and how can we really make sure that every API call is being logged as expected?
How do your companies deal with analytics? Where would you implement such a layer? Would be grateful to hear your ideas.