I have the following scenario:
I have a user that needs to see some news feeds from different sites and I want to paginate them and sort them by date. The problem is I don't understand how to do that schemantically.
Fetch top-N from each site and then limit the results? That could result in inconsistent results if for example:
I ask the first 100 results from each site and then select in total the newest 100 from all sites. The second time I do this if site A had all of its first 100 results newer than the other sites , it is a problem. I will ask from the sites results from 100-200 where site B's results should come from 0-100 because they were not displayed the last time.
How to do this kind of aggreggation without fetching all available (or an obsene amount of results) from each site?