I'm building an application which monitors uptime of hosts/ip addresses. I'm using Laravel + VueJS.
So the app should check lots of urls every minute and get & store in db http responses. I've never worked with highload so I'm struggling a bit.
The thing is: I'm able to store my application on a VDS, run queues using redis, do async jobs. For some number of urls it will work.
I have no idea how to scale this. For example, when talking about load balancers, as I get it they are used when users make a lot of requests, while in my case it's cronjob running on linux and running php processes.
What's more important is: how the architecture should be made if I need to check the same URL from different locations (like US, Europe, China etc). Obviously I'll need many servers, however I don't have a clue how to connect them together.
Probable amount of work: marking 100k requests per minute