Skip to main content

Questions tagged [monitoring]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
2 answers

CDN monitoring for cost distribution [closed]

I'm aggregating a lot of data from different vendors and have to provide an unified data set to a set of clients. The clients will be identified with a specific identifier upon fetching the data from ...
Banana's user avatar
  • 141
-2 votes
2 answers

Monitor newly released code without real traffic

As new code is released to production, without enough direct access to production execution environments I rely only on user traffic for monitoring. However not all use cases get covered via user ...
sam kirubaharan's user avatar
0 votes
1 answer

AWS and cron job: improve logging, monitoring and concurrence

In my company, we use a separate cron server to run mission-critical background jobs that run on a single ec2 instance: the whole platform is then vulnerable to anything going wrong on this instance. ...
friday-json's user avatar
1 vote
0 answers

Centralized management of many single-tenant instances

Designing a SaaS application that will be used by multiple business customers (tenants). Decided to use the single tenant model - a single instance of the application and database is deployed for each ...
Alex's user avatar
  • 11
3 votes
1 answer

Defining SLI / SLO for ETL and Reporting Application

All, We're just started on SRE journey and trying to define SLI / SLO for our application. It is an ETL application where 1. feeds (e.g. start of day, end of day data feeds) comes from various ...
Ravi Parekh's user avatar
-2 votes
1 answer

What approaches are standard for 'healthcheck' monitoring of frontends?

A problem I'm currently solving is that at a glance I want to see the status of various services, including both frontends and backends, across dev, test and prod environments. That is, I want to see: ...
dwjohnston's user avatar
  • 2,563
2 votes
2 answers

Design a function that indicates significant deviations in response times

I'd need some feedback on how to approach the design of a function that highlights parts of a time series chart. The chart shows the response time of an application, in particular the 90th percentile, ...
BMBM's user avatar
  • 337
-1 votes
1 answer

How to objectively monitor REST APIs performance based on the request/response size

We recently integrated a monitoring solution (Data Dog) for our REST-APIs based microservices. The monitoring solution gives us many useful metrics. For example, we can see the average response time ...
Hawk's user avatar
  • 487
0 votes
1 answer

How to add APM/observability/tracing in a monolithic architecture?

I keep reading articles analyzing Monitoring and Observability, or having lots and lots of text regarding how the latter is the extension of the first, or how they are complementary, or how tracing is ...
Astyanax's user avatar
  • 324
-4 votes
1 answer

A request's round trip time monitoring at microservice production best tools and practices?

I've a microservice's system at production which provide an API to the outer world. Along with each service monitoring via monitoring tool ( Prometheus, zabbix, etc.) of course it's highly desirable ...
cpu's user avatar
  • 1
-1 votes
1 answer

Show a service's status to the user

Some design thoughts on an application that is mostly event driven using kubernetes and docker. The application is a web based application, a single page one. It shows updates from the back-end such ...
ring bearer's user avatar
2 votes
0 answers

What is the most efficient way to find filesystem changes in percentage?

I am planning to write a program that will produce digest logs for file changes in a particular directory. The idea is that whenever a file is deleted in a particular directory, it will show up in the ...
Michael John's user avatar
1 vote
3 answers

Monitoring write-intensive web service through submitting synthesized data?

We have a web service that accepts images and metadata uploaded by end users, and the uploaded images would go through multiple steps of processing / reviewing with human involved. To monitor the ...
liuyu's user avatar
  • 113
0 votes
0 answers

Do logs enhance availability of service for a well monitored application?

I used to work for teams that built software as a service applications. Our requirements, regarding production, were often the same : A complex service (web application, database, daemons, typically) ...
Diane M's user avatar
  • 2,076
1 vote
0 answers

How should propagation of service abuse information work within a microservice architecture?

At the moment, I'm working on a product that's being broken down from a monolith to a bunch of microservices, and it seems to be going well enough. However, if a user is abusing the service somehow, ...
Parthian Shot's user avatar
-2 votes
1 answer

Monitoring my REST API service

I have a REST API. I want to monitor it -- that it's always up. That's the canonical way to ping it? Especially when all of its calls require an API key. Should I create an empty open end point ...
nylypej's user avatar
  • 111
0 votes
1 answer

What would be the architecture for a polling-based monitoring service?

I have a list of 75000 websites that need to be monitored for uptime. Monitoring the websites involves making a HTTP request for the website every minute, and the website is said to be "up" or "down" ...
user avatar
3 votes
3 answers

Designing database job monitoring

I have several Oracle database where my in-house applications are running. Those applications use both dba_jobs and dba_scheduler_jobs. I want to write monitoring function: check_my_jobs which will ...
mariami's user avatar
  • 209
0 votes
1 answer

Standard Patterns to measure capacity in a competing consumers system

We have a number of systems that are based on the competing consumers pattern. We currently monitor the delay between an item of work being queued and processing finishing, however, as throughput ...
Justin's user avatar
  • 1,738
7 votes
3 answers

Difference between watchdog timer and heartbeat signals?

As the title says what is the difference between watchdog timer and heartbeat signal ? When to use each of them.
Sahib Yar's user avatar
  • 189
0 votes
2 answers

Techniques for observing runtime state in C

What are the techniques for C programs which allow easily inspecting the state of the embedded device, through a communication link? For example, for a microcontroller device which communicates with ...
Lou's user avatar
  • 265
1 vote
2 answers

Designing a scalable website monitoring infrastructure

I'm designing a infrastructure to monitor websites and applications. The idea is to build an application which checks the user website/application with a certain interval (30 sec, 1 min, 5 min, etc.). ...
Jamie's user avatar
  • 149
5 votes
2 answers

Tracking state changes based on duration of time in state

I've been building a monitoring system that checks whether a device is alarmed or not, and if so, sends notifications to relevant users based on how long a device is in a particular state. Here's an ...
Copernicus's user avatar
2 votes
2 answers

Java EE exceptions for validation and APMs

In my current work, we have some Java EE applications and we use exceptions and exception mappers to deal with user errors, i.e. that can't be dealt with in the frontend. We usually reply with a 400, ...
caarlos0's user avatar
  • 259
2 votes
0 answers

Technique to passively take down a host on the network [closed]

I am developing a program which is to be installed on a "simple" machine in a LAN, the only particularity is that the NIC are connected on mirror ports. The software can scan and monitor the network. ...
user185133's user avatar
0 votes
1 answer

How to do an "Automatic DB monitor" and notify the client

Until now I didn't find anything good about monitoring a DB's specific table (or related tables) specific values changed. I want to know: Since most of DB's don't support monitoring changes for ...
xqMogvKW's user avatar
  • 543
3 votes
1 answer

How to design error monitoring for batch jobs with multiple and diverse steps?

I'm working on a software to integrate an e-commerce store and the company ERP. All the integration steps are run as a unique batch job, every 5 minutes. Things are working under production, but I'm ...
user149702's user avatar
1 vote
1 answer

windows users vs. custom [closed]

My application needs to support a "shift change" scenario. Essentially, a person is managing some assets. At the shift change, the person that was there leaves right as the replacement signs in. The ...
Brannon's user avatar
  • 371
11 votes
3 answers

How to monitor a long-running program programmatically

What I've currently got can be summed up with this pseudo code: public static void Main(string[] args) { var listOfObjects = Database.GetObjectsToUploadToOnlineService(); Parallel.ForEach(...
Robert Snyder's user avatar
5 votes
4 answers

Write progress from a long running process

We have some long running processes which could run for as long as an hour up to 6 hours. Some of the processes are started by hand and the user wants to see what the progress of the process is. ...
Michel's user avatar
  • 981
1 vote
2 answers

How to comfortably monitor 5 daemons while developing them?

This is the scenario: I'm on this project for which I wrote 4 Node.js scripts that act as "servers" for some service (they have to be separated). I also use Redis, that is another service to keep an ...
Claudio's user avatar
  • 221