Questions tagged [logging]
Computer data logging is the process of recording events in a computer program, usually with a certain scope, in order to provide an audit trail that can be used to understand the activity of the system and to diagnose problems.
260
questions
-3
votes
2
answers
75
views
Optimal variable-time logging of a real-time data stream
Cross-posted from stats stackexchange
Say I have a logging utility in my application that I use for recording timestamped diagnostic log messages. I want to add tracking of some performance metrics to ...
- 97
1
vote
1
answer
96
views
Should a LoggingHandler log?
I wrote a custom log handler that has a config file and uses a service on the network. Now I'm wondering if it should itself log.
Pro:
Everyone should log, it helps track errors, especially when you'...
- 159
2
votes
2
answers
892
views
What log level should be used for an expected but (potentially) bad occurrence?
In my team we are currently building an API gateway, where the client can authenticate themselves with an API key. Naturally the authentication may also fail, which produces a message in the log.
...
- 45
2
votes
3
answers
904
views
log levels and stdout vs stderr
I'm writing an app which uses a logger with different logging levels (info, debug, warning, error, etc.); but - I'm used to the custom of writing program output to stdout and error information to ...
- 2,489
0
votes
0
answers
47
views
Dispatching an event in the decorator or use some other design pattern entirely?
Disclaimer: before explaining the problem here I am aware that the answer to the question might be a subject of an opinion. The reason I am asking this question is because I still believe that there ...
- 459
0
votes
2
answers
102
views
TL suggests that testing, refactor, and tool usage could avoid the need for verbose logging
Additional Context
I make infrastructure for automated device testing. Debugging can be very time consuming because the devices have many states and are constantly being updated with new builds which ...
- 1,655
0
votes
2
answers
156
views
How to refactor code so that a facade class could be decoratable?
I've got a class that is a facade class (encapsulates complex-ish behaviour for reusability). It has a function called manage (the class is called Manager):
function manage()
{
$entityBuilder = '...
- 459
6
votes
4
answers
4k
views
How to get an ILogger instance from extension methods?
Let's say I have this service abstraction exposed from a library.
public interface INavigator
{
ImmutableList<IPageViewModel> Entries { get; }
void NavigateForward(IPageViewModel page);
...
- 234
7
votes
4
answers
853
views
How to provide logging to consumers of a NuGet package/library
I've been building a library (NuGet package as I'm in the C# world here) & I want to add logging so the consumer of the library can optionally provide some logger to the library. However, there ...
- 171
2
votes
2
answers
339
views
How to split logging into streams?
I am looking for an advice (or an example) on how to organize logging streams in my cloud app (C#).
In my app there are logging events related to the application infrastructure level and I want to ...
- 356
32
votes
10
answers
5k
views
Does logging inside a class violate the SRP?
I wrote a class that takes a Logger class as one of its arguments:
class QueryHandler:
def __init__(self, query: Query, logger: Logger) -> None:
self.query = query
self.logger =...
- 1,047
-2
votes
1
answer
87
views
Does it make sense to have a return type for a method doing batch operations [closed]
My application syncs data between 2 different services. Data flow looks something like this:
Target <-- My Service <-- Source
I have a method that starts this batch operation:
// we have ...
- 143
0
votes
1
answer
107
views
Aggregating logs from embedded devices
I'm trying to aggregate logs from multiple embedded devices in centralized place to be able to analyze them.
This is how system looks like:
I have number of embedded devices.
Some deployments are on-...
- 119
2
votes
1
answer
126
views
Choosing test method of bash command output with bats
Context
While writing a bash script I would like to test every command I write. To do so I create a separate function per command that executes the function. In addition I want to log the output of ...
- 215
1
vote
1
answer
354
views
What are the best practices to design a "verbose" mode in command line scripts?
To improve my command lines scripts, I want to add some optional console output, mainly for logging purposes. In my PowerShell modules, I use Write-Verbose for this (but it should be clear this isn't ...
- 141
1
vote
1
answer
177
views
What are the best way to publish application event in a spring boot application?
My goal is to collect/publish different types of information from the application. We use Kafka for the event bus. Consider the following sample code.
class UserService {
public User ...
- 295
3
votes
0
answers
202
views
Relational or non-relational database for storing and querying log data?
I'm planning to extend an application with logging of user events. (Client application via REST-API to Symfony). What is the preferred type of databases?
Currently the log data is stored in a ...
- 47
0
votes
2
answers
500
views
How do you effectively track the history of changes to a text field in the database on a content editing platform?
Say I have a website/platform that allows people to submit business names in order to build a high quality business name database. You can apply this to any subject or topic, such as building a ...
- 2,467
0
votes
1
answer
306
views
Do I have to use Filebeat to parse logs with logstash?
I was under the impression that Filebeat is only necessary if I wish to provide a constant, paced, fresh input to logstash.
But the tutorial here starts with configuring Filebeat to send log lines to ...
- 119
1
vote
2
answers
98
views
How can I cleanly set up debug logging in my javascript frontend?
I basically want to be able to "turn on debug logging" like you can do with many applications that run in a shell. The naive way of implementing it would be to insert a statement like this ...
- 1,094
0
votes
1
answer
127
views
Storing a series of diffs that create a JSON
tl;dr is there an existing, standardized way to store sequences of diffs to a JSON or JSON-type object?
Question:
So currently I have something a class that looks something like this (pseudocode):
...
- 342
1
vote
2
answers
474
views
add function to input of builtin python logger
For simplicity, assume my application logs only dictionaries. I want to add a step to Python logging for my application to prevent logging any dictionary with the key password, i.e.,
def clean_log(...
- 111
0
votes
1
answer
460
views
What is "scoped logging" defined as?
I hear this term from time to time but haven't found any well defined precise technical definitions posted online. They all seem to use the notion as if the term scoped has been defined elsewhere.
I ...
- 359
2
votes
1
answer
747
views
What makes a before/after vs. only before approach to logging more effective?
I'm currently developing a server where I find myself asking whether something such as:
logger.info("Starting <action_1>.")
action_1()
logger.info("Ending <action_1>.")
...
- 384
8
votes
6
answers
2k
views
How to insert logging information without making the code a mess
When working with some complex algorithms, I would like to have a way to keep track of some information for easy debugging. I just need to see sometimes how things are going, and have some easy way to ...
- 2,551
0
votes
0
answers
35
views
Migrating an application using a custom API logging system
I'm turning a VB6 application into a VB.NET (using a migration tool). This software relies on a custom DLL which handles logging. This DLL logs to flat files and optionnaly in a GUI component.
Also ...
- 137
4
votes
3
answers
266
views
How to return "debugging" information during the execution of an algorithm
I was recently tasked with thinking about returning optional tracing information about the execution of a complex algorithm. It's the kind of data you need to analyse the inner workings - a bit like ...
- 157
-4
votes
1
answer
86
views
Message Strings in Backend
Its ok to have hardcoded strings on backend? Example:
Log.e("Error connecting to the database")
The text "Error connecting to the database" should be hardcoded there? Or should it be in a separated ...
-3
votes
2
answers
1k
views
Are there any standards on log severity levels? [closed]
I'm seeking a way to generalize the way log levels are managed in my services. I have multiple services, written in multiple languages, and using multiple libraries to manage logs.
Almost all of them ...
- 103
3
votes
0
answers
159
views
Logging by 3rd party libraries
We've got 2 very large platforms for our services & jobs.
Both platforms consists of 20+ servers hosting 1000+ services/jobs.
Each job/service is essentially a java web application.
Both ...
- 61
1
vote
1
answer
63
views
Test logging library
I've been designing and developing a very scalable logging library for a while.
The main goal of this library is pretty simple. Like many others projects, a simple goal does not mean a simple way the ...
- 121
3
votes
5
answers
537
views
Are there better alternatives to debug level logs to investigate a bug in a production environment?
Some of our customers from time to time report an unexpected behavior in one feature of our software and we suspect that we have a bug.
The feature itself and the kind of bug is not interesting for ...
- 653
2
votes
2
answers
250
views
Logging: safety vs performance. How do I choose?
While making an application I've come to the point where I want to add logging for the inevitable case when something goes wrong. Now this seems like a problem that should have been solved decades ago,...
- 5,270
0
votes
2
answers
214
views
Architectural solution for business logging
I have a the requirement for a webservice which should return a "business log" of the action the service performed. Usually I only return error logs which are based on exceptions. the exceptions get ...
- 11
4
votes
3
answers
483
views
Should An SDK Have Logging in the API
I am working on building a API and SDK for a web service. My question is what is the correct practice for logging. Should the SDK do logging for the API methods? All the SDKs I have seen do not do ...
- 171
3
votes
4
answers
516
views
What log level use for deprecated features?
There is a feature that is now deprecated and going to be removed. Adding a logging statement, observed by some alerting mechanism, can help finding out whether the feature is still being actively ...
- 139
1
vote
0
answers
76
views
Why does the PHP community always rely on file-based logging instead of a combination with in-memory logging?
This is an initial thought I'm having on logging. Clearly, am missing something about the whole picture because I don't think someone didn't think of this before.
PHP runs on one request. That means ...
- 85
0
votes
0
answers
483
views
log centralization and central aggregation system design
I'm thinking of how would I go about creating my own logging centralization and centralized aggregation system.
Imagined system has 10 - 100 nodes. Each node runs a LAMP(Linux, Apache, MySql, PHP) ...
- 109
2
votes
0
answers
138
views
Database vs Logs - Persistence approach evaluation
I have a node js app, in which I need to perform background jobs. My plan is to use a data structure which will contain all the jobs needs done. My design also suggests that this data structure needs ...
- 991
1
vote
0
answers
231
views
Log data anonymization with ELK
I'm considering using the ELK stack for logging within our company. To comply with our data retention policy, we would like to anonymize data after one year so it cannot be traced back to an ...
- 165
2
votes
1
answer
118
views
How to Avoid Copy Pasting Repetitive Log Calls
Currently working on a Go project of about 10k lines of code. Within the project, there's a logging library that requires a couple steps of initialization in order to actually write to the log ...
- 139
2
votes
3
answers
1k
views
What is the proper logging level for tests?
I raised an issue at my employer concerning our gigantic heaps of testing logs.
I raised the issue because I was spending well over a minute to find the relevant logs and stack-trace.
I stated we ...
- 318
0
votes
1
answer
146
views
I'm writing an application that needs to log error/ exception messages but should still continue execution if it not a fatal error
I'm writing an application that needs to log error/ exception messages but should still continue execution if the error is not a fatal error. I was thinking of making a method that returns a Task but ...
- 163
3
votes
4
answers
1k
views
Do I use Repository or Service Object to Perform Logging?
I'm working in Java Spring, and I have typical service and repository layers. The repository grabs a JSON; passes it along to the service; service maps the repository response to a DTO.
I also need ...
- 165
9
votes
6
answers
13k
views
Is it worth logging HTTP requests when they enter an API server?
I'm designing an API and have reached the topic of logging. I'm going to store my logs in Elasticsearch.
I'm certainly going to do some logging at the time the HTTP response is sent back to the ...
- 277
3
votes
2
answers
767
views
Logging Config - in code vs in config file
The built-in logging module of python 3.x allows for 3 ways to define a custom logger:
INI-formatted file
dict, json, yaml
python (directly in code)
In my opinion, it is easier to define a custom ...
- 153
13
votes
5
answers
2k
views
Does the responsibility of logging method/function calls fall to the caller or the callee?
What are the pros and cons to each of the following ways of logging a function call? This code is written in Ruby but I feel the question applies to programming in general.
Responsibility belongs to ...
- 269
0
votes
0
answers
46
views
Do logs enhance availability of service for a well monitored application?
I used to work for teams that built software as a service applications. Our requirements, regarding production, were often the same :
A complex service (web application, database, daemons, typically) ...
- 2,056
5
votes
1
answer
2k
views
Interview question: "How do you make sure your logs are sufficient?" [closed]
I was in a job interview with a vp r&d today.
I would like to ask it here, even though it is, in my opinion, too broad as a question.
One of his questions went something like:
"How do you make ...
- 1,211
2
votes
2
answers
196
views
How to implement change log of a ticket in complaint management system [closed]
One of the requirement, in the complaint management system were are designing, is to implement complete history of the ticket. For example
Status was changed (new to pending to work in progres to ...
- 1,035