Questions tagged [logging]

Computer data logging is the process of recording events in a computer program, usually with a certain scope, in order to provide an audit trail that can be used to understand the activity of the system and to diagnose problems.

Filter by
Sorted by
Tagged with
0
votes
1answer
136 views

I'm writing an application that needs to log error/ exception messages but should still continue execution if it not a fatal error

I'm writing an application that needs to log error/ exception messages but should still continue execution if the error is not a fatal error. I was thinking of making a method that returns a Task but ...
2
votes
2answers
103 views

Do I use Repository or Service Object to Perform Logging?

I'm working in Java Spring, and I have typical service and repository layers. The repository grabs a JSON; passes it along to the service; service maps the repository response to a DTO. I also need ...
0
votes
4answers
142 views

Is it worth logging HTTP requests when they enter an API server?

I'm designing an API and have reached the topic of logging. I'm going to store my logs in Elasticsearch. I'm certainly going to do some logging at the time the HTTP response is sent back to the ...
3
votes
2answers
158 views

Logging Config - in code vs in config file

The built-in logging module of python 3.x allows for 3 ways to define a custom logger: INI-formatted file dict, json, yaml python (directly in code) In my opinion, it is easier to define a custom ...
7
votes
5answers
448 views

Does the responsibility of logging method/function calls fall to the caller or the callee?

What are the pros and cons to each of the following ways of logging a function call? This code is written in Ruby but I feel the question applies to programming in general. Responsibility belongs to ...
0
votes
0answers
42 views

Do logs enhance availability of service for a well monitored application?

I used to work for teams that built software as a service applications. Our requirements, regarding production, were often the same : A complex service (web application, database, daemons, typically) ...
5
votes
1answer
500 views

Interview question: “How do you make sure your logs are sufficient?” [closed]

I was in a job interview with a vp r&d today. I would like to ask it here, even though it is, in my opinion, too broad as a question. One of his questions went something like: "How do you make ...
2
votes
2answers
97 views

How to implement change log of a ticket in complaint management system [closed]

One of the requirement, in the complaint management system were are designing, is to implement complete history of the ticket. For example Status was changed (new to pending to work in progres to ...
0
votes
2answers
120 views

Can there be too much logging? (Front End & Back End)

In a bit of a dilemma. At work we are having issues with an API service that communicates with the client side through a WebSocket. The problem so far is that the WebSocket seems to be unreliable. We ...
1
vote
0answers
28 views

Solution architecture for storing machine learning data

I'm building a mobile application using Expo & React Native. As the user interacts with the mobile app I need to store their interactions in Google BigQuery, so they can later be used to train ...
3
votes
2answers
342 views

Is there a specific name for this kind of debugging?

Imagine you have a system where a program is running and somehow an abnormality occurs. (it can be a crash, or an abnormal screen or any other thing) Imagine reproducing the problem is next to ...
-1
votes
1answer
174 views

What is the C++ equivalent of a logging facade in Java?

I'm currently writing a library in C++ and was wondering if I should log from within it. Googling the issue I came across this question but it makes reference to a logging facade. Is there anything ...
0
votes
0answers
27 views

Does using ElasticSearch X-Pack Watcher make sense for emailing error logs?

Watcher for X-pack seems like an awesome technology for dealing with system events, however I think it may be overkill for my current use case. All I am trying to do at the moment is email an admin ...
0
votes
1answer
105 views

When to use logger.info in sl4j

For my application logs for a REST server, I'd like to log some details about each http request. I'm using sl4j. Should I use logger.debug or logger.info More generally what sort of things should be ...
0
votes
1answer
45 views

Custom remote logging strategies

I am implementing an asynchronous remote (to aws S3) logging handler (in python, but it doesn't matter) supporting 4 modes: Immediate: the messages get written immediately to S3 - I am trying to ...
3
votes
1answer
267 views

Why would CPython logging use a Lock for each handler rather than one Lock per Logger?

While developing my own logging library, I studied the source code of the standard logging module of CPython. One of its features is that handlers are thread-safe. One can write logs to a file from ...
7
votes
4answers
788 views

Should log statements be tested?

When writing tests I usually ignored logging statements, but now I wonder if it was right. The logs are often important tools when diagnosing production issues, moreover there can even be ...
0
votes
1answer
43 views

How to ensure that every log event will be delivered to the GrayLog

In our applications we traditionally log events locally into the logging files. As our applications are distributed on multiple server instances, searching for particular events are complicated and ...
1
vote
0answers
41 views

Logfile correlation finder (for j4Log)

I'm currently analyzing a problem in a old "distributed" system, that only occurs sporadically - as the system does not support other means of debugging help I have to rely on the logs (I did not ...
1
vote
1answer
127 views

Logging patterns from within library code

I am looking for a design pattern for logging from within library code. Suppose I have a function in a library file that i expect will be used by multiple front-ends (lets assume a CLI and a web): ...
3
votes
3answers
160 views

Drawing lines with dashes in logs

It can sometimes ease readability to "draw" lines in a logfile. For example: noise noise ----------------------------- Starting Operation ABC blabla blabla ----------------------------- End of ...
2
votes
1answer
232 views

Logging an application in Python

Recently I have worked in a small standalone Python console application and have inherited some code from another team. Although some of us have written small Python scripts in the past, none of us ...
1
vote
1answer
581 views

Logging architecture in microservices

We are going to develop an enterprise level application which will be run by a dozen microservices. Every microservice will be inside docker and all this will be orchestrated by Kubernetes. Obviously, ...
0
votes
2answers
135 views

Handling logging when there is no internet access

I'm developing an application that handles sales for multiple clients, when the client sells a particular item, that information should be send to the admin. The count of each item sold and the item ...
3
votes
2answers
126 views

How would you go about designing a structured log pattern for systems?

My web app generate log entries on hooks such as model.save. Right now, I have a class Entry (representing a log entry) with a string field content to contain the text of the log entry. Examples of ...
1
vote
2answers
187 views

Rotated log file - what is it?

What does rotated log file means? There is any example? I used to see this term in logging libraries documentation but couldn't understand the meaning. Update: there is any different from a rolling ...
1
vote
1answer
153 views

Logging Architecture Solution

Let me start by setting up the context briefly. In our organization (a Big Data company), there are many different systems, including Web sites, workers (system listening to queues and/or topics), ...
1
vote
1answer
845 views

Fastest way to persist an append-only ordered event stream

I'm looking to persist a stream of events and I want it to be: fast in both latency and throughput, looking at at least 100k events per second ordered (not by timestamp, as multiple events within the ...
0
votes
1answer
252 views

When doing oop in python where should I add the logger

When doing oop in python where should I add the logger. Should I add it: before the class Rocket(): and give it a file global scope or after the class Rocket():  and give it a class scope. Syntax ...
0
votes
1answer
180 views

Application analytics - Logging with NoSQL/RDBMS, BigData [closed]

I need to architect a system for my company. My question is specific to logging. Part of the requirement is to log 2 kinds of data. A1. User events (Ex: UserA clicked on Button1, performed Action#21. ...
0
votes
2answers
522 views

what is the impact of logging (or excessive logging) of messages to log file on application performance?

Do logging impact application performance? First thing to know is , whether logs are written serially as processing takes place or are logged into file i a separate process? In java world how should ...
6
votes
3answers
1k views

Better conditional debugging pattern?

Given the need to log only in debug mode the easiest way would be to use if conditions: def test(x, debug=False): if debug: print(x) # ...Some more code if debug: print("...
1
vote
2answers
113 views

How much to log with 400 or 500 HTTP resonses?

In light of the recent Twitter logging bug, I've been thinking about something with my own web-app: how much information should I log in the event of a 400 or 500? I obviously don't want to be logging ...
0
votes
2answers
108 views

Difference between interaction log and “debug” or “application” log

Let's say I need two logs coming out of my application. One is for debugging issues and making sure the application runs correctly and the other is used for user statistics and general analysis of the ...
1
vote
1answer
1k views

Is it a good practice to log client side errors to a file

I basically want to know if it is considered a good practice to persist the errors that happen on the client side of a web application (typescript/angular for example) by logging them to files? Or if ...
2
votes
3answers
258 views

Storing a large amount of measurement data in a small storage space

I'm storing some temperature, voltage and current data every 10 seconds to a log file. This file is supposed to be retrieved later so we can read the data and display it. Time requirement is 6 month ...
1
vote
1answer
208 views

logger initialization in JEE based web application

While working on a web (JEE based) application I saw some different ways people have instantiated loggers in different classes. First way is classic way like, private static final Logger logger = ...
15
votes
6answers
9k views

Try/Catch/Log/Rethrow - Is Anti Pattern?

I can see several post where importance of handling exception at central location or at process boundary been emphasized as a good practice rather than littering every code block around try/catch. I ...
1
vote
1answer
71 views

How to implement format-complying logging system?

We have a system that generates lots of logs and we have to somehow maintain logging workflow in a project. The 'strict' (let's assume it's strict) requirement is that there should be a document ...
39
votes
6answers
5k views

Making code findable by using globally unique message IDs

A common pattern for locating a bug follows this script: Observe weirdness, for example, no output or a hanging program. Locate relevant message in log or program output, for example, "Could not find ...
7
votes
1answer
531 views

Handle Optional Logging in High-Performance Library

I'm writing a library in C++ which needs to be as fast as reasonably possible. However, I'd also like to be able to provide logging in case a user (or me) needs to debug possible problems. This ...
0
votes
1answer
77 views

Logging parametrized logs while maintaining readability

I have a LogFormatter class which looks like below @Sl4j class LogFormatter { public static String format(String taskType, String taskId, String message) { return String....
5
votes
2answers
133 views

Logging/Debugging of computer vision apps

When I'm writing an computer-vision program (using OpenCV and Python) I need to print/show a lot of intermediate results in form of images (using cv2.imshow(..)) for debugging purposes to find out ...
4
votes
2answers
147 views

Create machine-readable logfiles

I'm currently developing a new device, which produces (text-)logfiles. There will be many devices of this type and I want to analyse the logfiles (for error-detection and statistics). Until now, the ...
2
votes
1answer
592 views

Storing logs on mysql database

I was looking for more information on logging user actions on the application (web based project). I did found this question, but it's a more conceptual answer, wich helped me getting started with ...
1
vote
5answers
414 views

Making logging more efficient and useful by categorizing data (and virtually not writining messages anymore)

I'd like to make my logs more useful. Currently they mostly contain such common columns as: timestamp, logger-name, log-level, message, exception. They are unsearchable and unparsable and writing ...
1
vote
2answers
157 views

Optional logger for an API implementation

Say I want to create a C# implementation of an API for some 3rd party service, and I want to have an option to get the json posts and responses out somehow, what would be an elegant way of doing that? ...
1
vote
1answer
872 views

How to choose between a library and shared project?

I am working on a set of .NET Core 2.0 Microservices together with some other developers. I wrote some code to add my own custom logging as described here. My logger sends the logging messages to an ...
1
vote
2answers
2k views

Auditing web application user changes

I have a web application written in Java, Oracle, and AngularJS. I want to save log in database when user changes, creates or updates something. There are two way of implementing this: 1. Auditing ...
3
votes
4answers
494 views

What is the point of logging? [closed]

I got asked a question today that was so basic I was unsure how to answer it. I had added some logging statements to our integration testing package, to find out what part of it was taking so long (...