Questions tagged [logging]

Computer data logging is the process of recording events in a computer program, usually with a certain scope, in order to provide an audit trail that can be used to understand the activity of the system and to diagnose problems.

Filter by
Sorted by
Tagged with
-2
votes
0answers
16 views

Design choice: Using kafka for application logging 1 topic vs multiple topics

I'm planning on having multiple applications switch to using kafka as the main place to push logs to asynchronously, where a downstream application will consume those logs and load them somewhere for ...
0
votes
0answers
26 views

Migrating an application using a custom API logging system

I'm turning a VB6 application into a VB.NET (using a migration tool). This software relies on a custom DLL which handles logging. This DLL logs to flat files and optionnaly in a GUI component. Also ...
2
votes
1answer
67 views

How to return “debugging” information during the execution of an algorithm

I was recently tasked with thinking about returning optional tracing information about the execution of a complex algorithm. It's the kind of data you need to analyse the inner workings - a bit like ...
-4
votes
1answer
39 views

Message Strings in Backend

Its ok to have hardcoded strings on backend? Example: Log.e("Error connecting to the database") The text "Error connecting to the database" should be hardcoded there? Or should it be in a separated ...
-3
votes
2answers
142 views

Are there any standards on log severity levels? [closed]

I'm seeking a way to generalize the way log levels are managed in my services. I have multiple services, written in multiple languages, and using multiple libraries to manage logs. Almost all of them ...
0
votes
0answers
26 views

Persistent logging in browser extension?

I am currently working on developing a browser extension to be supported on chrome, firefox and edge. I want to integrate application logging into it in order to have sufficient data to diagnose any ...
3
votes
0answers
72 views

Logging by 3rd party libraries

We've got 2 very large platforms for our services & jobs. Both platforms consists of 20+ servers hosting 1000+ services/jobs. Each job/service is essentially a java web application. Both ...
0
votes
1answer
40 views

Test logging library

I've been designing and developing a very scalable logging library for a while. The main goal of this library is pretty simple. Like many others projects, a simple goal does not mean a simple way the ...
3
votes
3answers
233 views

Are there better alternatives to debug level logs to investigate a bug in a production environment?

Some of our customers from time to time report an unexpected behavior in one feature of our software and we suspect that we have a bug. The feature itself and the kind of bug is not interesting for ...
2
votes
2answers
199 views

Logging: safety vs performance. How do I choose?

While making an application I've come to the point where I want to add logging for the inevitable case when something goes wrong. Now this seems like a problem that should have been solved decades ago,...
0
votes
2answers
120 views

Architectural solution for business logging

I have a the requirement for a webservice which should return a "business log" of the action the service performed. Usually I only return error logs which are based on exceptions. the exceptions get ...
3
votes
3answers
91 views

Should An SDK Have Logging in the API

I am working on building a API and SDK for a web service. My question is what is the correct practice for logging. Should the SDK do logging for the API methods? All the SDKs I have seen do not do ...
3
votes
4answers
169 views

What log level use for deprecated features?

There is a feature that is now deprecated and going to be removed. Adding a logging statement, observed by some alerting mechanism, can help finding out whether the feature is still being actively ...
1
vote
0answers
72 views

Why does the PHP community always rely on file-based logging instead of a combination with in-memory logging?

This is an initial thought I'm having on logging. Clearly, am missing something about the whole picture because I don't think someone didn't think of this before. PHP runs on one request. That means ...
0
votes
0answers
392 views

log centralization and central aggregation system design

I'm thinking of how would I go about creating my own logging centralization and centralized aggregation system. Imagined system has 10 - 100 nodes. Each node runs a LAMP(Linux, Apache, MySql, PHP) ...
1
vote
0answers
60 views

Database vs Logs - Persistence approach evaluation

I have a node js app, in which I need to perform background jobs. My plan is to use a data structure which will contain all the jobs needs done. My design also suggests that this data structure needs ...
1
vote
0answers
50 views

Log data anonymization with ELK

I'm considering using the ELK stack for logging within our company. To comply with our data retention policy, we would like to anonymize data after one year so it cannot be traced back to an ...
2
votes
1answer
90 views

How to Avoid Copy Pasting Repetitive Log Calls

Currently working on a Go project of about 10k lines of code. Within the project, there's a logging library that requires a couple steps of initialization in order to actually write to the log ...
2
votes
3answers
307 views

What is the proper logging level for tests?

I raised an issue at my employer concerning our gigantic heaps of testing logs. I raised the issue because I was spending well over a minute to find the relevant logs and stack-trace. I stated we ...
0
votes
1answer
137 views

I'm writing an application that needs to log error/ exception messages but should still continue execution if it not a fatal error

I'm writing an application that needs to log error/ exception messages but should still continue execution if the error is not a fatal error. I was thinking of making a method that returns a Task but ...
3
votes
2answers
191 views

Do I use Repository or Service Object to Perform Logging?

I'm working in Java Spring, and I have typical service and repository layers. The repository grabs a JSON; passes it along to the service; service maps the repository response to a DTO. I also need ...
0
votes
4answers
2k views

Is it worth logging HTTP requests when they enter an API server?

I'm designing an API and have reached the topic of logging. I'm going to store my logs in Elasticsearch. I'm certainly going to do some logging at the time the HTTP response is sent back to the ...
3
votes
2answers
356 views

Logging Config - in code vs in config file

The built-in logging module of python 3.x allows for 3 ways to define a custom logger: INI-formatted file dict, json, yaml python (directly in code) In my opinion, it is easier to define a custom ...
8
votes
5answers
846 views

Does the responsibility of logging method/function calls fall to the caller or the callee?

What are the pros and cons to each of the following ways of logging a function call? This code is written in Ruby but I feel the question applies to programming in general. Responsibility belongs to ...
0
votes
0answers
42 views

Do logs enhance availability of service for a well monitored application?

I used to work for teams that built software as a service applications. Our requirements, regarding production, were often the same : A complex service (web application, database, daemons, typically) ...
5
votes
1answer
683 views

Interview question: “How do you make sure your logs are sufficient?” [closed]

I was in a job interview with a vp r&d today. I would like to ask it here, even though it is, in my opinion, too broad as a question. One of his questions went something like: "How do you make ...
2
votes
2answers
108 views

How to implement change log of a ticket in complaint management system [closed]

One of the requirement, in the complaint management system were are designing, is to implement complete history of the ticket. For example Status was changed (new to pending to work in progres to ...
1
vote
2answers
345 views

Can there be too much logging? (Front End & Back End)

In a bit of a dilemma. At work we are having issues with an API service that communicates with the client side through a WebSocket. The problem so far is that the WebSocket seems to be unreliable. We ...
1
vote
0answers
113 views

Solution architecture for storing machine learning data

I'm building a mobile application using Expo & React Native. As the user interacts with the mobile app I need to store their interactions in Google BigQuery, so they can later be used to train ...
3
votes
2answers
348 views

Is there a specific name for this kind of debugging?

Imagine you have a system where a program is running and somehow an abnormality occurs. (it can be a crash, or an abnormal screen or any other thing) Imagine reproducing the problem is next to ...
-1
votes
1answer
262 views

What is the C++ equivalent of a logging facade in Java?

I'm currently writing a library in C++ and was wondering if I should log from within it. Googling the issue I came across this question but it makes reference to a logging facade. Is there anything ...
0
votes
1answer
166 views

When to use logger.info in sl4j

For my application logs for a REST server, I'd like to log some details about each http request. I'm using sl4j. Should I use logger.debug or logger.info More generally what sort of things should be ...
0
votes
1answer
52 views

Custom remote logging strategies

I am implementing an asynchronous remote (to aws S3) logging handler (in python, but it doesn't matter) supporting 4 modes: Immediate: the messages get written immediately to S3 - I am trying to ...
3
votes
1answer
462 views

Why would CPython logging use a Lock for each handler rather than one Lock per Logger?

While developing my own logging library, I studied the source code of the standard logging module of CPython. One of its features is that handlers are thread-safe. One can write logs to a file from ...
8
votes
4answers
2k views

Should log statements be tested?

When writing tests I usually ignored logging statements, but now I wonder if it was right. The logs are often important tools when diagnosing production issues, moreover there can even be ...
0
votes
1answer
56 views

How to ensure that every log event will be delivered to the GrayLog

In our applications we traditionally log events locally into the logging files. As our applications are distributed on multiple server instances, searching for particular events are complicated and ...
1
vote
0answers
52 views

Logfile correlation finder (for j4Log)

I'm currently analyzing a problem in a old "distributed" system, that only occurs sporadically - as the system does not support other means of debugging help I have to rely on the logs (I did not ...
1
vote
1answer
244 views

Logging patterns from within library code

I am looking for a design pattern for logging from within library code. Suppose I have a function in a library file that i expect will be used by multiple front-ends (lets assume a CLI and a web): ...
3
votes
3answers
169 views

Drawing lines with dashes in logs

It can sometimes ease readability to "draw" lines in a logfile. For example: noise noise ----------------------------- Starting Operation ABC blabla blabla ----------------------------- End of ...
2
votes
1answer
335 views

Logging an application in Python

Recently I have worked in a small standalone Python console application and have inherited some code from another team. Although some of us have written small Python scripts in the past, none of us ...
1
vote
1answer
905 views

Logging architecture in microservices

We are going to develop an enterprise level application which will be run by a dozen microservices. Every microservice will be inside docker and all this will be orchestrated by Kubernetes. Obviously, ...
0
votes
2answers
147 views

Handling logging when there is no internet access

I'm developing an application that handles sales for multiple clients, when the client sells a particular item, that information should be send to the admin. The count of each item sold and the item ...
3
votes
2answers
153 views

How would you go about designing a structured log pattern for systems?

My web app generate log entries on hooks such as model.save. Right now, I have a class Entry (representing a log entry) with a string field content to contain the text of the log entry. Examples of ...
1
vote
2answers
364 views

Rotated log file - what is it?

What does rotated log file means? There is any example? I used to see this term in logging libraries documentation but couldn't understand the meaning. Update: there is any different from a rolling ...
1
vote
1answer
327 views

Logging Architecture Solution

Let me start by setting up the context briefly. In our organization (a Big Data company), there are many different systems, including Web sites, workers (system listening to queues and/or topics), ...
1
vote
1answer
1k views

Fastest way to persist an append-only ordered event stream

I'm looking to persist a stream of events and I want it to be: fast in both latency and throughput, looking at at least 100k events per second ordered (not by timestamp, as multiple events within the ...
1
vote
1answer
503 views

When doing oop in python where should I add the logger

When doing oop in python where should I add the logger. Should I add it: before the class Rocket(): and give it a file global scope or after the class Rocket():  and give it a class scope. Syntax ...
0
votes
1answer
326 views

Application analytics - Logging with NoSQL/RDBMS, BigData [closed]

I need to architect a system for my company. My question is specific to logging. Part of the requirement is to log 2 kinds of data. A1. User events (Ex: UserA clicked on Button1, performed Action#21. ...
0
votes
2answers
988 views

what is the impact of logging (or excessive logging) of messages to log file on application performance?

Do logging impact application performance? First thing to know is , whether logs are written serially as processing takes place or are logged into file i a separate process? In java world how should ...
6
votes
3answers
2k views

Better conditional debugging pattern?

Given the need to log only in debug mode the easiest way would be to use if conditions: def test(x, debug=False): if debug: print(x) # ...Some more code if debug: print("...

1
2 3 4 5