Timeline for How to handle database connection drops?
Current License: CC BY-SA 4.0
7 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Aug 10, 2020 at 13:28 | comment | added | Bharel | Apparently the term I was looking for is "Exactly-once semantics". And by the looks of it there's no general way to solve it, while attempting to disregard the underlying technology . | |
Aug 10, 2020 at 13:17 | comment | added | Bharel | @BerinLoritsch if any of them drop. It's a general question about outside resource access. Any time you access a remote service and the connection drops you need to restore it somehow while keeping the data consistent. | |
Aug 10, 2020 at 13:16 | comment | added | Bharel | @JakobBuskSørensen If you wait on a single Kafka connection, and you lose that connection, you won't receive the response if the message was added or not. | |
Aug 10, 2020 at 13:01 | comment | added | Jakob Busk Sørensen | @Bharel I am not sure I am following? I assume you are using Kafka as a message queue. I would wait in my program, until I recieved a response from Kafka, that the message was added to the queue. After that, assuming the use of UUID, the program would be able to move on, since the handler can now run it mulitple times, if e.g. the database connection drops. | |
Aug 10, 2020 at 12:52 | comment | added | Berin Loritsch | Wait a minute... is it your connection to Kafka that gets dropped or your connection to the database? Why would you query Kafka for something happening in your database? | |
Aug 10, 2020 at 12:39 | comment | added | Bharel | Unfortunately, if for example I use a Kafka stream and I insert a new object to it, I'm not sure if I'm able to query Kafka and check if it was inserted or not. | |
Aug 10, 2020 at 12:28 | history | answered | Jakob Busk Sørensen | CC BY-SA 4.0 |