Timeline for Storing scraping functions code inside a database
Current License: CC BY-SA 4.0
17 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Aug 30, 2021 at 9:58 | comment | added | bdsl | @Dana Thanks - may be worth editing your question to add that information. | |
Aug 30, 2021 at 9:17 | comment | added | Dana | @bdsl We have many clients reaching out for our services and we cannot simply afford downtime on daily basis for updating the scraping functions according to the new changed website DOM. Be that as iut may, we do not expect for a change to occur on daily basis as well, but we dont want to be dependent on such | |
Aug 30, 2021 at 9:15 | comment | added | Dana | @DocBrown No - they shall be treated just as any other db info | |
Aug 29, 2021 at 14:03 | comment | added | bdsl | Can you say something about why 're-deploying the system for every change' is time consuming or expensive, and how often you would expect there to be changes? I suspect there may be a better solution around improving your deployment system to make redeploy for every change convenient.. | |
Aug 27, 2021 at 14:05 | history | protected | gnat | ||
Aug 27, 2021 at 13:57 | answer | added | John Peters | timeline score: 2 | |
Aug 27, 2021 at 5:22 | comment | added | Doc Brown | Ok, you missed the point in my former comment, let me reword it: would the scraping functions still be under version control as soon as they are moved into the database? | |
Aug 26, 2021 at 23:40 | comment | added | Dana | @DocBrown All scraping functions are currently inside the project, each function inside its own module | |
Aug 26, 2021 at 19:43 | comment | added | Doc Brown | Do you have version control for the scraping functions in the database? | |
Aug 26, 2021 at 16:08 | history | edited | Rik D |
Removed domain-driven-design tag
|
|
Aug 26, 2021 at 15:03 | answer | added | Hieu Le | timeline score: 4 | |
Aug 26, 2021 at 13:27 | answer | added | Hans-Martin Mosner | timeline score: 7 | |
Aug 26, 2021 at 13:21 | answer | added | ojdo | timeline score: 2 | |
Aug 26, 2021 at 13:06 | answer | added | Kilian Foth | timeline score: 3 | |
Aug 26, 2021 at 13:00 | history | edited | Kilian Foth | CC BY-SA 4.0 |
deleted 2 characters in body; edited title
|
Aug 26, 2021 at 12:52 | review | First posts | |||
Aug 26, 2021 at 18:12 | |||||
Aug 26, 2021 at 12:48 | history | asked | Dana | CC BY-SA 4.0 |