Questions tagged [database]
This tag is for general database questions. If you question is specific to SQL or NoSQL, use the corresponding tags instead.
1,896
questions
-3
votes
0answers
24 views
What's the likely minimum size of a comprehensive personal profile dataset, including compressed imagery? [closed]
It's been oddly difficult to pinpoint the right focus group within the Stack Exchange family at which to ask this question. Nothing seems to quite fit, probably because the question covers so many ...
0
votes
1answer
39 views
Distribute commit files between different repositories
I am not sure if what I'm asking is even possible (or desirable, for that matter), but we were wondering what would be the best way to handle SQL changes to a Database schema, when this schema is ...
0
votes
0answers
40 views
Design an extensible permissions model in database
I’m trying to model a system with Users, Permissions and Products. The main goal is to have a way of checking if a User has a specific Permission in order to allow or deny other system operations.
So ...
2
votes
2answers
86 views
How does a database implementor migrate their database engine to a new data structure?
I am working on implementing a database of sorts and am stuck wanting to make it perfect from the get go because I realize I don't know how to migrate the database engine from one data structure to ...
7
votes
5answers
325 views
How to avoid making User a god object?
Consider typical gym trainings tracker app.
User has account related attributes:
User {
id
login
password
email
fname, lname
isBlocked
}
However, the requirements are that an application'...
0
votes
1answer
41 views
Bulk Update of DDD Aggregate Roots
In my applications users can perform actions on a few thousand aggregate root instances with a single click. The problem is that the UI is blocked for several seconds (~ 3) what feels too slow. So, I'...
1
vote
3answers
114 views
In a micro service architecture, how should two services communicate with each other? Shared database? REST calls?
I've read a number of conflicting articles as to whether microservices should share a database. How and when should microservices communicate?
Someone posed the example of 2 microservices:
Employee
...
-1
votes
2answers
60 views
What's better, using DB or Storage services to save videos?
I am creating a website that allows to teachers to uploading courses, what's better, to just use the DB or should I use storage services, and how could I know the size of the videos?
I am using AWS if ...
-3
votes
1answer
55 views
Replacement for Progress/OpenEdge environment [closed]
I've recently joined a firm, where we are working with Progress 4GL from OpenEdge, release 11.6.
As I have quite some experience in other programming environment, I'm really surprised by the extremely ...
-4
votes
1answer
41 views
Efficient database for multiple key searching?
I'm trying to implement a solution that stores every product from a shop, and then allows me to search them either by ID (an integer index), description (string) or barcode (string).
The idea I came ...
0
votes
0answers
99 views
Storing tree data in a database for fast reading of the whole hierarchy
I have a class that looks something like this:
class Entity
{
public string Id { get; set; }
public List<Entity> Children { get; set; }
public void DoStuff(Data data)
{
...
0
votes
2answers
131 views
How do you effectively track the history of changes to a text field in the database on a content editing platform?
Say I have a website/platform that allows people to submit business names in order to build a high quality business name database. You can apply this to any subject or topic, such as building a ...
-1
votes
2answers
66 views
When writing tests against the database, should the test to create a resource also retrieve the resource to check the values were correctly inserted?
Where I work, we have some integration tests which spin up a new SQL database instance in Docker, so that we can test the repository logic for write actions as well as read actions. We have a test for ...
0
votes
2answers
72 views
Check if can delete before save
I am designing an application that works with REST API requests for dealing with information stored in a database.
The user will add, edit, delete information in this client and after SAVE the ...
-1
votes
1answer
90 views
Best practice to flatten JSON object and store it database
I'm fetching data from Clockify, flattening the JSON response, and storing it in the database where each property on the API response should have its own table's field.
I have read this article about ...
0
votes
1answer
45 views
Convert RTF to HTML when it's saved to the database or when it's rendered?
Users have the ability to enter and save text in a rich text editor which is eventually stored in a database and then rendered on a site.
Is it better to convert the RTF to HTML when it's stored to ...
0
votes
1answer
45 views
Loading in and Autocompleting a CSV File React
I'm currently working on a React Application with Firebase that involves a ton of data manipulation and reading. One specific feature is the ability to autofill a form based on a very large CSV file (...
5
votes
2answers
179 views
What's the difference between active-active failover and master-master replication?
As we may know, there are two main high availability patterns: fail-over and replication.
In active-active failover, both servers are managing traffic.
In master-master replication, both masters serve ...
2
votes
1answer
108 views
Sharding rule updating on DB scaling
When you have sharding, horizontal partitioning, you have multiple DBMS instances, and your server app chooses which one to use by some rule that uses record IDs. Well, for example, we have ...
2
votes
2answers
251 views
DB table for weather station readings
I want to create a DB table to keep the sensor readings from the physical sensors (weather station). What I was thinking is to create following:
+--------------------------+
| readings ...
0
votes
1answer
64 views
Best practice for pulling bulk data from APIs and storing in database
I have written a small application using ASP.NET Core to create and manage collections of cards for a collectable card game. I currently have a version that successfully downloads bulk card data via ...
-2
votes
1answer
79 views
How to set only one foreign key for every record where the table has 2 foreign keys?
I know that this question has been asked before and is the same or at least almost the same but I just want to know: Is it the only method or is there any other way to do it?
I have these tables: ...
0
votes
1answer
115 views
Does it make sense to have redundant DB fields to improve query performance, programming speed and code readability?
I am a bit torn about the database design for a solution. I have the following structure: (only the relevant fields are marked with #)
+------------------+
| activities |
|------------------|
| ...
1
vote
2answers
203 views
When would I pick NoSQL over SQL when dealing with partly schema-less data?
so, I'm currently developing a feature for a website of mine, which aims to gather a set of financial data from the user so the user can start and take care of a budget, as well as the website ...
0
votes
1answer
47 views
IOT data interpretation
This is a more architectural question and I am hoping to get more ideas out of this thread. I have a computer vision model detecting daily life activities and sending data to the server every second. ...
0
votes
0answers
34 views
Scheduled messages pushed from database to API
I'm building a system with a dataflow, as described below. It is reasonable, or can it be improved, especially I would like comments on the job that moves messages from the database to the queue.
...
0
votes
0answers
54 views
Database Design for Form Builder
Hi guys I'm trying to create Form builder in my app for different Events that have happened and publish them, so the users can fill them out.
Little About Logic:
Forms are created per different Event ...
0
votes
1answer
57 views
Design a correct microservices architecture with data relations
I just started thinking about building a microservices architecture for learning purposes.
I understood that microservices are split, and they should be independent, even when storing data, but what ...
-1
votes
1answer
31 views
Should 2 different MySql databases from 2 different applications be joined together if the 2 apps are merging into 1?
This is a question about software architecture, not databases.
I currently have 2 completely separate web applications, call them A and B for simplicity. They are on their own machines, with their own ...
2
votes
2answers
48 views
Where to place an in-memory cache to handle repetitive bursts of database queries from several downstream sources, all within a few milliseconds span
I'm working on a Java service that runs on Google Cloud Platform and utilizes a MySQL database via Cloud SQL. The database stores simple relationships between users, accounts they belong to, and ...
0
votes
0answers
34 views
Should we leak concurrency in the application layer, domain, controller,
Consider a (simplified) version of a/our (clean-)architecture in the image below.
Using Cosmos, we want to use optimistic concurrency to ensure we do not suffer from any lost updates. This can be ...
0
votes
2answers
51 views
How to name an association table connecting two tables having common name
I have two tables products and product_tags in my database having a many-to-many relationship. But I am having a hard time coming up with a practical name. So I was wondering if there is a standard ...
-2
votes
1answer
70 views
Handling Legacy Database with Spring Boot Java
We are given a task to create an Web Service API for a mobile application. The problem is we have to use a legacy database that is not normalized and its very tedious to work with. We are accustomed ...
-1
votes
1answer
44 views
Are DB integration tests relevant to test DB schema (and worth being impl.) when being run in a CI pipeline? If not when are they?
This is something that is puzzling me a bit.
I am seeing some people who like to implement DB-related integration tests (in the case of BLOBAs) to test the insertion with a Legacy DB in a CI pipeline, ...
0
votes
1answer
47 views
Data Junction table - how many relations should it contain?
I have a junction table, say for People and Locations
PersonLocations
PersonId | LocationId
---------------------
1 3
2 5
Now, Locations can belong to each other i.e. one ...
1
vote
0answers
71 views
How do I architect reordering in database?
I'm building a todo list app and using react-beautiful-dnd on the frontend to allow users to reorder tasks. I'm trying to work out how to persist changes to the database when a user reorders items.
...
0
votes
1answer
123 views
Is it considered as best practice to use migration scripts for one-off large data manipulation over a table?
I have inherited a project via laravel that uses its database migration mechanism coming from the framework. The application has the following table named actions:
action_log_id SERIAL PK
user_id INT
...
1
vote
0answers
76 views
Notification System Design for Multi User Application
I have a requirement to design a notification system for multi-user(~1000 users) application, here are the high level requirements.
System event gets triggered on specific operations.
On event ...
1
vote
0answers
36 views
make Google Cloud Storage public url's only accessible to my react native app
I have a Node backend that uploads users' profile pictures to Google Cloud Storage, which returns a Public URL that is stored against the user doc in MongoDB. I want this URL to only be accessible ...
2
votes
2answers
94 views
How to model database for system with historical relationships (many-to-many and one-to-many)
I'm working on a system with a main entity, let's say "Members", these members have relationships to other entities and it's important to keep the history to be able to query and know the ...
2
votes
2answers
254 views
Benefits of created_at or updated_at columns in database design
I am under the impression that having created_at or updated_at columns seems to be a best practice in database design. Frameworks like "Ruby on Rails" and "Laravel" both support ...
5
votes
3answers
286 views
Best way to reduce database writes?
I couldn't find a similar enough thread, so i'm making a new one. My question is about reducing database writes. Context is that I have an application which increments a number in a database every ...
8
votes
1answer
136 views
What is the field/discipline called that deals with the automated management of very large and heterogeneous collections of files?
I work for an academic research lab whose file storage footprint is growing past the point where it can be properly managed "by hand", i.e. without extensive automation. (The number of ...
-2
votes
1answer
107 views
Extensible hierarchical database design
This question is an extension to the question here (and follows the same hierarchy) - Multiple intersection tables vs multiple joins based on this answer - https://softwareengineering.stackexchange....
1
vote
1answer
62 views
Multiple intersection tables vs multiple joins
I have a hierarchical relationship between my tables, with the children having foreign keys referring back to their parent ids (assuming id is the primary key for each table):
Department has many ...
2
votes
2answers
135 views
API architecture design for fast reads of text file with 150m unique labels
Assume a text file with 150m unique records.
Each record has two columns: (1) string and (2) integer.
The string is a unique label, and the integer is the label's value.
The only query will return the ...
1
vote
0answers
62 views
Neo4j graph performance: should I cache slow queries in a separate database?
Setup/Intro
I have 10k+ nodes in my Neo4j graph in which I need to display a sub-graph (100-500 nodes) between 2 start/end nodes on the frontend app along with info about the critical path and all ...
0
votes
1answer
170 views
How to manage database changes and sync data with multiple api versions
We're working with ASP.NET Core web API and looking for a couple of doubts that we have.
The versioning documentation recommended creating multiple controllers:
Contoso
└ Api
├─ v1
│ └ ...
-3
votes
2answers
40 views
Does it make sense for a large scale SaaS project to use a single all powerful SQL/RDBMS database?
Scalability seems to be a thing now.
I was in a heated argument with one of my developer who insist on using MySQL for a data intensive application we are building. MySql is easy, fits the purpose and ...
0
votes
1answer
51 views
What is the schema to specify relationships in a flat-document structure?
I have a question about the best database schema to do this. So, we want our database schema to carry out some generic operation <> involving two units of data, x1 and x2 (e.g. a1).
// CURRENT ...
