Questions tagged [database]
This tag is for general database questions; if you question is specific to SQL use that tag instead.
1,800
questions
-3
votes
0answers
19 views
Is it possible for multi-user to access with only one/same database using mySQLdb anytime, anywhere
I am doing a GUI project for employees using python and Tkinter. I'm new in this gui developments. The project is purposedly for employees to update their working progress for production. I am ...
0
votes
1answer
74 views
How can I store time series data like Google Analytics, Facebook, etc?
I'm thinking about this in terms of a No SQL database, more specifically MongoDB. So, I want to build something like Google Analytics where I will be taking in a ton of data and when it occurs so I ...
1
vote
3answers
129 views
How should I store time stamps so that it's easily accessible and won't take too much space
tldr at the bottom if you don't want to read all this! :)
First of all the db I'm using is MongoDB! So I've been building a fun project and all has been well but I hit a small problem. Effectively, ...
-1
votes
1answer
48 views
Simple OO/normalization question - common fields in new table/separate object?
I am working on an app and creating models now. I think this is a basic 1N normalization question but am not sure. Should I break location/address out as a separate table?
Let's say I have Parents ...
0
votes
2answers
62 views
How to get data from different microservice?
I have one microservice named UserRegistration for user creation, another microservice named Billing where able to show the billing details for users.
After a new user is being created, it will send ...
0
votes
2answers
138 views
Does the term “master-slave” have the same meaning in software architecture, database schema, and distributed system replication?
From Software Architecture and Design Illuminated
In the master-slave architecture, slaves provide replicated
services to the master, and the master selects ...
1
vote
1answer
46 views
Moving a module out of monolithic database using microservice patterns - challanges
We have a large monolithic database. As part of a new requirement, I am proposing to move our financial transactional system in a new separate database via microservice-esq services. These financial ...
2
votes
2answers
923 views
Storing unchangable data in database vs in code
Hi I am trying to create a role based dynamic route authorization system on my NodeJS ExpressJS powered API server.
Scenario:
There will be some roles like Admin, StandardUser etc. and they can't be ...
0
votes
0answers
31 views
How to store articles (with text and images) in SQLAlchemy database
I'm working on a blog-like application with Flask and SQLAlchemy and I'm unsure how to store the blog posts (articles) in the database. These are going to contain text and images (placed between ...
0
votes
0answers
22 views
Database design and Spring fetch type eager
I am working on an application Angular/Spring boot.
This is the database shema (there were minor changes)
In the backend part (Spring boot) we are using fetchtype eager, it means when i load mission ...
-3
votes
0answers
28 views
Working with Database connections in CRUD flask application
I am creating a CRUD application with flask. In this application about 40 people will be editing the the database at the same time. I am using flask-sqlalchemy for ORM. My question is do I need to ...
0
votes
3answers
189 views
Comparing whether two very large text contents are different or not efficiently
I have a MySQL database with a column Body MEDIUMTEXT. Until now I used to only store the contents into it. There was no update option for the users of the application. Now, I wanted to add an update ...
0
votes
0answers
43 views
Designing flow for application
Problem
I am working on an application for my personal use. Basically what I require is a 24 hr running cloud application that will get alerted about the new articles posted on provided website links ...
1
vote
2answers
112 views
Is it legitimate for a database-driven website to read the DB once (at SessionStart)?
I'm working on a webapp that is supposed to be "database-driven". Now, the stuff we do is a bit evolved (a little configurator) and I hesitate to re-read the DB on every callback, because I fear data ...
0
votes
0answers
25 views
Locale selection for searching and sorting in web app
In a web app i'm working on, there's some i18n/l10n support. Some entities (I'm using locations as an example) support having names in multiple locales. The app has a primary_locale (defaulting to 'en'...
11
votes
5answers
1k views
Docker: One container per database?
I am currently researching approaches for moving our application to Docker containers and stumbled upon a question to which I could not find a clear answer.
Our application has several separate ...
1
vote
2answers
91 views
Database design of a web-app which trains kids to read
The question is about my database design. Is it OK?
I feel uncomfortable about having 2 separate WordTraining and SyllableTraining tables and about too simple design (not much normalized). Maybe ...
0
votes
1answer
54 views
Analyse/show user why data has been filtered out by SQL
Sorry for the bad title. Couldn't really think of a good name without an explanation.
In our system (source is inside Oracle PL/SQL packages) we have quite a lot large SQL queries with a sh..load of ...
1
vote
5answers
179 views
How do B-Trees used in databases sort data based on different fields?
I know majority of databases uses B-Trees, and I can see how using a balanced binary tree will give fast sort times, for ordering by ID or whatever else the primary key is; but how are databases able ...
0
votes
3answers
79 views
Need advice on reporting with big amounts of data
I have a monolith application in .net core 3.0 with entity framework core 3.0. using:
a table with ~3 million records. Its structure is BusinessUnitId | ProfileId | Amount(it has more fields, but ...
1
vote
1answer
58 views
Is my server design safe regarding multiple threads and concurrent database reads/writes?
I'm making a chat server using sockets and a MySQL database, and after it's working I want to expand it to become a more complex game server.
I want to know whether my design is missing anything.
...
-1
votes
1answer
52 views
Data sharing on a multi-instance application
I would like to know which architecture is more suitable when considering data sharing between tenants: a Multi-instance (Single-tenant) or Multi-tenant architecture with a database by tenant.
...
1
vote
2answers
86 views
Separate database in microservice architecture
I'm trying to create project siteWeb and mobile app with clean Architecture and Microservices.
create identity service with separate database A and make another api service with other database B.
for ...
4
votes
2answers
141 views
DB design while designing the system
Recently we had a discussion if rough DB schema (high level tables and columns) design should be part of system design phase or not.
We have two confronting approaches in the company.
Let's assume ...
0
votes
1answer
41 views
Ensure that Room No. of a Course's Section is within the permitted Rooms for that Course with some Constraint
I am facing difficulties establishing constraints in the following situation. This is a hypothetical scenario for practicing DB designing.
Imagine, a rule in a School states that the Courses there ...
-4
votes
3answers
129 views
Why local database should be the only source of truth for mobile application?
Being mobile developer for quite some time (ios/android) I've learnt that local database is very rarely needed. Mobile application are mobile by definition, they usually serve only as clients to ...
3
votes
2answers
101 views
Is Excel data model as good as or better than Microsoft Access?
I'm working with several Excel worksheets and workbooks that need to consolidated or linked to each other. These workbooks will track client interactions for different team members.
I did the initial ...
4
votes
1answer
106 views
Solving file system dependency with database storage
I have a software project A which makes API calls to a third-party software B that is heavily based on data stored on the file system. Also, those software and file systems are distributed on servers ...
2
votes
1answer
61 views
From Oracle to Apache Parquet : how to handle eventual consistency?
I have an existing production Oracle Database. However, there are performance issues for certain kind of operations, because of the volume of the data, or the complexity of queries.
That's why I ...
1
vote
1answer
28 views
Pattern for schema split across sources
I was not sure how to title this question, but bear with me.
My company is building a new product and for it we will use a third-party service (let's call it ENB for short) to be responsible for many ...
0
votes
1answer
52 views
MVC database connection .NET
Introduction
I intend to create a .NET WinForms application (this will be a toy application) which connects to a SQL Server database backend. I have designed and implemented an object-oriented model ...
1
vote
1answer
79 views
How to keep user inputs consistent with assumed inputs to slow computations at the backend?
Background:
I'm writing a clinical trials simulator. The user defines future trial options, eg a trial with 100 placebo patients, 200 treatment patients, "optimistic" outcome scenario, etc. There can ...
2
votes
0answers
103 views
Is it possible to implement insert file operation in modern extent-based filesystems?
The problem was already discussed here. But there was not consensus on this topic.
I have some thoughts on how insert operation can be implemented for some popular file systems. If FS has extent-...
1
vote
1answer
47 views
Structuring a db to allow multiple products to hit a select component list
I am designing my first ever database architecture, no real framework to build up on. So I am working on my own! Terrifying.
A huge question I have is for having two separate tables, one being ...
1
vote
1answer
65 views
Best approach to handle user statuses and keep their history
I am developing a Spring application which has a few different modules. There will be a bunch of users added in the database.
I want to add a feature, which will allow me to track users' availability,...
0
votes
2answers
102 views
Is database linked list a good architecture for replies and reviews system when using mongodb?
I want to create a system of user reviews and replies to the reviews in a website. There can be replies to replies. I'm using mongodb database which I think is an important detail.
The review ...
-2
votes
1answer
92 views
Elasticsearch and PostgreSQL combination
I have a marketplace application and I stored data in a PostgreSQL. I have performance problem for product search, I know I can improve search performance if I use Elasticsearch instead of PostgreSQL ...
0
votes
0answers
25 views
When should I run my database migrations on a multi-server php app deployment thas uses a legacy database that previously had no migrations?
I have a multi-server laravel php application running behind a load balancer and I deploy the code using aws codebuild and codepipeline. The approach is to deploy my application one server at the ...
0
votes
1answer
55 views
Should I skip some migrations on production in case of migrating a legacy database that has not been generated via migration script?
I have a complex PostgreSQL database structure that is consisted with views, materialized views and foreign wrappers.
The database schema is manually updated without any sort of migration script, ...
2
votes
3answers
201 views
When would I use a database over an object-store for large blobs?
I am designing an application where there will be one column that stores a large amount of text. I'm debating whether the text should be stored in the database itself, or whether the database should ...
-3
votes
1answer
52 views
How to store a limited set of custom properties without using an EAV Schema
I'm designing a solution in .Net which will be hosted on Azure. I have a system which will allow users to specify custom characteristics for their objects which they will track over time. I am certain ...
0
votes
0answers
13 views
Dynamically retrieve associated data in View
I'm afraid on StackOverflow this question might be rejected as "opinion based".
I'm using CakePHP 3.7.9 and in one View I have a form with a select and a number input:
echo $this->Form->...
-4
votes
2answers
73 views
What are distributed transactions supposed to satisfy?
I am lost when reading Design Data Intensive Applications.
In a nondistributed database system, nondistributed transactions are to satisfy ACID.
In a distributed data store, what are distributed ...
1
vote
1answer
79 views
Write complex query OR write simpler queries and combine the results in Backend service?
Take the following statement for example:
'Get results for ALL Active students of a Course'.
Naturally, this query has 2 parts,
Get all active students of the course.
Get results of those ...
3
votes
2answers
108 views
For Evolutionary Database Tools like Flyway or LiquidBase, it is better to integrate the tool or left it as a stand alone step in the CI process?
Although I believe my question is language and DB agnostic, I will provide the specifics technologies in this case study because it might help understanding my question (sorry for my English).
It's ...
1
vote
2answers
53 views
Improving the usage of a database with a low number of connections available
I'm currently with with a Progress ERP database, which has two connection brokers: 4GL (aka ABL-used by the "desktop" apps) and SQL-92 (for any other language to connect, using ODBC or JDBC).
The ...
1
vote
0answers
56 views
Database vs Logs - Persistence approach evaluation
I have a node js app, in which I need to perform background jobs. My plan is to use a data structure which will contain all the jobs needs done. My design also suggests that this data structure needs ...
-2
votes
1answer
288 views
How to represent in a flowchart data fetched from a database
I have an existing piece of code that uses a database. In order to understand its algorithm, I try to represent it with a flow chart. In this algorithm I need to fetch some data from the database in ...
-3
votes
3answers
195 views
If data is stored in RAM, do we still need index into data?
Is the purpose of the indexing data structures to address the limitations of disks?
If data is stored in RAM, do we still need index into data? Thanks.
Question comes from Design Data Intensive ...
3
votes
2answers
319 views
Database design - maintaining versions of an object
Suppose I've a Person object. This Person object in turn is having name, address, accountNumber and many other fields.
Now my requirement is that I want to maintain multiple version for each person ...
