Questions tagged [database]

This tag is for general database questions; if you question is specific to SQL use that tag instead.

Filter by
Sorted by
Tagged with
2
votes
1answer
44 views

Projects version and database compatibility

We are trying to fix our's company versioning of several modules and I'm not sure how to consider Database compatibility when versioning. The same Database is used for a lot of applications and we're ...
-1
votes
0answers
32 views

Best architecture for sharing large amount of data in a large distributed system?

Context: a large distributed system that has multiple data sources (services backed by OLTP databases) and multiple data sinks (data processing jobs, reporting, etc...) maintained by multiple teams in ...
0
votes
1answer
73 views

How do you name “*_statuses” for multipe tables so that there'll be some pattern in the names of the statuses?

I have the following entities in database that have a corresponding table "entityN_statuses" associated with each of them: * products * refunds * payments * users * etc... The &...
-2
votes
2answers
58 views

Is it okay to keep open the MySQL database connection open through out the Application or open and close connection query-wise?

I'm developing a REST API using Nodejs along with MySQL as the database.Is it okay to keep open the MySQL database connection open through out the Application or open and close connection query-wise ? ...
-5
votes
1answer
31 views

How is data stored prior to downloading?

I go to several sites that offer their data in XML, JSON, CSV formats. As shown here, https://www.space.org/basicspacedata/query/class/boxscore/format/csv, I choose the format. Question is how is ...
2
votes
1answer
83 views

How to handle db password change in a live service

Suppose I have a REST application running on a remote server which connects to a mysql database. Now let's say the password of the db has to be changed. What are the right methods and practices that ...
1
vote
0answers
16 views

Firestore implement Notifications View

So to begin with this question is not related to Push Notifications. What I want to achieve is a View in which all notifications are displayed. Something like Instagram or Facebook. There could be a ...
2
votes
1answer
65 views

Use one table and a “type” column to represent two types or use separate tables?

I am building a blog system, the blog can have its comment. And like to provide the upvote/downvote feature for both the blog and comment. Since the vote count number of blog/comment should be ...
-2
votes
0answers
26 views

How do I improve a data/media storage application?

We have a software product which is used for storing data. We have windows services in our system which makes api calls and the data we get in return is mostly in .csv, .mp3 or .wav format. CSVs are ...
0
votes
1answer
109 views

Is it a standard practice to have a single application/controller writing to database

I've been interviewed by some experienced engineer, when he strongly disagreed with some statements I said: Assuming full control over your applications, It's a standard practice to make writes-to-...
2
votes
5answers
240 views

How can billion integer ids be stored and specific ones checked for existence most efficiently? (persistent solution, not just in-memory)

Let me preface this by saying that I am familiar with RDBMS. I have a solution using mysql/mariadb but I am not happy with the efficiency of the solution so I'm looking for alternatives. I'm trying ...
-3
votes
1answer
57 views

Relation between the different types of database sharding [closed]

I try to understand the different types of sharding that is possible for a database. Is it true that horizontal and vertical sharding are the two main types of sharding, and that the others approaches,...
-3
votes
1answer
51 views

SQL Server: Which License? Any alternatives?

I'm working on a project which at the moment is not being used for any commercial purposes, and I'm managing the data by using a SQL Server Database. I read here that I should pay for it if I ever ...
-1
votes
1answer
30 views

Android Chat Application Architecture with websocket

I'm trying to build chat application in Android (future maybe webapp also) using websockets. The purpose of this project is to familiar with websockets, get know websockets and real time applications. ...
-3
votes
1answer
77 views

Is splitting unit tests from integration test with mocks worth the effort (in nodejs)?

Well consider a relative simple server for a SPA application. Written in nodejs with express and knex as backends. Now if we do it properly each function will have unit tests (as they are always all ...
-1
votes
0answers
56 views

Can MongoDB store structured data or is it only used for semi structured data?

I am trying to build an application that will scrap data from a website and then I will apply a transformation algorithm on the scrapped data and store in the database. I want to use mongodb ...
1
vote
2answers
50 views

How to handle manual corrections to data in ETL pipeline

We receive product data from vendors on a regular basis to be incorporated into our catalog. The data looks like this: [ { id: 123, collection: Spring, name: New Beginnings, size: 8, price:...
1
vote
1answer
25 views

Organizing Data with Specific Group in Objects and Lists

So recently I have been working with a large-scale app that has a large number of individual objects with specific group attributes. For example, I have a list with objects such as {Name: "Todd", ...
0
votes
2answers
45 views

Live data migration - double read vs double write

Pretty often I have a need to migrate the location where some data is stored - to a new column, a new table, or even a new data store. And usually this needs to be done with no down-time. I can see ...
0
votes
0answers
35 views

How to seperate user data in database models?

I am writing a webservice for research and learning purposes and try to find an approach to seperate user data from other users to ensure a request can never deliver or reveal data from another user. ...
-2
votes
1answer
78 views

Designing a sqlite component in C++

I work on a small component in an embedded device (sensor). This component : Every 5 seconds, sends requests to other components using sockets (get health check status, operating status etc) and ...
2
votes
3answers
111 views

Does the Controller contain get methods in MVC?

I am at the stage of implementing a my 1st ever view, after developing a Model and Controller, however there is a problem. I have been reading this article on MVC, which is what I have been aiming ...
3
votes
2answers
246 views

Storing a function body inside a database table

Let us say that for a web application, inside the source code of the app you created a function called calculateAmount. Inside the web app, you need to call that function. But for some reason, due ...
1
vote
0answers
29 views

Offloading database joins to IOT devices

Solution as it is right now I have this solution where I gather information from a proprietary product of a different company in various sites. The solution is based on a single go binary that ...
-2
votes
2answers
62 views

Re-runnable db alter scripts

Is there a standard on db alter scripts (both data and ddl), should they be re-runnable if so what are the reasons for making them re-runnable. The only web pages I could find are telling me how to ...
0
votes
2answers
122 views

When placing an order in a shop, should a snapshop be taken of the products in an order also?

...to prevent messing up with data updates, such as prices, titles, of the products that are placed in an order. Namely, a customer buys 3 items: for $5, $10 and $33 and pays for them. All is well. ...
-1
votes
2answers
132 views

When should I use a database instead of a list? [duplicate]

New to Python and all things database related. Wondering when I should consider using a database and why? I have what is essentially a list of objects that is around 30000 lines long. I'm developing a ...
-4
votes
1answer
42 views

How to create a quiz app without multiple choice?

So I'm trying to make a quiz app where the answers should be typed rather than multiple choice. However, even though there is always one right answer, in english, we have many ways of writing the same ...
0
votes
2answers
88 views

What's the pattern to share database to other module in security perspective?

In a large iOS application, I have a database module which is dedicated to handle application databases with read/write public APIs for other module. UI module has a feature to share the database, in ...
-1
votes
2answers
102 views

Splitting large table into multiple tables

Let's say I have a astonishingly big table (300 columns) with lot's of records (in the millions). This table is overly complicated to use. I'd like to refactor this table and split it in multiple ...
5
votes
2answers
700 views

Are bank transactions run with DB transactions?

The classic example for a transaction is withdrawing money from a savings account and depositing it to a checking account in the same bank. Yet I have the suspicion that DB transactions are ...
0
votes
1answer
40 views

REST action as part of request body - action not stored alongside entity

I am working on an API that allows a client document to updated under the endpoint of PUT /client/{documentId}. As part of this document, I need to include an extra field 'ReplicateInManager' that ...
-3
votes
1answer
44 views

Defining Database vs Service-level Entity [closed]

I have a demo application, which have customer and their order information. If I had a database, data will be stored in table as below, Customer : id | name | Address Order table : (for ...
0
votes
0answers
37 views

Multi-store E-commerce Database Users Table Design

I am developing multi-store e-commerce platform Restful api. I am stuck at users table design. Platform users has 3 different role thats Admin, Customer and Merchant. Admin user just have a user ...
-3
votes
1answer
33 views

How to manage source data for movies and series?

I am trying to build a system that tells the user on which platforms (like Netflix, prime, etc.) a movie or series is available. What is the best way to go about it? I have considered the following: ...
-2
votes
1answer
44 views

Design a database with multiple relations and tables

I'm struggling to find how to correctly design a database in order to store and retrieve data for my software. Basically, I'm designing an application for a gym (C++, MySQL with PhpMyAdmin): each ...
0
votes
1answer
36 views

Equivalent attributes and normal forms

A relation R(A,B,C,D) is given. C and D are equivalent (C is the course ID and D is the course name, one implies the other). C and D are prime attributes. Does that violate the requirement of 1NF ...
-4
votes
1answer
62 views

Novelty of relational model in historical context

The question/title might be ambiguous, so please feel free to improve (or even migrate if necessary) it. My primary concern is what are the innovations of relational model/theory/databases? (In ...
-3
votes
1answer
46 views

How to call the process of filling missing data after a database upgrade?

My webapp is periodically collecting data samples (say of type A and B) from some web services. Its database has therefore columns for A and B. So we have values A1/B1, A2/B2 etc. Requirements have ...
2
votes
1answer
152 views

How do you approach one database per developer when working with a very large databases?

In our production environment we have a large database (SQL Managed Instance), roughly around 400-500 GB. We create a copy of this database and use it to restore in our development environment to ...
1
vote
1answer
44 views

SQL Database schema for Catering/Menu management

Background I'm building a Private Chef booking service where you can book a Chef to cook you a custom Menu. I'm having trouble creating a SQL db schema that accurately represents the domain while ...
0
votes
0answers
10 views

Node.JS/MongoDB/Mongoose route structuring

Thinking about some route/controller structuring here: Say I have a Company, under which it can have many Locations, and each Location can have multiple Forms. On the Company's profile is a short, ...
1
vote
1answer
73 views

How to approach deleting entities from database with foreign keys

In a microservice architecture I have a BREAD (CRUD) service that has methods for interacting with database that holds some number of different entities that reference each-other. I also use a Message ...
-2
votes
2answers
50 views

Is a JVM based dbms like Neo4J implemented ideally?

Since Neo4J is implemented in Java and therefore uses the JVM, wouldn't an equivalent graph database that is written in C++ / Rust or GoLang be more performant? Why would one decide to build a DBMS ...
-2
votes
1answer
31 views

Saving large files like Credit Reports in Data Store - SQL/NoSQL/ObjectStore

I am working on a project to save external credit bureau reports in database. These reports are typically big and could go from 0.5MB to 5.0 MB. Number of files will grow exponentially over the time ...
-4
votes
1answer
59 views

Is it better (from a maintenance perspective) to dynamically construct complex SQL queries using Jinja or String concatenation? [closed]

Two possibilities. Which is better, with respect to readability, maintenance and clean code: SQL injection can be disregarded. Constructing complex parameterized sql queries using python string ...
0
votes
0answers
31 views

How to model combinatorial information in RDBMS

I need to model the persistence of combinatorial information. For example, suppose that the combination of 3 attributes (A, B, and C) are used to reference a given product. Besides that, supposed that ...
1
vote
1answer
50 views

Storing, indexing and searching data using Azure with frequently updated fields. Multiple Sources

We have a multi-vendor marketplace (e-Commerce) system and plan to move our data structures into a polyglot architecture to improve the performance of reads (critical) and writes (not as critical). ...
-2
votes
1answer
53 views

Database design user user roles applications and features

We have multiple applications with different features. We want to create a central security system, where each user is assigned a role. Role has access to certain applications and features with in ...
-1
votes
1answer
41 views

How to execute a proper comparative performance testing?

There are two compatible versions of the same Product (e.g. database engine) that I want to compare to each other for the same input scenario (SQL query). The problems that I want to address at first ...

1
2 3 4 5
37