Questions tagged [database]
This tag is for general database questions; if you question is specific to SQL use that tag instead.
-1
votes
0answers
31 views
How to handle big data import into web application? [on hold]
Users need to upload 10 Gigabyte of contact data into my web application.
What would be a best practice approach?
0
votes
1answer
69 views
ER Diagram in Barker Notation
I engineered an ERD diagram using Barker's notation.
The problem was to make a database for system of water pipes where one node is connected to another using a section (pipe), each node can have ...
3
votes
1answer
77 views
Database structure for word co-occurrence frequencies in a large corpus
I would like to store the frequencies with which words co-occur with each other over a variety of contexts in a large (> 1 billion tokens) text corpus. I need to store the word pair, the type of co-...
2
votes
1answer
62 views
Allow client side direct access to the database [duplicate]
I am asking advice from the SQL graybeards. Because my following proposition goes against everything I have practiced.
In this instance
Let's assume we are developing a phone app. A social network ...
0
votes
0answers
20 views
ACL entity and microservices database relations
I would like to build a microservices architecture to handle the following scenario:
I have a building. The building has some kinds of devices. And the devices can be used by the users. In the system, ...
1
vote
0answers
91 views
How to store relational data belonging to different client customers?
My users will be businesses with a small number of accounts each: e.g. Business #1 with 3 users, Business #2 with 5 users, etc.
I am trying to determine the best way to organise the relation (on ...
1
vote
8answers
617 views
Is there a way to prevent developers leaking data while they are developing?
I am working with a startup company for a while now. They have been affected by some reckless developers in the past. One area they want a real and immediate improvement is when they assign a task to ...
1
vote
2answers
71 views
Storing and searching a vast database of text [on hold]
I am building an application to search through a large number of comments. Currently I am storing the comments in an sqlite database, but it has grown to around 40GB in size and even with FTS5 ...
0
votes
0answers
33 views
What architecture is the most adapted for a shared balance in Nodejs (and maybe Redis)? [closed]
I need some kind of fast micro-services using nodejs to share a common balance between several services. Several services can change this balance , so the balance must guarantee that the operation ...
1
vote
1answer
76 views
About databases in docker containers
I'm trying to understand containerized apps and databases and I'm trying to understand the microservice architecture using kubernetes. One thing that I couldn't get my mind convinced is the database ...
1
vote
1answer
80 views
Approach to handle network breakdowns in application dealing with database?
I have an application that writes data to database. In case of network breakdowns, the connection to database gets lost & my db queries freezes the whole application.
So, in order to make it ...
2
votes
1answer
143 views
Unit conversion of data
My team is developing a web application, where we have in the requirements to display the data in multiple unit which is set by the end user.
Where should we write down the unit conversion logic, on ...
0
votes
1answer
38 views
How do database storage engines handle new columns?
I really don't know which StackExchange site this belongs on. It didn't seem to match the "on-topic" list of DBA.SE or SO.SE ... so please let me know if I should move it. I also couldn't find a ...
0
votes
1answer
143 views
When is the point where a JSON text file storage is not enough?
I guess it was Robert C. Martin who campaigned against using SQL in one of his apps, where he was just fine without DB and SQL initially. Later, thanks to the abstraction a DB implementation could be ...
0
votes
0answers
27 views
Object Data must be built on SQL side or in Code Side?
I am thinking of a very flexible application that will build a single entity object from a lot of tables joins. example for an object "Car"
with a code something like this
SELECT e.id, a1.attr_value ...
2
votes
1answer
115 views
Who (and what) should have direct access to a database, and why?
I am developing a chat application as my the first project. I have never had experience of establishing a connection to the remote database server before so I don't really understand who should have ...
1
vote
1answer
71 views
Does a microservice's individual database need to have complete data?
Say you have a Users and Orders service and they have their own database.
Since microservices need to stand on their own even if another service is unavailable, does the Orders DB need to have all ...
1
vote
1answer
43 views
Database structure for an app used to capture data in warehouses
I am in the process of creating an android app for our clients that would replace the paper-trail in their facilities with electronic inspections.
Although I have coding experience, I have little ...
0
votes
1answer
68 views
Database schema for products and their packages
The product is water purifier, and we are selling packages included support for changing filters.
Serial is a unique number identifying a single produced item and it's only for water purifiers not ...
2
votes
1answer
206 views
How to handle database connection password?
I have a question about using databases in my application. I have the User table which stores password for my users. I know how to handle user authentication, but how to handle the password for the ...
0
votes
0answers
26 views
How to store message content in a webservice
I am building a service responsible for sending email/sms communications. The service receives a request that contains information necessary to build an email/sms template and the recipient ...
0
votes
4answers
117 views
Could you please recommend an approach on converting non-unique field to a unique field?
On our prod db we have two tables:
companies
invoices
Relationship:
A company has many invoices
An invoice belong to a company
The invoices table contains duplicate invoice_number for each company. ...
1
vote
2answers
138 views
What is the best model to catch DB side error?
We have a web application that all update, insert and DB operation procedure handle via SQL Server DB 2017. What is the best way to handle and get error (in Web-app or SQL server error handler?). for ...
0
votes
0answers
40 views
Designing database relationships for a voting application
So I designed database relationships for a voting/polling application. I want a user to only be able to pick 1 option on a poll. I want multiple options per poll.
So what I have here is this.
User
...
0
votes
1answer
60 views
Multiple stored procedures or 1 with parameter
I need some advice...
I started working at a financial business world recently.
Looks like the DB architect uses auto generate function to create stored procs. At the end, we have way too many procs ...
-2
votes
1answer
145 views
Mock db out or not during testing?
I am writing an app that mainly consists of just creating, editing and reading records in database. I was persuaded that any app has to be covered with tests. I was told that it's a good practice to ...
15
votes
4answers
2k views
Why not use SQL instead of GraphQL?
Recently I learned about GraphQL which claims to be superior to RESTful. However, I started wondering why don't we simply put SQL statements into an HTTP GET request.
For example, in GraphQL I would ...
-2
votes
1answer
73 views
Generate HTTP RESTful server from database schema
Today the job of most Java-based servers is to translate HTTP requests into SQL commands/queries and send a JSON-ed response back to the client. That's a pretty generic (and honestly boring) job.
I ...
6
votes
4answers
595 views
Am I right in writing our own database migration/versioning software?
I have started work on writing a tool to version the database schemas we use at work and enable migrations under version control. My first research into existing tools turned out to be too cursory due ...
1
vote
2answers
140 views
Small databases online
This is to ask whether accdb databases are suitable for this application, and how to connect the user with the database (and the phone network with the database if anyone has a comment on this).
I ...
0
votes
0answers
43 views
How to design database tables for complex build of materials as product models?
I need to redesign a 10 year old Product Management Portal and underlying Data-model. There are build of materials as products in the system.
Product managers update pricing frequently for products. ...
0
votes
2answers
61 views
Is it worth to use a sql db for just two columns (possibly extensible)?
So, first of all hello to everyone, I hope you are having a good day :)
I will give you a little context. I coded a program for my job, in which I save to a database Errors ID and their solutions. It ...
6
votes
3answers
571 views
How should I design database, where I have 30 users, each who needs full access to their data?
I work for something like a consulting company. I have a web application that I built for one client. Now around 30 other clients want about the same product. The problem is, I don't know where to put ...
0
votes
2answers
95 views
Database agnostic DAO (NoSQL + SQL)
Background
While writing a new component, I m in middle of making a decision of SQL/NOSQL database (Mongo vs Mysql) for my storage layer. As of today, mysql seems to be a perfect fit for my use-case (...
0
votes
1answer
62 views
Custom service layer logic vs Custom DB query
I am trying to confirm best practice around architecture I am working with.
Frontend <-> API gateway <-> Service layer (Rest API) <-> DB
I have an incoming request which is asking for huge ...
1
vote
2answers
117 views
Multiple use/semantics of the same database fields - is it acceptable practice?
I have ERP database whose good or person entities each have several hundreds of fields. Many of them are used for some subjects only. And hence senior companions (especially from the business division)...
0
votes
1answer
169 views
An approach to writing database applications [closed]
I'd like to share my approach to writing database applications for small businesses. It's possibly unconventional, but it's something I have been developing for nearly 20 years.
The approach I use is ...
1
vote
1answer
39 views
Storing answers of a form builder where question sections may be repeated N times
I built a form builder with which administrators of the system I work on can build forms (or blueprints as we call them). The structure of these blueprints are as follows:
blueprint X
section 1
...
1
vote
2answers
119 views
Real Time Web Sockets Architecture
I am confused here on how real time analytics is accomplished with web sockets when data is inserted into the system via a REST API. In my (admitted immature) understanding of web sockets, you have ...
1
vote
1answer
53 views
different data connectors for different objects and users
I have an application which needs to store different objects in different data stores based on the user's authorization credentials. I.E. the user may need to save object 1 to their BI postgres ...
1
vote
1answer
64 views
Check if object exists before updating/deleting
In an application that doesn't use an ORM, is it good practice to check whether an object exists before attempting to update/delete it?
For example:
@Route(method="DELETE", path="/posts/\d+")
...
-2
votes
1answer
44 views
Preuso/empty entity or only real entities + nulls?
I have a table "products" and a child one "product_modifications"
Some products have "product_modifications": "colour", "size",, .... But not all.
When a client orders a product, views pictures and ...
11
votes
5answers
731 views
My team is scared of relational database entities with foreign key relationships and I don't understand why
I'm relatively fresh out of college so most of my familiarity with relational databases is from my databases course where anything not in BCNF or 3NF is a travesty. Certainly that's one end of the ...
3
votes
2answers
133 views
How to improve code quality in database driven applications
I'm working for a company with a big ass legacy codebase. Changing existing code is like a guarantee to break things. Most functions are a few thousand lines, using some global flags, having different ...
0
votes
2answers
97 views
Referencing Database Primary Keys from Codebase
I don't have a lot of experience with these kind of issues, but I feel I need to consult on this issue. The current codebase I'm working on is using what I consider to be a questionable technique to ...
2
votes
4answers
145 views
What is the name of DB design pattern which support only soft-deletes and soft-updates?
I heard that there is some DB design in relational databases where updating a record will create a new record with different timestamp or status. Also, deletion will be soft-delete (it updates the ...
4
votes
1answer
75 views
Maintaining parallel libraries: Binary files access + Metadata Database ORM design
I'm dealing with a higher-level data abstraction that I would appreciate some input on.
I'm working on an application that uses a large data lake. The data lake is consisted of thousands of large ...
3
votes
1answer
100 views
Auto incrementing from two different points on the same table?
Each customer has an ID. For every new customer it's incremented by 1.
My company is wanting to start selling to a new type of customer (lets call it customer B), and have their ID start at 30k on ...
4
votes
4answers
203 views
Splitting application into multiple but keeping database same
I have a medium scale e-commerce application. Over a period of time our monolithic project got quite heavy in terms of code base. I was exploring the solutions for it and found micro-services is one ...
0
votes
2answers
72 views
What is the best method to avoid company data duplication in mixed B2C and B2B product in account creation?
I'm building a user license portal, store, SSO, and mini CRM and admin for internal people to manage those users for a niche 3D software company, similar to Autodesk. Licenses are sold to both ...
