Questions tagged [nosql]
Databases that propose alternative solution to SQL (Relational) Database which can be document oriented, key/value, graph, objects,...
197
questions
-4
votes
0answers
34 views
Most efficient database for the location based statistics [closed]
I would like to create a simple application where I will show the tourists counts of a particular location with the tourist origin. For example Spain got 20 million visitors from which 5 million of ...
1
vote
1answer
22 views
Storage and partitioning in Cosmos DB
I'm working on designing a system for reporting/storing information on hardware devices (IoT-like), and trying to figure out how that would best be structured in Azure's Cosmos DB.
Every device will ...
-2
votes
0answers
40 views
Run fast queries on a huge data source
Today, I have a huge mongodb collection (+200 million documents, +500 GB) that aggregates data from a few different data sources. I can run queries veery fast when using indexed fields (1sec or 2 sec)....
1
vote
1answer
40 views
Firebase prefer separate collections over mixed collection?
I'm writing an education app and my current Firebase structure looks like:
Course
∟ Lesson
∟ Modules (Includes video, audio, text and quiz modules in one collection)
Where "Course", "...
1
vote
1answer
40 views
Query by NoSQL keys versus SQL hash
I am trying to decide between a NoSQL (MongoDB) or a SQL (Oracle) database for my project. This database will be used to store output files from a set of parameters.
I can model this as a MongoDB ...
1
vote
2answers
60 views
System design for filtering/sorting objects whose properties are stored in distributed storage
Imagine that we have a storage of objects O (can be in SQL, NoSQL, doesn't matter) where the object contains some property P_1 to P_n. Some of these properties are stored in storage S1, some in ...
1
vote
1answer
65 views
Uncertain of cache solutions for CAD models
I am running a personal project of offering 3D model generation as a service (in this case CAD model). Since most of the generation of 3D models take a long time, I thought about using cache to ...
2
votes
1answer
111 views
Is it recommended to use schemas on non-relational databases?
I'm trying to figure out if the use of schemas on non-relational schemaless databases like MongoDB is a recommended practice or a bad practice to be avoided.
I am doing research work and am looking ...
2
votes
3answers
91 views
How should I best structure my app when I want to sort a “parent” model by a property computed on another “child” model?
Question about OO-programming, functional programming, NoSQL, SQL databases, and software architecture
Hi all,
I am a intermediate-level self-taught programmer, and have been dying to get an answer ...
1
vote
1answer
80 views
Optimizing inserting/storing Large amount of data in database
We have a POST API that takes data from the Client and send it to different applications (Payment, Email, SMS). We also store all the data sent by the Client in a database for future analytics ...
0
votes
0answers
14 views
Design question: Parquet with “corrections”
We are loading in insurance claims data into Parquet on a daily basis for analysis in Spark. At a high level, each claim record has a date, claimant details and value of the claim. This works well in ...
1
vote
2answers
131 views
Designing database: split into different tables or group them together?
I am fairly new to database design and now trying to build my own forum-based application. The app will have nested categories as
countries > systems > levels > subjects
In every subject ...
0
votes
2answers
93 views
Gathering data from JSON fields in a relational database
I'm working on a small e-commerce solution which uses MySQL. At first there was an initiative by the boss to use MongoDB but I suggested relational database because there are lot entities with ...
0
votes
0answers
55 views
What is the correct way of setting and then differentiating between paid and free user in Firebase / Firestore?
I am developing a mobile application that will have both free and paid versions.
The way I see how I could differentiate between what is a paid and free user is to set a property isPaid on their ...
0
votes
1answer
29 views
Update items based on a read operations on same items is a bad practice?
DynamoDB is the database solution, I'm using to store my items. It's a NoSQL/Document database and I got a real problem on real-time updates of items.
First, the saved format is like
{
expiredTime:...
3
votes
2answers
432 views
How to update a NoSQL database and publish event atomically in an event-driven microservices architecture?
In an event-driven microservices architecture, services typically need to update their domain state and publish an integration event to a service bus at the same time (Either both operations complete, ...
0
votes
0answers
20 views
Efficiently querying for a set of objects for price comparison
I am designing a system where a user can input a budget and a query returns to them sets of objects that they can afford from different vendors. The system has 100s of different combination types (i.e ...
2
votes
4answers
483 views
Database agnostic DAO (NoSQL + SQL)
Background
While writing a new component, I m in middle of making a decision of SQL/NOSQL database (Mongo vs Mysql) for my storage layer. As of today, mysql seems to be a perfect fit for my use-case (...
0
votes
2answers
138 views
Some Suggestion about Data Modeling
I want to make a social game for Android. I am using NoSQL Based Database (MongoDB) and I am using NodeJs. I am using Android-Volley library to make POST and GET requests. But I am stucked on ...
12
votes
5answers
799 views
My team is scared of relational database entities with foreign key relationships and I don't understand why
I'm relatively fresh out of college so most of my familiarity with relational databases is from my databases course where anything not in BCNF or 3NF is a travesty. Certainly that's one end of the ...
1
vote
1answer
98 views
Some Guidance on Parent-Child Relationships in Elasticsearch
I would like some guidance in setting up my document structure Elasticsearch. The company I work for has an app that stores around 20,000 new phone records each day in a SQL database. And we feel we ...
0
votes
2answers
94 views
Most efficient way to get unique customer count
I'm working on a system that stores details of customer purchases for several stores. One statistic that they would like is to know how many unique customers they have had over a specified day range, ...
2
votes
1answer
59 views
Alternatives to RDBMS For Forecast Data
I currently capture well structured forecast data in a SQL Server. An example of this data is below:
What this tells me is that each day, I receive a forecast for the next three days. Note that in ...
1
vote
1answer
192 views
Regarding data modelling in a NoSQL use case
I am reading the following link to learn about system designs of various systems. https://www.educative.io/collection/page/5668639101419520/5649050225344512/5673385510043648
(This is a paid link, I am ...
2
votes
1answer
296 views
How to think about queries in NoSQL
I'm writing a project for school - Tinder-like app. I thought of implementing database entirely in RDBMS (PostgreSQL). But now I think it's a good opportunity to get to know NoSQL systems a bit.
I'm ...
2
votes
2answers
161 views
How to model JSON data so it can be easily de-serialized in to simple Java classes?
Context
Currently I'm struggling with correctly modeling a small instruction set I want to send as JSON to an Android application to generate a list of UI parts. Right now it's layered as pretty much ...
1
vote
0answers
42 views
Giving search on customizable fields
I have some user defined custom fields corresponding to a ticket (A ticket is an entity which has subject, status and custom fields). I need to search tickets based on its custom field values.
A ...
5
votes
2answers
301 views
How is Eventual Consistency (EC) better than Strong Consistency (SC) when N = 3, R=W=2 when SC gives better consistency gurantee in same config?
In dynamo paper, it says that in production most of the users set N = 3, R = 2 and W = 2.
The common (N,R,W) configuration used by several instances of Dynamo is (3,2,2). These values are chosen to ...
5
votes
1answer
229 views
Achieving scalability and ACID with a RDBMS to NoSQL streaming solution
My understanding is that the main feature Cassandra has to offer is linear performance at any scale; meaning that if I know 1 C* node can handle 500 queries or commands per second from my app, then I ...
0
votes
1answer
297 views
Application analytics - Logging with NoSQL/RDBMS, BigData [closed]
I need to architect a system for my company. My question is specific to logging. Part of the requirement is to log 2 kinds of data.
A1. User events (Ex: UserA clicked on Button1, performed Action#21. ...
1
vote
2answers
2k views
Should I use NoSQL (MongoDB) or SQL (postgresql) database for my application?
I am planning to build a live audience interaction webapp similar to Slido as practice/fun project.
User groups: admins and anonymous users
Admins:
login
create event (define event period and ...
0
votes
0answers
47 views
Design The Key in KV Store
How keys should be designed in a Key-Value Store?
For example if there is a need for querying users based on their emails (a manual secondary index), should the key be user:email_index:user@domain....
3
votes
2answers
104 views
API-oriented databases: is it maintained by the back or API team?
From what I understand, no-SQL databases differ from SQL databases because they allow the developpers to designe the tables to fit the usage, rather than fitting the model. Which means most of the ...
1
vote
2answers
953 views
Maintaining user avatars
The issue at hand is dealing with user avatars that come from their social media accounts. When a user signs up with our app, the user will use his/her social media account and we simply save the URL ...
0
votes
2answers
535 views
Migrating an Application from SQL to NoSQL [closed]
I am faced with taking a mvce's for SQL which happens to be the WideWorldImporters Database from Microsoft and migrating it to a NoSQL on mongodb.
The system in question may use certain fractions of ...
0
votes
3answers
1k views
Can traditional SQL databases be fully replaced by NewSQL?
I've recently learnt about "NewSQL" databases like:
Google Cloud Spanner (proprietary)
Microsoft Azure Cosmos DB (proprietary)
CockroachDB (open source)
also see How does CockroachDB compare to ...
3
votes
0answers
1k views
NoSQL data modelling for multi level nested documents
What kind of NoSql data modelling is best suitable for the following requirement?
This can be visualised (NoSQL-Document) as a Collection of Records where each Record contains nested Documents.The ...
-2
votes
1answer
2k views
NoSQL vs SQL for creating an inventory database [closed]
I've been reading a lot of comparisons between NoSQL and SQL. I feel like NoSQL might be the way to go but I'm still uncertain. So here's my example:
I want to be create an inventory system. There ...
2
votes
1answer
192 views
How to make a basic database application, previously developed for 500 records, ready for 1 million records?
I have written a basic web app in PHP, using MongoDB as database engine. The app basically inserts records into database as they become available, and queries the database and displays the data as on ...
5
votes
2answers
584 views
Which database technology to choose for storing (post + replies) threads
I am designing for a new application and I don't want to suffer later for the performance that manges discussion threads (posts + replies, very similar to Facebook or StackOverflow posts).
I wonder ...
1
vote
1answer
976 views
Should I use NoSQL or RDBMS for materialized view in this CQRS / ES implementation?
I am going to try to build a implementation of CQRS and ES for large scale application (1M users) authentication API. Below is my initial architecture draft (Ignore Azure related stuff). I am going to ...
2
votes
1answer
105 views
Where should my method(s) that connect to DynamoDB go?
I'm a Java developer working on a new module for my app that connects to, inserts, and updates DynamoDB information. For a lot of our projects, I used an MVC design pattern with a service layer to ...
2
votes
1answer
2k views
Implementing tags in object
In my app, I'm implementing a questionnaire system and I'd like to implement tags for questions -- very similar to tags in questions here or Stack Overflow.
I wanted to get some advices on how to ...
2
votes
0answers
295 views
Replication between SQL server and Couchbase Lite
We have a main MS Sql server. This is the main data source that delivers and receives data to and from backend administration and (in development) mobile software. We need to make a connection to ...
0
votes
2answers
155 views
Dealing with Image data redundancy in a NoSQL table
Say I have a database structure like this:
CREATE table Customer (id identity, name varchar(30), dateofbirth datetime, Photo varbinary, primary key (id))
CREATE table Order (id int, Date datetime, ...
3
votes
2answers
4k views
Store and Tag Millions of Images
I am building an application where I need to store millions of images and later tag them. The tags attributed to the images could change over time as the tagging system evolves. Images will then be ...
1
vote
2answers
412 views
NoSQL or SQL for my situation? [closed]
I'm sure this has been asked multiple times but for me it's more specific as I know what I'm building. I wrongly posted this to stack-overflow (now removed) so I'm hoping this is the best place to ask....
2
votes
2answers
813 views
NoSQL/Mongo: Best practice for modeling 1:1 “relationships”?
I come from many years working with SQL Server. I am working now on a mobile game using GameSparks as the back-end which only supports NoSQL run on Mongo.
I am creating a Computer Card Game and am ...
0
votes
1answer
63 views
API parameter to “include” resolving ids to objects
I have a NoSQL repository with two tables, Foo and Bar. Each Foo has some metadata and a list of Bar ids. Each Bar has some metadata.
I'm writing the API for retrieving a Foo and would like to ...
3
votes
1answer
502 views
In what way is an XML database different from (is not specialization of) a graph database?
XML is labelled tree, a special case of graphs. So, why there are separate XML databases and why is it that XML is not stored in graph databases? At a first glance it seems so easy - one should map ...
