Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [nosql]

Databases that propose alternative solution to SQL (Relational) Database which can be document oriented, key/value, graph, objects,...

0
votes
0answers
2 views

Nosql one to many relationship, search and paginate on both entities efficiently

I have products and their brands, Earlier my mapping was { "product_id", "product_name", "brand_id", "brand_name", "city_id", //other filters associated with product } it was working fine until i ...
11
votes
5answers
675 views

My team is scared of relational database entities with foreign key relationships and I don't understand why

I'm relatively fresh out of college so most of my familiarity with relational databases is from my databases course where anything not in BCNF or 3NF is a travesty. Certainly that's one end of the ...
1
vote
1answer
36 views

Some Guidance on Parent-Child Relationships in Elasticsearch

I would like some guidance in setting up my document structure Elasticsearch. The company I work for has an app that stores around 20,000 new phone records each day in a SQL database. And we feel we ...
0
votes
2answers
59 views

Most efficient way to get unique customer count

I'm working on a system that stores details of customer purchases for several stores. One statistic that they would like is to know how many unique customers they have had over a specified day range, ...
0
votes
0answers
29 views

Alternatives to RDBMS For Forecast Data

All, I currently capture well structured forecast data in a SQL Server. An example of this data is below: What this tells me is that each day, I receive a forecast for the next three days. Note ...
1
vote
1answer
43 views

Regarding data modelling in a NoSQL use case

I am reading the following link to learn about system designs of various systems. https://www.educative.io/collection/page/5668639101419520/5649050225344512/5673385510043648 (This is a paid link, I am ...
0
votes
1answer
52 views

How to implement scalable RBAC library/service?

I need to design and implement a RBAC (role based access control) library to protect RPC calls. A role is a list of verbs (RPC methods). One should be able bind a user (or group of users) to a role ...
3
votes
1answer
106 views

How to think about queries in NoSQL

I'm writing a project for school - Tinder-like app. I thought of implementing database entirely in RDBMS (PostgreSQL). But now I think it's a good opportunity to get to know NoSQL systems a bit. I'm ...
2
votes
2answers
111 views

How to model JSON data so it can be easily de-serialized in to simple Java classes?

Context Currently I'm struggling with correctly modeling a small instruction set I want to send as JSON to an Android application to generate a list of UI parts. Right now it's layered as pretty much ...
1
vote
0answers
41 views

Giving search on customizable fields

I have some user defined custom fields corresponding to a ticket (A ticket is an entity which has subject, status and custom fields). I need to search tickets based on its custom field values. A ...
5
votes
2answers
278 views

How is Eventual Consistency (EC) better than Strong Consistency (SC) when N = 3, R=W=2 when SC gives better consistency gurantee in same config?

In dynamo paper, it says that in production most of the users set N = 3, R = 2 and W = 2. The common (N,R,W) configuration used by several instances of Dynamo is (3,2,2). These values are chosen to ...
5
votes
1answer
179 views

Achieving scalability and ACID with a RDBMS to NoSQL streaming solution

My understanding is that the main feature Cassandra has to offer is linear performance at any scale; meaning that if I know 1 C* node can handle 500 queries or commands per second from my app, then I ...
0
votes
1answer
89 views

Application analytics - Logging with NoSQL/RDBMS, BigData [closed]

I need to architect a system for my company. My question is specific to logging. Part of the requirement is to log 2 kinds of data. A1. User events (Ex: UserA clicked on Button1, performed Action#21. ...
1
vote
2answers
986 views

Should I use NoSQL (MongoDB) or SQL (postgresql) database for my application?

I am planning to build a live audience interaction webapp similar to Slido as practice/fun project. User groups: admins and anonymous users Admins: login create event (define event period and ...
0
votes
0answers
41 views

Design The Key in KV Store

How keys should be designed in a Key-Value Store? For example if there is a need for querying users based on their emails (a manual secondary index), should the key be user:email_index:user@domain....
3
votes
2answers
103 views

API-oriented databases: is it maintained by the back or API team?

From what I understand, no-SQL databases differ from SQL databases because they allow the developpers to designe the tables to fit the usage, rather than fitting the model. Which means most of the ...
1
vote
2answers
346 views

Maintaining user avatars

The issue at hand is dealing with user avatars that come from their social media accounts. When a user signs up with our app, the user will use his/her social media account and we simply save the URL ...
0
votes
2answers
429 views

Migrating an Application from SQL to NoSQL [closed]

I am faced with taking a mvce's for SQL which happens to be the WideWorldImporters Database from Microsoft and migrating it to a NoSQL on mongodb. The system in question may use certain fractions of ...
0
votes
3answers
678 views

Can traditional SQL databases be fully replaced by NewSQL?

I've recently learnt about "NewSQL" databases like: Google Cloud Spanner (proprietary) Microsoft Azure Cosmos DB (proprietary) CockroachDB (open source) also see How does CockroachDB compare to ...
2
votes
0answers
668 views

NoSQL data modelling for multi level nested documents

What kind of NoSql data modelling is best suitable for the following requirement? This can be visualised (NoSQL-Document) as a Collection of Records where each Record contains nested Documents.The ...
-3
votes
1answer
1k views

NoSQL vs SQL for creating an inventory database [closed]

I've been reading a lot of comparisons between NoSQL and SQL. I feel like NoSQL might be the way to go but I'm still uncertain. So here's my example: I want to be create an inventory system. There ...
2
votes
1answer
190 views

How to make a basic database application, previously developed for 500 records, ready for 1 million records?

I have written a basic web app in PHP, using MongoDB as database engine. The app basically inserts records into database as they become available, and queries the database and displays the data as on ...
3
votes
2answers
254 views

Which database technology to choose for storing (post + replies) threads

I am designing for a new application and I don't want to suffer later for the performance that manges discussion threads (posts + replies, very similar to Facebook or StackOverflow posts). I wonder ...
1
vote
1answer
555 views

Should I use NoSQL or RDBMS for materialized view in this CQRS / ES implementation?

I am going to try to build a implementation of CQRS and ES for large scale application (1M users) authentication API. Below is my initial architecture draft (Ignore Azure related stuff). I am going to ...
2
votes
1answer
91 views

Where should my method(s) that connect to DynamoDB go?

I'm a Java developer working on a new module for my app that connects to, inserts, and updates DynamoDB information. For a lot of our projects, I used an MVC design pattern with a service layer to ...
2
votes
1answer
1k views

Implementing tags in object

In my app, I'm implementing a questionnaire system and I'd like to implement tags for questions -- very similar to tags in questions here or Stack Overflow. I wanted to get some advices on how to ...
2
votes
0answers
228 views

Replication between SQL server and Couchbase Lite

We have a main MS Sql server. This is the main data source that delivers and receives data to and from backend administration and (in development) mobile software. We need to make a connection to ...
0
votes
2answers
122 views

Dealing with Image data redundancy in a NoSQL table

Say I have a database structure like this: CREATE table Customer (id identity, name varchar(30), dateofbirth datetime, Photo varbinary, primary key (id)) CREATE table Order (id int, Date datetime, ...
2
votes
2answers
2k views

Store and Tag Millions of Images

I am building an application where I need to store millions of images and later tag them. The tags attributed to the images could change over time as the tagging system evolves. Images will then be ...
1
vote
2answers
353 views

NoSQL or SQL for my situation? [closed]

I'm sure this has been asked multiple times but for me it's more specific as I know what I'm building. I wrongly posted this to stack-overflow (now removed) so I'm hoping this is the best place to ask....
2
votes
2answers
682 views

NoSQL/Mongo: Best practice for modeling 1:1 “relationships”?

I come from many years working with SQL Server. I am working now on a mobile game using GameSparks as the back-end which only supports NoSQL run on Mongo. I am creating a Computer Card Game and am ...
0
votes
1answer
57 views

API parameter to “include” resolving ids to objects

I have a NoSQL repository with two tables, Foo and Bar. Each Foo has some metadata and a list of Bar ids. Each Bar has some metadata. I'm writing the API for retrieving a Foo and would like to ...
4
votes
1answer
321 views

In what way is an XML database different from (is not specialization of) a graph database?

XML is labelled tree, a special case of graphs. So, why there are separate XML databases and why is it that XML is not stored in graph databases? At a first glance it seems so easy - one should map ...
4
votes
2answers
1k views

NoSQL & DDD: Is it OK to have two model classes for same entity b/c I have it partially duplicated in DB?

I have a NoSQL DB with parts of my data denormalized and duplicated. For concreteness, let's say I have: A document set called "people" containing full specifications of people. A document set called ...
0
votes
1answer
226 views

Where to enforce relationships with NoSQL?

The team i'm in is moving to use couchbase rather than elasticsearch DB. Now this is only an example but my question is more general. In elasticsearch you have the notion of parent-child ...
0
votes
0answers
112 views

Non HBase solution for huge data that has update and delete in sequential manner

I have to design an application where there are around 5K structured base text files (file.txt) with data and format as below: Primary key is OrgId + ItemId OgId|^|ItemId|^|segmentId|^|Sequence|^|...
-1
votes
2answers
954 views

MySQL 5.7 json type or MongoDB document?

I'am working on a project that use MySQL as RDBMS. Recently, we have to manipulate a big json data. So, the first solution that comes in mind, and for many reasons, is to cooperate mongoDB with Mysql ...
0
votes
2answers
196 views

Should I move to In-Memory tables and stored proc or NoSql (CosmosDB) [closed]

I have a lot of data. Objects with other objects nested like this (JSON): { id: 12, Code: "a code", country: "at", prices: [{ { price: 100, from "2017-05-05", to "2017-06-05" }, ...
0
votes
1answer
97 views

Designing a schema for generic objects

I'm making an simple application that involves books, using a NoSQL database (MongoDB) -- I think I need to make a DB/schema that stores generic books and their information (title, author, etc.) and ...
-3
votes
1answer
165 views

Choose NoSQL database type

I have an app and a list of all the actions a user has done while using it. To put an example, for each user I have data like this: "start" "country":"aa" "session":"0" "menu":"main" "menu":"play" "...
-1
votes
2answers
163 views

Using NoSQL as MQ and for maintaining state

Currently we have an application that doesn't scale well because of multiple concurrent updates to a table which gets locked. The tech stack is ASP.NET and backend is in SQL Server. To avoid database ...
9
votes
2answers
3k views

Where to put business logic if using Firebase?

I'm about to start developing a single page web application that is very simplified a multi user documentation system. The front end will probably use Angular2. The project has a short deadline, so I'...
2
votes
1answer
473 views

MongoDB schema for tracking matches

This is the first mongo-backed-application I am trying to make beyond tutorials, so I lack imagination when it comes to document schemas. Context: On a dating application, there is an algorithm that ...
6
votes
1answer
347 views

Using key-value NoSQL DBs relationally

I am new to NoSQL and have always heard of "key-value" DBs like Cassandra or Riak and expected their tables to literally have two columns: a key-col and a value-col. I just started working at a new ...
0
votes
1answer
344 views

MongoDB capped collections

I'm not really sure if that is right "stack" to ask that question, well two questions actually. What's the potential use for capped collections? (besides logging) Capped collections cannot be sharded,...
0
votes
1answer
60 views

Store active item in an array

In a NoSQL database (MongoDB), I need to store a list of creditcards for a user and to keep track of which one is active. I came across 3 patterns: #1 Keep the active property in the Creditcard ...
4
votes
1answer
293 views

What technical approach does NoSQL databases use for fast key-value access

For example, In NoSQL, technically replication and sharding approach is used for supporting large data. Was reading this article about NoSQL use cases. It mentions that NoSQL can be used for ...
0
votes
1answer
126 views

What is the meaning of sharing state between processes?

The author here states that: Share state between processes. Run a long running batch job in one Python interpreter (say loading a few million lines of CSV in to a Redis key/value lookup table) and ...
4
votes
1answer
129 views

Fast Upload/Retrieval For Blob Data Solutions

Problem I am currently investigating a solution to allow fast upload (and retrieval) of data that can be implemented via NoSQL/SQL or a file system on a Centos server with 64 core cpu with 529GB of ...
-1
votes
2answers
153 views

Relational or non relational database for my described application?

I want to design and implement a mobile application in which: Every user who have already registered is able to add new news (including title: text plus a picture, and content: long text, pictures or ...