Questions tagged [data-modeling]

Elaborating passive data structures based on the analysis of data requirements for the purpose of designing and implementing standardised data formats, databases and data processing systems.

Filter by
Sorted by
Tagged with
-1 votes
1 answer
178 views

Modeling a CSV file: What is the standard? Python or SQL?

I have a wide CSV file of about 350mb, and want to load it into a SQL database and properly model the data to make it easier to use for analysis. I could split the data into tables with python and ...
HappilyCoding's user avatar
0 votes
0 answers
22 views

3 QAbstractListModels versus 1 QAbstractItemModel

This is a simplified representation of the existing data structure I have in my code (The actual data structure is composed of classes), the data of which I need to display and modify via multiple ...
19172281's user avatar
  • 133
0 votes
1 answer
85 views

using same table for multiple features a bad coupling?

We are migrating a template that was a mere questions array questions [ { type:text, name:first, value:What is our name },{ type:radio, name:favourite fruits, value:[ ...
veritas's user avatar
  • 131
1 vote
5 answers
280 views

Data Modeling: Are technical concepts within a tool that implement a business entity entities as well?

I believe this forum is the correct one for my question, based on the community guidelines but let me know if not. It seemed like the best fit. I am performing a data modeling exercise to formulate a ...
Steven's user avatar
  • 229
0 votes
0 answers
22 views

An IoT client and MVC-based server. Data model with different fields per type?

The problem Let's assume such scenario: List of IoT devices (one model?) Each list item has (among other fields) a type field Depending on the value in the type field, device may report different ...
trejder's user avatar
  • 2,386
0 votes
2 answers
110 views

Tradeoff: Fetching less data vs having a simpler data model

We have 2 vehicle types in our system Car and Bike. Both can be associated with a Report. There are components in our system which operate on Report but when dealing with the report they need to check ...
tim's user avatar
  • 131
1 vote
2 answers
647 views

Should I duplicate or inherit a python dataclass which changes attributes based on the version of an API endpoint?

I'm working on a python library for a REST API.I'm using python data classes to represent the structure of the returned JSON The v2 of this API returns a slightly different object when compared to v1. ...
rsn's user avatar
  • 117
0 votes
0 answers
378 views

Python - Where do I store data classes which are common across different files?

I'm working on a python wrapper for a REST API. I'm using python data classes to store the shape of the JSON response of each endpoint so developers have features like autocomplete and objects they ...
rsn's user avatar
  • 117
2 votes
1 answer
236 views

User (Actor) data shared across Domains / Microservices

I have read through a number of posts on Software Engineering but am unable to find a suitable solution for the problem my team and I are trying to solve. We are building a system where we have ...
Richard's user avatar
  • 73
-1 votes
1 answer
315 views

How to model a ternary relationship in a graph-based paradigm?

Consider a context where we have Users saving Questions and adding personal Tags to them. In a graph-based paradigm, a first approach could be something like: (User)-[SAVES {tags}]->(Question) ...
ssn's user avatar
  • 71
1 vote
2 answers
993 views

How to document a NoSQL document-based data model?

How do you document the logical data model of a document-oriented database like MongoDB? For relational databases, Entity-Relationship diagrams or UML class diagrams are used. What is the practice for ...
ssn's user avatar
  • 71
0 votes
1 answer
66 views

Is there a difference between these two data models?

Let us say I want to store on a database a userID, their nationality and if they are from the UK their UK passport number. I could model this by having one table with userID as primary key, ...
Cap Barracudas's user avatar
1 vote
4 answers
377 views

Thinking about data as object vs table row [closed]

It often happens that we have a set of structured data. Let's say our data is about charitable organizations. I could turn it into a list/set of objects/structs: struct Charity { let name: String ...
Eerik Sven Puudist's user avatar
2 votes
1 answer
703 views

How to draw an aggregation relationship in the Crow's Foot Notation?

I was stuck on a relation description and unable to model it in the Crow's Foot Notation: Each individual vehicle is a particular model of a particular brand offered by the company (e.g., the XF is a ...
Fifnmar's user avatar
  • 186
3 votes
2 answers
408 views

What to do when putting logic into the database seems to be the only option?

I am currently working on an application that models a complex business process that consists of many steps, each having a 1:n relationship with subsequent steps. The software is written Java using ...
xgb84j's user avatar
  • 149
-1 votes
2 answers
125 views

How to change a data model

In my model a user entity has three attributes : ID, name, hasBoyfriend. I want now to change hasBoyfriend to boyFriendsNames which is an array of names . The user entity is used by many services. The ...
Cap Barracudas's user avatar
0 votes
1 answer
505 views

Can we do domain modelling or create domain entities/models in NoSQL like Amazon DynamoDB? If yes then how?

Recently I was going through an article (link at the end) on AWS for DynamoDB NoSQL and got to know that they are suggesting to only have a single table with certain access patterns in your NoSQL ...
Pulkit Gupta's user avatar
5 votes
3 answers
442 views

Rebuilding a legacy application : What about the data model?

I am currently rebuilding from scratch a product catalogue (to feed a shopping website). The existing legacy system is heterogenous, Long story short : The some products are stored in a FileMaker ...
user15083369's user avatar
0 votes
1 answer
86 views

Attributes at the fact table in dimensional data model

I know that a fact table in dimensional data model consists of measures and flags for an event or transaction. I also understand that it may contain date of the event. I have to design on fact table ...
Rajneesh Shukla's user avatar
3 votes
3 answers
2k views

What is the normal form of JSON?

This is going to sound like a trivial question, but I like to think it's actually a deep one. The simple quesiton is, "What is the normal form of a typical JSON object?" For reference, I ...
James Madison's user avatar
1 vote
0 answers
132 views

IoT Data Model Standards

I am currently trying to model IoT devices within buildings. I could start from scratch and develop the data model myself, but this seems like a common problem which will have been solved multiple ...
Kevin Brydon's user avatar
0 votes
3 answers
2k views

Introducing "status" column to an SQL table changes its definition

I saw this pattern in multiple projects I wrote: I create an SQL model for a certain type of entities and at some point, we realize that there's a need to store multiples types of the same entities. ...
d33tah's user avatar
  • 143
0 votes
1 answer
400 views

What kind of Relations should I have in my E/R Diagram

I am trying to create an Entity/Relationship Chen Diagram for a new APP. Scope is simple enough. I will have multiples types of users login through the same Login Form. What I decided to do... Is ...
Tygreton's user avatar
  • 117
4 votes
2 answers
702 views

Applying Domain Driven Design to an analysis driven domain

I am currently working on a domain that is fundamentally driven by analytics. I'll use a fictitious example to illustrate my question. Suppose the application is a service based on House Prices. The ...
Cosmica's user avatar
  • 87
1 vote
1 answer
3k views

SQL Database schema for Catering/Menu management

Background I'm building a Private Chef booking service where you can book a Chef to cook you a custom Menu. I'm having trouble creating a SQL db schema that accurately represents the domain while ...
narciero's user avatar
  • 111
2 votes
3 answers
871 views

Database Model Classes in TypeScript

I'm using Knex.js with TypeScript for database access. Table uid (UUID, auto-generated by Postgres) name (varchar) Model interface User { uid: string | null; name: string; }...
John Mark Gabriel Caguicla's user avatar
1 vote
1 answer
9k views

Data Flow Diagram for patient information system for a hospital

I have an example for a DFD for a patient information system implemented in a certain hospital. The below figure, represents the overview diagram (level 0-diagram, if we consider that the first level ...
AAAA's user avatar
  • 145
2 votes
2 answers
406 views

How to represent a data model?

Often enough, the terms data model and data format are used interchangeably, but here I disagree. Let's start with the simpler one, the data format. I don't know exact definitions, but the data format ...
flowit's user avatar
  • 237
1 vote
1 answer
199 views

How to avoid code duplication from handling "structually similar types" in Scala?

Often, when programming, you'll have different degrees of information to you in different contexts. For example, a web server may have two routes, which recieve information about a Person, one of ...
Joe's user avatar
  • 174
3 votes
2 answers
681 views

Is Excel data model as good as or better than Microsoft Access?

I'm working with several Excel worksheets and workbooks that need to consolidated or linked to each other. These workbooks will track client interactions for different team members. I did the initial ...
Jasterix's user avatar
0 votes
1 answer
221 views

API Request/Response Model for showing differences in JSON objects

I am writing an API to merge two different JSON Objects. Both of these objects can have same as well different number of properties. Object 1 : { "name": "Sam", "lastName": "Hanks", "...
Code-47's user avatar
  • 101
2 votes
1 answer
2k views

Optional relationship on ERD diagram

Upon generating an entity-relationship diagram of my database I observed several occurrence like this: This diagram (in IDEF1X notation) shows the following: Our team's DB convention is that each ...
Michael Sorens's user avatar
-1 votes
2 answers
346 views

Correct place to store semi dynamic data

What I mean by semi dynamic data are data that are expected to be changed only with product versions. Now imagine this scenario, In version 1 of the product, I have item status : SUCCESS , FAIL In ...
osama yaccoub's user avatar
-1 votes
2 answers
2k views

When self-referencing in a table, do you prefer `parent_id = null` or `parent_id = id` for a row referencing to itself?

For the discussion, I will provide my example. But I am interested in the broad guidelines. I save in my postgres DB legislation (law texts) composed of a single header (H), paragraphs (P), sub-...
Poutrathor's user avatar
2 votes
3 answers
144 views

Many-to-many assignments in user system

I have a few software architecture/design questions related to a technically quite simple problem. We already have all the functionality implemented properly, however from a design perspective it is ...
Fly's user avatar
  • 129
1 vote
2 answers
46 views

Best way to model assay steps with low variability?

I have to process biological data input in the format of 96-well plates. explainer for the non-biologists: These plates are basically a 2D matrix of 8 rows x 12 columns of small cups called wells. ...
Nanobody's user avatar
-1 votes
2 answers
135 views

Help designing a product model with vast amount of properties

I've been asked how to re-design a legacy system by a relative for a company that builds custom chairs. On their website you can customize your chair in about 30 permutations : chair type, material, ...
m-a.D's user avatar
  • 9
0 votes
2 answers
279 views

Creating a "pass-through" dynamic model

We have a layer that exists in our architecture that, for lack of a better term, bears the responsibility of defining the common models. In other words, when systems need to communicate, rather than ...
McArthey's user avatar
  • 117
0 votes
0 answers
166 views

What kind of diagram best represents the field-level mapping from one system component to another?

In my environment, we have multiple systems developed independently by different teams. Those teams frequently recreate the wheel because they're building applications, not building blocks. As a ...
Jason's user avatar
  • 1
4 votes
3 answers
235 views

ER diagram - feasibility of a requirement

I need to model the following requirement in an Entity-Relationship diagram. "Customers place orders, which contain a list of products with their quantity and prices. A shipment is made when ...
holy_el's user avatar
  • 49
0 votes
1 answer
327 views

How to create a flexible datamodel?

I'm trying to create a flexible datamodel and i'm not sure what's the right approach. My application is used by several clients (big and small). Big clients need all the seperate layers, but small ...
Peer's user avatar
  • 49
0 votes
1 answer
97 views

Lightweight data mining + organization & visualization

I'm looking to do some simple data mining that consists of going once per day to a single page and collect the following information: List of movie theaters Movies today on each theater Session times ...
dR_'s user avatar
  • 11
2 votes
2 answers
804 views

Index / Unique on `deleted_at` column?

We have an Accounts table in a Postgres DB that has a unique index on user_id and product. Users can have many accounts, there's no product table. Occasionally users will create an account ...
kidCoder's user avatar
  • 129
2 votes
2 answers
132 views

how to model 2 objects that refer to each other in the DB

Now I have 2 objects which are "PROBLEM" and "SOLUTION", obviously "SOLUTION" is a proposed solution to a given "PROBLEM", my problem is that in my business I have the following relations: a "...
osama yaccoub's user avatar
29 votes
4 answers
8k views

Is there an industry standard for gender model other than male and female?

I am modeling a database that should be used as generic non-functional requisite for all services of the startup company, like persons, users, services and commercial data like coupons, signature ...
NaN's user avatar
  • 549
2 votes
1 answer
89 views

How to model rdbms relationships as graph relationships?

I am modeling our existing database in transition to a graph database. Currently here is how I can interpret the database a graph relationships group -have-> groups group -have-> participants ...
MichaelChan's user avatar
2 votes
3 answers
2k views

How to store sequential timespans in a database?

How can consecutive periods of time (defined by a start and end date) be stored in a database? For example: from 2018-01-01 00:00:00+01:00 until 2018-06-01 00:00:00+02:00 from 2018-06-01 00:00:00+02:...
smhg's user avatar
  • 131
4 votes
1 answer
6k views

What is an example giving the difference between Domain Model and Data Model?

I've seen many articles describing differences between Domain Model and Data Model. However none of the articles have picture representations showing difference. https://stackoverflow.com/questions/...
CarSpeed87's user avatar
4 votes
1 answer
2k views

Handling guest users in ecommerce application

I'm currently developing an Ecommerce application and am trying to figure out how best to add a 'guest checkout' feature. The 3 main models that I am wrestling with to add this feature are Address, ...
Rnice4christ's user avatar
3 votes
3 answers
178 views

Should I use a physical units library for modelling domain properties if I don't need to perform computations on them?

I'm working on the data model of a service describing houses and flats. This involves storing quantitative physical properties of certain features of the premises, for example: Speed of the Internet ...
H2CO3's user avatar
  • 437