Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data-warehouse]

The tag has no usage guidance.

0
votes
1answer
62 views

Lightweight data mining + organization & visualization

I'm looking to do some simple data mining that consists of going once per day to a single page and collect the following information: List of movie theaters Movies today on each theater Session times ...
2
votes
1answer
31 views

Indexes on a SQL Server fact table

If I have a SQL Server fact table with four dimensions (OrderDate, Customer, Product, Region), my understanding is that it's best to create a non-clustered index per foreign key (dim key column in the ...
0
votes
1answer
163 views

How to organise development process with AWS DataPipeline?

I'm introducing a Redshift for my team and it becomes a challenge to make a solid development process, so I need some info how to deal with it. First, of all some info about current layout. We are ...
26
votes
8answers
1k views

Is there a programming paradigm that promotes making dependencies extremely obvious to other programmers?

I work in a Data Warehouse that sources multiple systems via many streams and layers with maze-like dependencies linking various artifacts. Pretty much every day I run into situations like this: I run ...
1
vote
3answers
179 views

Categorizing columns in a database table

I wanted to know how do people generically think of, in a data base table: Columns that people are expected to use mostly for grouping expectable of groupability. Columns that people are expected to ...
6
votes
4answers
755 views

How and when to choose between Data Consolidation/Data Integration and Data Synchronisation?

I am having some confusion as to how to decide what to choose between Data Consolidation/Data Integration and Data Synchronisation? I know that: Data Consolidation/Data Integration: refers to the ...
4
votes
3answers
741 views

Designing a data warehouse: action or status based

I am designing a data warehouse for a sales platform. There exists a group of users that offers and a group of users that demand entities. The production data base holds two sources of information: ...
2
votes
0answers
58 views

How are values such as monthly cost stored in a data warehouse

Would a value such as monthly cost from source data be represented as a fact? If yes, how would a date dimension table be designed around that fact?
4
votes
2answers
2k views

Am I using Data Warehousing wrong?

I work for a company that has several products, and several databases and tons of data. To sorta merge all this data what we've been doing moving some of our data over to Amazon Redshift (a data ...
1
vote
3answers
332 views

Are Data Warehouses bespoke products that are tailored towards the specific needs of one single organisation?

Are Data Warehouses bespoke projects that are developed to meet the needs of a specific organisation or can you buy off the shelf products that would meet the needs of many organisations? I am ...
-1
votes
3answers
2k views

New to Data Warehouses/ERP

The organisation I work for is very application rich i.e. there are lots of SQL and Oracle databases. We are thinking about a data warehouse. I believe there is a difference between an Enterprise ...
4
votes
2answers
385 views

implementing dynamic query handler on historical data

Context: I have historical data about property (house) sales collected from various sources in a centralized/cloud data source (assume info collection is handled by a third party) Planning to ...
2
votes
0answers
88 views

Best practice or design patterns for retrieval of data for reporting and dashboards in a domain-rich application [duplicate]

First, I want to say this seems to be a neglected question/area, so if this question needs improvement, help me make this a great question that can benefit others! In my experience, there are two ...
43
votes
11answers
21k views

Best practice or design patterns for retrieval of data for reporting and dashboards in a domain-rich application

First, I want to say this seems to be a neglected question/area, so if this question needs improvement, help me make this a great question that can benefit others! I'm looking for advice and help from ...
0
votes
1answer
308 views

How to provide data to a web server using a data warehouse?

We have data stored in a data warehouse as follows: Price Date Product Name (varchar(25)) We currently only have seven products. Once every business day, seven new data points are added ...
6
votes
6answers
10k views

What are the disadvantages of using stored procedures, SSIS, and SSRS to implement business applications? [closed]

Recently, it was suggested that many projects (where I work) should be implemented using some combination of stored procedures (on SQL Sever / T-SQL), SSIS, and SSRS. In one specific project, SSIS ...
3
votes
2answers
645 views

Data warehouse architecture for mutating schema

I am setting up an ETL process and small data warehouse for querying the data in a few different dimensions. One issue is that the schema for the objects can mutate over time - mainly that some fields ...
3
votes
3answers
4k views

Can a table be both Fact and Dimension

Ok, I am a newbie and don't really think "dimensionally" yet, I have most of my initial schema roughed out but I keep flipping back and forth on one table. I have a Contract table and it has a ...
0
votes
1answer
962 views

Developing an analytics's system processing large amounts of data - where to start

Imagine you're writing some sort of Web Analytics system - you're recording raw page hits along with some extra things like tagging cookies etc and then producing stats such as Which pages got most ...
5
votes
2answers
7k views

What's the best way to learn the MS Business Intelligence stack? [closed]

What's the best/easiest way to get into the MS BI stack on my own (preferably with a [kindle] book)? Specifically, I'd like to learn more about SSIS, SSRS, and SSAS in that order. I've tried looking ...
0
votes
1answer
1k views

Testing BI (Business Intelligence) systems on the MS stack

I'm placing my first steps in the Business Intelligence sector and I'm looking for good ways to test BI systems. I'm going to try to explain what my system consists of so that people unfamiliar with ...
3
votes
3answers
15k views

How and when dimensions are filled in a data warehouse schema?

I'm reading Ralph Kimball's books and I'm currently exploring the following data warehouse schema. Are both dimension & fact tables populated during the data warehouse creation/update? How often? ...