Databases
StackOverflow2013
Postsdbo
POAre there any data warehouse frameworks?
Body
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POAre there any data warehouse frameworks?
    text
    copied!<p>I've got a lot of mysql data that I need to generate reports from. It's mostly historic data so it won't be changing much, but it weighs in at 20-30 gigabytes easily and is expected to grow. I currently have a collection of php scripts that will do some complex queries and output csv and excel files. I also use phpMyAdmin with bookmarked queries. I manually edit them to change the parameters. The amount of data is growing and the number of people who need access to it is also growing, so I'm making the time to improve this situation.</p> <p>I started reading about data warehousing the other day and it seems that this an area that relates to what I need to do. I've read <a href="http://philip.greenspun.com/wtr/data-warehousing.html" rel="nofollow noreferrer">some</a> <a href="http://www.meansandends.com/mysql-data-warehouse/?link_body/body=%7Bincl:Aggregation%7D" rel="nofollow noreferrer">good</a> <a href="http://en.wikipedia.org/wiki/Data_warehouse" rel="nofollow noreferrer">articles</a> and am even waiting on a book. I think I'm getting a handle on what these sorts of systems do and what's possible.</p> <p>Creating a reporting system for my data has always been on a todo list, but until recently I figured it would be a highly niche programing venture. Since I now know data warehousing is a common thing, I figure there must be some sort of reporting/warehousing frames available to ease in the development. I'd gladly skip writing interfaces and scripts to schedule and email reports and the like and stick to writing queries and setting up relations.</p> <p>I've mostly been a lamp guy, but I'm not above switching languages or platforms. I just need a more robust solution as my one off scripts don't scale well.</p> <p>So where's a good place to get started?</p>
 

Querying!

 
Guidance
An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload