Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    singulars
    1. This table or related slice is empty.
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. VO
      singulars
      1. This table or related slice is empty.
    2. VO
      singulars
      1. This table or related slice is empty.
    3. VO
      singulars
      1. This table or related slice is empty.
    1. COIt seems like an update trigger would be the right way to go if the table wasn't being replaced wholesale, but it is. Unfortunately the `Products` table is huge and importing the data takes a really long time. Replacing the table (rather than UPSERT-ing rows) speeds it up significantly but I lose the ability to use an update trigger. I guess I'll have to evaluate which is more important: total import speed or the ability to have an update trigger. I might be able to mimic the same functionality with a ruby observer that creates `product_price_changes` after the import is finished I suppose.
      singulars
    2. COHow often do the values in `Product` really change? If the daily product data dump comes from an outside source you might be able to work out a diff/patch deal (which might even be a simple diff(1) on text files) system to trim it down to a small set of changes, then apply just those changes to the `Product` table. The trick is to trim down the work load or spread it out into small chunks to avoid locking up `Product` and getting in the online system's way. Hopefully the "big database" crew will show up tomorrow with some fresh ideas.
      singulars
    3. COWell, they might not change that often, but the problem is the sheer volume of records and data I'm working with... it's several million records total, so if even a smallish percentage of them are updated, it's still quite a lot of data. (I'm importing other tables as well, this is just one piece in a somewhat large data set.) You're right though, I may need to rethink replacing the tables entirely on import...
      singulars
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload