Databases
StackOverflow2013
Postsdbo
PO
 

Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>I think you maybe having performance issues because of your current approach.</p> <p>First off, let's cover the differences between the editions of StreamInsight. Standard edition has only 1 scheduler thread while Premium has one per core. The Evaluation edition is equivalent to Premium.</p> <p>I think the way to fix this is to reduce the number of queries you have. If you are creating 1000 queries (each with their own instance of an output adapter) I can see where you are going to have issues. On a quad-core machine, you are going to have 4 scheduler threads trying to run 1000 queries.</p> <p>Are your queries that are arranged "horizontally" doing the same thing? If so, see if you can consolidate them. For instance, if I needed to do a query like the "Price>5 Vol&lt;2k" for 5 different stocks, I would write it in such a way that I can handle all 5 stocks in a standing query that sends all the results to 1 output adapter. If a client is "subscribing" to results from a query, that's something that can/should be handled by your output adapter. You could also turn results on and off for certain stocks by streaming in reference data.</p> <p>Take a look at the sample below. "sourceStream" is going to be my raw stock data coming from the data source. "referenceStream" is going to be some configuration streamed in from a reference data source (i.e. SQL). The success or failure of the join will throttle the events that get passed on for further processing.</p> <pre><code>var myPrice5Vol2kSourceStream = from s in sourceStream join r in referenceStream on s.StockSymbol equals r.StockSymbol select s; </code></pre>
    singulars
    1. This table or related slice is empty.
    1. POStreamInsight Performance Issue
      singulars
      1. PTQuestion
    1. PTAnswer
    1. This table or related slice is empty.
    1. USTXPower275
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. COTim, did this help or ?
      singulars
      1. PO
      1. USTXPower275
    2. COI'm providing this feature to a large number of customers, allowing them to customize their queries. I planned to merge similar parts of the queries, but would easily have thousands of unique queries. I don't think StreamInsight is going to give me the performance I want for that type of situation. I have another solution that gives me much better performance for this problem (high number of unique, simple queries). I was hoping that StreamInsight could replace some of that code and just throttle data through tons of queries, but my current code seems more tuned to what we need.
      singulars
      1. PO
      1. UStimothymcgrath
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload