StreamCruncher supports several Databases. Different configuration files are provided for each of the Databases that are supported. They must be set appropriately and fed to the Kernel at startup.
Some Databases that are not In-Memory are also supported. In such cases (like Oracle 10g, PointBase, Derby and Firebird), the Database configurations must be modified to reduce frequent Disk Writes/Flushes, larger Page Size, better Page Cache etc, so that they work like In-Memory Databases by forgoing Durability and thereby reducing Latency/Delays. Creating the TableSpace on a RAM/Memory Drive can also be considered.
Database | Notes |
---|---|
ANTs | Tested on version 3.60 (Suggested setting: "LOG_MODE = DISABLED") |
Derby | Tested on version 10.1.2.1 (Suggested setting: "derby.system.durability=test". Large Page and Page Cache sizes. Sample configuration file provided) |
Firebird | Tested on version 1.5.3 (Suggested setting: "ForcedWrites=Off". Large Unflushed Write, Unflushed Write Time and Cache Page sizes) |
Tested on version 1.0 / 2006-12-03 | |
MySQL | Tested on version 5.0 (The Database must have the Memory/Heap Engine installed) |
Oracle 10g | Tested on Enterprise 10.2.0 (Suggested setting: Requires expert tuning. TableSpaces on RAM Drive will help) |
Oracle TimesTen | Tested on version 6.0.2 (Suggested setting: "Temporary DataStore" with "Diskless Logging") |
PointBase | Tested on Embedded version 5.5 (Suggested setting: Large Page and Page Cache sizes, Disk sync and Forced Write disabled. Sample configuration file provided) |
Solid BoostEngine | Tested on version 04.50.0110 (Suggested setting: "Listen=tcpip 1315, shmem SOLID" for Windows or the equivalent on Unix with "LogEnabled=no") |
Datatypes of special columns
The Highest/Lowest values Window supports columns whose JDBC types implement java.lang.Comparable.
Id Column type for Input & Output Streams (Auto generated for Output Streams) | Timestamp column type (Time based Windows) |
---|---|
java.lang.Long | java.sql.Timestamp |
Aggregate Functions and their Datatypes
Aggregate Function | Supported Input Column Types | Output Column Type |
---|---|---|
Average | java.lang.Integer, java.lang.Double, java.lang.Long | java.lang.Double |
Count | Any | java.lang.Integer |
Geometric Mean | java.lang.Integer, java.lang.Double, java.lang.Long | java.lang.Double |
Kurtosis | java.lang.Integer, java.lang.Double, java.lang.Long | java.lang.Double |
Max | Any JDBC type that implements java.lang.Comparable | Same as Input |
Median | java.lang.Integer, java.lang.Double, java.lang.Long | java.lang.Double |
Min | Any JDBC type that implements java.lang.Comparable | Same as Input |
Skewness | java.lang.Integer, java.lang.Double, java.lang.Long | java.lang.Double |
Standard Deviation | java.lang.Integer, java.lang.Double, java.lang.Long | java.lang.Double |
Sum | java.lang.Integer, java.lang.Double, java.lang.Long | java.lang.Double |
Sum of Squares | java.lang.Integer, java.lang.Double, java.lang.Long | java.lang.Double |
Variance | java.lang.Integer, java.lang.Double, java.lang.Long | java.lang.Double |