StreamCruncherDatabases & Datatypes

Databases

StreamCruncher supports several Databases. Different configuration files are provided for each of the Databases that are supported. They must be set appropriately and fed to the Kernel at startup.

Some Databases that are not In-Memory are also supported. In such cases (like Oracle 10g, PointBase, Derby and Firebird), the Database configurations must be modified to reduce frequent Disk Writes/Flushes, larger Page Size, better Page Cache etc, so that they work like In-Memory Databases by forgoing Durability and thereby reducing Latency/Delays. Creating the TableSpace on a RAM/Memory Drive can also be considered.

Database Notes
ANTs Tested on version 3.60 (Suggested setting: "LOG_MODE = DISABLED")
Derby Tested on version 10.1.2.1 (Suggested setting: "derby.system.durability=test". Large Page and Page Cache sizes. Sample configuration file provided)
Firebird Tested on version 1.5.3 (Suggested setting: "ForcedWrites=Off". Large Unflushed Write, Unflushed Write Time and Cache Page sizes)
Tested on version 1.0 / 2006-12-03
MySQL Tested on version 5.0 (The Database must have the Memory/Heap Engine installed)
Oracle 10g Tested on Enterprise 10.2.0 (Suggested setting: Requires expert tuning. TableSpaces on RAM Drive will help)
Oracle TimesTen Tested on version 6.0.2 (Suggested setting: "Temporary DataStore" with "Diskless Logging")
PointBase Tested on Embedded version 5.5 (Suggested setting: Large Page and Page Cache sizes, Disk sync and Forced Write disabled. Sample configuration file provided)
Solid BoostEngine Tested on version 04.50.0110 (Suggested setting: "Listen=tcpip 1315, shmem SOLID" for Windows or the equivalent on Unix with "LogEnabled=no")

Datatypes

Datatypes of special columns

The Highest/Lowest values Window supports columns whose JDBC types implement java.lang.Comparable.

Id Column type for Input & Output Streams (Auto generated for Output Streams) Timestamp column type (Time based Windows)
java.lang.Long java.sql.Timestamp

Aggregate Functions and their Datatypes

Aggregate Function Supported Input Column Types Output Column Type
Average java.lang.Integer, java.lang.Double, java.lang.Long java.lang.Double
Count Any java.lang.Integer
Geometric Mean java.lang.Integer, java.lang.Double, java.lang.Long java.lang.Double
Kurtosis java.lang.Integer, java.lang.Double, java.lang.Long java.lang.Double
Max Any JDBC type that implements java.lang.Comparable Same as Input
Median java.lang.Integer, java.lang.Double, java.lang.Long java.lang.Double
Min Any JDBC type that implements java.lang.Comparable Same as Input
Skewness java.lang.Integer, java.lang.Double, java.lang.Long java.lang.Double
Standard Deviation java.lang.Integer, java.lang.Double, java.lang.Long java.lang.Double
Sum java.lang.Integer, java.lang.Double, java.lang.Long java.lang.Double
Sum of Squares java.lang.Integer, java.lang.Double, java.lang.Long java.lang.Double
Variance java.lang.Integer, java.lang.Double, java.lang.Long java.lang.Double