3609

Iowa State University researchers have developed a technique for processing massive data streams.   The patents are available for non-exclusive license.

This invention is a new technique for processing massive data streams. It overcomes the need to store data within the main memory of a computer (or even on a disk) in order to process the data.   Rather than storing data, this “real-time” method uses time decay functions to prioritize processing order by assigning weights based on the age of the data. Decay functions such as sliding windows and exponential decay have been studied under the assumption of well-ordered arrivals, i.e., data arrives in the order of increasing time stamps. However, data quality issues are prevalent in massive streams, due to asynchrony, delays or possibly features inherent to the measurement process, and correct order of arrival cannot be guaranteed.  This new methodology overcomes many of these problems.

• Improves accuracy and performance of data transmission

Data processing, computation of stream aggregates

IEEE International Conference on Data Engineering, Cancun, Mexico