Enhanced situation space mining for data streams

Yisroel Mirsky, Tal Halpern, Rishabh Upadhyay, Sivan Toledo, Yuval Elovici

نتاج البحث: فصل من :كتاب / تقرير / مؤتمرمنشور من مؤتمرمراجعة النظراء


Data streams can capture the situation which an actor is experiencing. Knowledge of the present situation is highly beneficial for a wide range of applications. An algorithm called pcStream can be used to extract situations from a numerical data stream in an unsupervised manner. Although pcStream outperforms other stream clustering algorithms at this task, pcStream has two major flaws. The first is its complexity due to continuously performing principal component analysis (PCA). The second is its difficulty in detecting emerging situations whose distributions overlap in the same feature space. In this paper we introduce pcStream2, a variant of pcStream which employs windowing and persistence in order to distinguish between emerging overlapping concepts. We also propose the use of incremental PCA (IPCA) to reduce the overall complexity and memory requirements of the algorithm. Although any IPCA algorithm can be used, we use a novel IPCA algorithm called Just-In-Time PCA which is better suited for processing streams. JIT-PCA makes intelligent 'short cuts' in order to reduce computations. We provide experimental results on real-world datasets that demonstrates how the proposed improvements make pcStream2 a more accurate and practical tool for situation space mining.

اللغة الأصليةإنجليزيّة أمريكيّة
عنوان منشور المضيف32nd Annual ACM Symposium on Applied Computing, SAC 2017
عدد الصفحات8
رقم المعيار الدولي للكتب (الإلكتروني)9781450344869
المعرِّفات الرقمية للأشياء
حالة النشرنُشِر - 3 أبريل 2017
الحدث32nd Annual ACM Symposium on Applied Computing, SAC 2017 - Marrakesh, المغرب
المدة: ٤ أبريل ٢٠١٧٦ أبريل ٢٠١٧

سلسلة المنشورات

الاسمProceedings of the ACM Symposium on Applied Computing
مستوى الصوتPart F128005


!!Conference32nd Annual ACM Symposium on Applied Computing, SAC 2017

All Science Journal Classification (ASJC) codes

  • !!Software


أدرس بدقة موضوعات البحث “Enhanced situation space mining for data streams'. فهما يشكلان معًا بصمة فريدة.

قم بذكر هذا