Querying industrial stream-temporal data: An ontology-based visual approach 1

Abstract

An increasing number of sensors are being deployed in business-critical environments, systems, and equipment; and stream a vast amount of data. The operational efficiency and effectiveness of business processes rely on domain experts’ agility in interpreting data into actionable business information. A domain expert has extensive domain knowledge but not necessarily skills and knowledge on databases and formal query languages. Therefore, centralised approaches are often preferred. These require IT experts to translate the information needs of domain experts into extract-transform-load (ETL) processes in order to extract and integrate data and then let domain experts apply predefined analytics. Since such a workflow is too time intensive, heavy-weight and inflexible given the high volume and velocity of data, domain experts need to extract and analyse the data of interest directly. Ontologies, i.e., semantically rich conceptual domain models, present an intelligible solution by describing the domain of interest on a higher level of abstraction closer to the reality. Moreover, recent ontology-based data access (OBDA) technologies enable end users to formulate their information needs into queries using a set of terms defined in an ontology. Ontological queries could then be translated into SQL or some other database query languages, and executed over the data in its original place and format automatically. To this end, this article reports an ontology-based visual query system (VQS), namely OptiqueVQS, how it is extended for a stream-temporal query language called STARQL, a user experiment with the domain experts at Siemens AG, and STARQL’s query answering performance over a proof of concept implementation for PostgreSQL.

Keywords

Visual query formulation ontology-based data access temporal data stream sensor data data retrieval usability

Get full access to this article

View all access options for this article.

References

Ambrus,

Möller and

Handschuh, Konduit VQB: A visual query builder for SPARQL on the social semantic desktop, in: Proceedings of the Workshop on Visual Interfaces to the Social and Semantic Web (VISSW 2010), CEUR Workshop Proceedings, Vol. 565, CEUR-WS.org, 2010.

Anicic,

Fodor,

Rudolph and

Stojanovic, EP-SPARQL: A unified language for event processing and stream reasoning, in: Proceedings of the 20th International Conference on World Wide Web (WWW 2011), ACM, 2011, pp. 635–644. doi:10.1145/1963405.1963495.

Arasu,

Babu and

Widom, The CQL continuous query language: Semantic foundations and query execution, The VLDB Journal15(2) (2006), 121–142. doi:10.1007/s00778-004-0147-z.

Arenas,

Cuenca Grau,

Kharlamov,

Marciuska and

Zheleznyakov, Faceted search over RDF-based knowledge graphs, Web Semantics: Science, Services and Agents on the World Wide Web37–38 (2016), 55–74. doi:10.1016/j.websem.2015.12.002.

Baeza-Yates and

Ribeiro-Neto, Modern Information Retrieval, Addison Wesley, 1999.

D.F.

Barbieri,

Braga,

Ceri,

Della Valle and

Grossniklaus, C-SPARQL: SPARQL for continuous querying, in: Proceedings of the 18th International Conference on World Wide Web (WWW 2009), ACM, 2009, pp. 1061–1062. doi:10.1145/1526709.1526856.

Bolles,

Grawunder and

Jacobi, Streaming SPARQL extending SPARQL to process data streams, in: Proceedings of the 5th European Semantic Web Conference (ESWC 2008), LNCS, Vol. 5021, Springer, 2008, pp. 448–462.

J.-P.

Calbimonte,

Corcho and

A.J.G.

Gray, Enabling ontology-based access to streaming data sources, in: Proceedings of the 9th International Semantic Web Conference (ISWC 2010), LNCS, Vol. 6496, Springer, 2010, pp. 96–111.

Calvanese,

Cogrel,

Komla-Ebri,

Kontchakov,

Lanti,

Rezk,

Rodriguez-Muro and

Xiao, Ontop: Answering SPARQL queries over relational databases, Semantic Web, in press.

10.

Calvanese,

Giacomo,

Lembo,

Lenzerini and

Rosati, Tractable reasoning and efficient query answering in description logics: The DL-lite family, Journal of Automated Reasoning39(3) (2007), 385–429. doi:10.1007/s10817-007-9078-x.

11.

Catarci, What happened when database researchers met usability, Information Systems25(3) (2000), 177–212. doi:10.1016/S0306-4379(00)00015-6.

12.

Catarci,

M.F.

Costabile,

Levialdi and

Batini, Visual query systems for databases: A survey, Journal of Visual Languages and Computing8(2) (1997), 215–260. doi:10.1006/jvlc.1997.0037.

13.

Chandrasekaran,

Cooper,

Deshpande,

M.J.

Franklin,

J.M.

Hellerstein,

Hong,

Krishnamurthy,

S.R.

Madden,

Reiss and

M.A.

Shah, TelegraphCQ: Continuous dataflow processing, in: Proceedings of the ACM International Conference on Management of Data (SIGMOD 2003), ACM, 2003, p. 668. doi:10.1145/872757.872857.

14.

Civili,

Console,

De Giacomo,

Lembo,

Lenzerini,

Lepore,

Mancini,

Poggi,

Rosati,

Ruzzi,

Santarelli and

D.F.

Savo, Mastro studio: Managing ontology-based data access applications, Proceedings of the VLDB Endowment6(12) (2013), 1314–1317. doi:10.14778/2536274.2536304.

15.

Dell’Aglio,

Della Valle,

J.-P.

Calbimonte and

Corcho, RSP-QL semantics: A unifying query model to explain heterogeneity of RDF stream processing systems, International Journal on Semantic Web and Information Systems10(4) (2014), 17–44. doi:10.4018/ijswis.2014100102.

16.

Doan,

Halevy and

Ives, Principles of Data Integration, 1st edn, Morgan Kaufmann, 2012.

17.

R.G.

Epstein, The TableTalk query language, Journal of Visual Languages and Computing2(2) (1991), 115–141. doi:10.1016/S1045-926X(05)80026-6.

18.

Giese,

Calvanese,

Haase,

Horrocks,

Ioannidis,

Kllapi,

Koubarakis,

Lenzerini,

Moller,

Ozcep,

Rodriguez-Muro,

Rosati,

Schlatte,

Schmidt,

Soylu and

Waaler, Scalable end-user access to Big Data, in: Big Data Computing,

Akerkar, ed., CRC Press, 2013.

19.

Giese,

Soylu,

Vega-Gorgojo,

Waaler,

Haase,

Jimenez-Ruiz,

Lanti,

Rezk,

Xiao,

Ozcep and

Rosati, Optique – Zooming in on Big Data access, IEEE Computer48(3) (2015), 60–67. doi:10.1109/MC.2015.82.

20.

B.C.

Grau,

Giese,

Horrocks,

Hubauer,

Jimenez-Ruiz,

Kharlamov,

Schmidt,

Soylu and

Zheleznyakov, Towards query formulation and query-driven ontology extensions in OBDA systems, in: Proceedings of 10th OWL: Experiences and Directions Workshop (OWLED 2013), CEUR Workshop Proceedings, Vol. 1080, CEUR-WS.org, 2013.

21.

Haag,

Lohmann,

Siek and

Ertl, QueryVOWL: A visual query notation for Linked Data, in: Proceedings of the Satellite Events of the 12th European Conference on the Semantic Web (ESWC 2015), LNCS, Vol. 9341, Springer, 2015, pp. 387–402. doi:10.1007/978-3-319-25639-9_51.

22.

Heim and

Ziegler, Faceted visual exploration of semantic data, in: Proceedings of the 1st IFIP WG 13.7 International Workshop on Human Aspects of Visualization (HCIV 2009), LNCS, Vol. 6431, Springer, 2011, pp. 58–75.

23.

Hogenboom,

Milea,

Fransincar and

Kaymak, RDF-GL: A SPARQL-based graphical query language for RDF, in: Emergent Web Intelligence: Advanced Information Retrieval, Advanced Information and Knowledge Processing, Springer, 2010, pp. 87–116. doi:10.1007/978-1-84996-074-8_4.

24.

J.H.

Hwang,

Xing,

Cetintemel and

Zdonik, A cooperative, self-configuring high-availability solution for stream processing, in: Proceedings of the IEEE 23rd International Conference on Data Engineering (ICDE 2007), IEEE, 2007, pp. 176–185. doi:10.1109/ICDE.2007.367863.

25.

Kharlamov,

Kotidis,

Mailis,

Neuenstadt,

Nikolaou,

Ozcep,

Svingos,

Zheleznyakov,

Lamparter,

Horrockset al., Towards analytics aware ontology based access to static and streaming data, in: Proceedings of the 15th International Semantic Web Conference (ISWC 2016), LNCS, Vol. 9982, Springer, 2016, pp. 344–362.

26.

Kharlamov,

Solomakhina,

Ö.L.

Özçep,

Zheleznyakov,

Hubauer,

Lamparter,

Roshchin,

Soylu and

Watson, How semantic technologies can enhance data access at Siemens Energy, in: Proceedings of the 13th International Semantic Web Conference (ISWC 2014), LNCS, Vol. 8796, Springer, 2014, pp. 601–619.

27.

M.R.

Kogalovsky, Ontology-based data access systems, Programming and Computer Software38(4) (2012), 167–182. doi:10.1134/S0361768812040032.

28.

Krämer and

Seeger, Semantics and implementation of continuous sliding window queries over data streams, ACM Transactions on Database Systems34(1) (2009), 4:1–4:49.

29.

N.C.

Krishnan and

D.J.

Cook, Activity recognition on streaming sensor data, Pervasive and Mobile Computing10(Part B) (2014), 138–154. doi:10.1016/j.pmcj.2012.07.003.

30.

Le-Phuoc,

Dao-Tran,

J.X.

Parreira and

Hauswirth, A native and adaptive approach for unified processing of Linked Streams and Linked Data, in: Proceedings of the 10th International Conference on the Semantic Web (ISWC 2011), LNCS, Vol. 7031, Springer, 2011, pp. 370–388. doi:10.1007/978-3-642-25073-6_24.

31.

Lieberman,

Paterno and

Wulf (eds), End User Development, Human-Computer Interaction Series, Vol. 9, Springer, 2006.

32.

Marchionini and

White, Find what you need, understand what you find, International Journal of Human-Computer Interaction23(3) (2007), 205–237. doi:10.1080/10447310701702352.

33.

Martinez-Cruz,

I.J.

Blanco and

M.A.

Vila, Ontologies versus relational databases: Are they so different? A comparison, Artificial Intelligence Review38(4) (2012), 271–290. doi:10.1007/s10462-011-9251-9.

34.

Neuenstadt,

Moller and

Ozcep, OBDA for temporal querying and streams with STARQL, in: Proceedings of the 1st Workshop on High-Level Declarative Stream Processing (HiDeSt 2015), CEUR Workshop Proceedings, Vol. 1447, CEUR-WS.org, 2015, pp. 70–75.

35.

Ozcep and

Moller, Ontology based data access on temporal and streaming data, in: Reasoning Web. Reasoning and the Web in the Big Data Era, LNCS, Vol. 8714, Springer, 2014, pp. 279–312.

36.

Ozcep,

Moller and

Neuenstadt, A stream-temporal query language for ontology based data access, in: The 37th Annual German Conference on Artificial Intelligence (KI 2014), LNCS, Vol. 8736, Springer, 2014, pp. 183–194.

37.

Pavel,

Callaghan and

A.K.

Dey, Looking back in wonder: How self-monitoring technologies can help us better understand ourselves, in: Proceedings of the 2010 6th International Conference on Intelligent Environments (IE 2010), IEEE Computer Society, 2010, pp. 289–294. doi:10.1109/IE.2010.59.

38.

Poggi,

Lembo,

Calvanese,

De Giacomo,

Lenzerini and

Rosati, Linking data to ontologies, Journal on Data Semantics X10 (2008), 133–173. doi:10.1007/978-3-540-77688-8_5.

39.

I.O.

Popov,

M.C.

Schraefel,

Hall and

Shadbolt, Connecting the dots: A multi-pivot approach to data exploration, in: Proceedings of the 10th International Semantic Web Conference (ISWC 2011), LNCS, Vol. 7031, Springer, 2011, pp. 553–568.

40.

H.N.M.

Quoc,

Serrano,

D.L.

Phuoc and

Hauswirth, Super stream collider: Linked stream mashups for everyone, in: Proceedings of the Semantic Web Challenge at ISWC2012, 2012.

41.

R.W.

Revie (ed.), Oil and Gas Pipelines: Integrity and Safety Handbook, John Wiley & Sons, Inc., 2015.

42.

Ruiz-Garcia,

Lunadei,

Barreiro and

J.I.

Robla, A review of wireless sensor technologies and applications in agriculture and food industry: State of the art and current trends, Sensors9(6) (2009), 4728–4750. doi:10.3390/s90604728.

43.

J.F.

Sequeda and

D.P.

Miranker, Ultrawrap: SPARQL execution on relational data, Web Semantics: Science, Services and Agents on the World Wide Web22 (2013), 19–39. doi:10.1016/j.websem.2013.08.002.

44.

P.R.

Smart,

Russell,

Braines,

Kalfoglou,

Bao and

Shadbolt, A visual approach to semantic query design using a web-based graphical query designer, in: Proceedings of the 16th International Conference on Knowledge Engineering and Knowledge Management (EKAW 2008), LNCS, Vol. 5268, Springer, 2008, pp. 275–291.

45.

Soon Low,

W.N.N.

Win and

Joo Er, Wireless sensor networks for industrial environments, in: Proceedings of the International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC 2006), IEEE, 2005, pp. 271–276.

46.

Soylu,

De Causmaecker,

Preuveneers,

Berbers and

Desmet, Formal modelling, knowledge representation and reasoning for design and development of user-centric pervasive software: A meta-review, International Journal of Metadata, Semantics and Ontologies6(2) (2011), 96–125. doi:10.1504/IJMSO.2011.046595.

47.

Soylu and

Giese, Qualifying ontology-based visual query formulation, in: Proceedings of the 11th International Conference Flexible Query Answering Systems (FQAS 2015), Advances in Intelligent Systems and Computing, Vol. 400, Springer, 2015, pp. 243–255. doi:10.1007/978-3-319-26154-6_19.

48.

Soylu,

Giese,

Jiménez-Ruiz,

Kharlamov,

Zheleznyakov and

Horrocks, Towards exploiting query history for adaptive ontology-based visual query formulation, in: Proceedings of the 8th Metadata and Semantics Research Conference (MTSR 2014), CCIS, Vol. 478, Springer, 2014, pp. 107–119.

49.

Soylu,

Giese,

Jimenez-Ruiz,

Vega-Gorgojo and

Horrocks, Experiencing OptiqueVQS – A multi-paradigm and ontology-based visual query system for end-users, Universal Access in the Information Society15(1) (2016), 129–152. doi:10.1007/s10209-015-0404-5.

50.

Soylu,

Giese,

Kharlamov,

Jimenez-Ruiz,

Zheleznyakov and

Horrocks, Ontology-based end-user visual query formulation: Why, what, who, how, and which? Universal Access in the Information Society, in press.

51.

Soylu,

Giese,

Schlatte,

Jimenez-Ruiz,

Ozcep and

Brandt, A visual query system for stream data access over ontologies, in: Proceedings of the Satellite Events of the 13th European Conference on the Semantic Web (ESWC 2016), LNCS, Vol. 9989, Springer, 2016, pp. 161–166.

52.

Soylu,

Giese,

Schlatte,

Jimenez-Ruiz,

Ozcep and

Brandt, Domain experts surfing on stream sensor data over ontologies, in: Proceedings of the 1st International Workshop on Semantic Web Technologies for Mobile and Pervasive Environments (SEMPER 2016), CEUR Workshop Proceedings, Vol. 1588, CEUR-WS.org, 2016.

53.

Soylu,

Kharlamov,

Zheleznyakov,

Jimenez-Ruiz,

Giese and

Horrocks, Ontology-based visual query formulation: An industry experience, in: Proceedings of the 11th International Symposium on Visual Computing (ISVC 2015), LNCS, Vol. 9474, Springer, 2015, pp. 842–854.

54.

Soylu,

Kharlamov,

Zheleznyakov,

Jimenez Ruiz,

Giese,

M.G.

Skjæveland,

Hovland,

Schlatte,

Brandt,

Lie and

Horrocks, OptiqueVQS: a Visual Query System Over Ontologies For Industry, An International Journal, submitted.

55.

Soylu,

Moedritscher,

Wild,

De Causmaecker and

Desmet, Mashups by orchestration and widget-based personal environments: Key challenges, solution strategies, and an application, Program: Electronic Library and Information Systems46(4) (2012), 383–428. doi:10.1108/00330331211276486.

56.

Soylu,

Wild,

Mödritscher,

Desmet,

Verlinde and

De Causmaecker, Mashups and widget orchestration, in: Proceedings of the International Conference on Management of Emergent Digital EcoSystems (MEDES 2011), ACM, 2011, pp. 226–234.

57.

D.-E.

Spanos,

Stavrou and

Mitrou, Bringing relational databases into the Semantic Web: A survey, Semantic Web3(2) (2012), 169–209.

58.

Suh and

B.B.

Bederson, OZONE: A zoomable interface for navigating ontology information, in: Proceedings of the Working Conference on Advanced Visual Interfaces (AVI 2002), ACM, 2002, pp. 139–143. doi:10.1145/1556262.1556284.

59.

Tunkelang and

Marchionini, Faceted search, in: Synthesis Lectures on Information Concepts, Retrieval, and Services, Morgan and Claypool Publishers, 2009.

60.

Uren,

Lei,

Lopez,

Liu,

Motta and

Giordanino, The usability of semantic search tools: A review, The Knowledge Engineering Review22(4) (2007), 361–377. doi:10.1017/S0269888907001233.

61.

C.J.

van Rijsbergen, Information Retrieval, Butterworth-Heinemann, 2nd edn, 1979.

62.

Yang,

Wu and

Zhu, Combining proactive and reactive predictions for data streams, in: Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery in Data Mining (KDD 2005), ACM, 2005, pp. 710–715.

63.

Zhang,

Minh Duc,

Corcho and

Calbimonte, SRBench: A streaming RDF/SPARQL benchmark, in: Proceedings of 11th International Semantic Web Conference (ISWC 2012), LNCS, Vol. 7649, Springer, 2012, pp. 641–657.

64.

M.M.

Zloof, Query-by-example: A data base language, IBM Systems Journal16(4) (1977), 324–343. doi:10.1147/sj.164.0324.