Enabling semantic integration

1. Date: 23/09/2010FIS 2010 DoctoralConsortiumEnabling Semantic Integration of Streaming Data SourcesJean-Paul CalbimonteOntology Engineering Group. Departamento de Inteligencia Artificial.Facultad de Informática, Universidad Politécnica de Madrid. Campus de Montegancedo s/n. 28660 Boadilla del Monte. Madrid. Spain{jpcalbimonte}@fi.upm.esSupervisor: Oscar CorchoDC Scientific advisor: AchimRettinger

2. IndexIntroductionProblem statementMain research questionsApproachProposed solutionWork done so farEvaluation Future work2EnablingSemanticIntegration of Streaming Data Sources

3. Introduction & Scope3Streaming Data

4. Continuously appended data

5. Potentially infinite

6. Time-stamped tuples

7. Continuous queries

8. Latest used in queries

9. Windows: time information and tuple based(t9, a1, a2, ... , an)(t8, a1, a2, ... , an)(t7, a1, a2, ... , an)......(t1, a1, a2, ... , an)......Window [t7 - t9]Streaming Data Sensor Networks characteristics

10. Cheap, Noisy, Unreliable (depends)

11. Low computational, power resources, storage

12. Distributed query execution

13. Routing, OptimizationQueryEnablingSemanticIntegration of Streaming Data Sources

14. Problem StatementHeterogeneous sources: schemas, stream rates, QoS, delivery mechanisms

15. Distributed sources

16. Semantic heterogeneity

17. Semantic data provision only for stored data

18. Need for live streaming continuous queriesSensor NetworkDatabase DataIntegrateDecl. QueryIntegrated viewStream Data4SemanticIntegrationStreaming Data Sources

19. Main Research QuestionsProvide semantic query interfaces for streaming data

20. Expose streaming data for the semantic web

21. Integrate streaming sources through ontology mappings

22. Optimize distributed query execution for streaming + stored dataOntology-based Data AccessHeterogeneous data IntegrationStreaming Data AccessDistributed Query ProcessingRDF Streams QueryingSemantic Integratorq5EnablingSemanticIntegration of Streaming Data Sources

23. 6General ApproachRelated work: literature and existing approaches

24. Identify limitations

25. Potential gaps

26. Incremental solution proposals

27. Ontology-based data access to streams

28. Semantic streaming query language

29. Semantic integration for distributed streams

30. Stream query optimization

31. Evaluation

32. SemSorGrid4Env project

33. Benchmarks, LinearRoadEnablingSemanticIntegration of Streaming Data Sources

34. 7Proposed SolutionClientSPARQLSTR (Og) Query reconciliationOntology-to-OntologymappingsSPARQLSTR (O1 O2On) Query translationOntology-to-SourcemappingsSensor Network (S1)SPARQLSTR algebra(S1 S2 Sm) Relational DB (S2)RewriterQuery EvaluatorOptimizerRewriterStream Engine (S3)Distributed Query ProcessingRDF Store (Sm)Ontology-based Streaming Data Access Service7SemanticIntegrationStreaming Data Sources

35. So Far…Ontology-base data accessDefinestream extensions for R2O

36. Define SPARQLSTRlanguagesyntax and semantics

37. Enableengine support for « S2O » documents, SPARQLSTR queries

38. Enabledengine support for SNEEql translation and connection

39. Limited to non-distributed scenario initially8SemanticIntegrationStreaming Data Sources

40. vvSo Far...9Enabling Semantic Integration of Streaming Data Sourcesenvdata_westbayFeatureenvdata_chesillocatedInRegionvenvdata_milfordObservationhasObservationResultS2O Mappingvenvdata_hornseaStreamsOntologiesobservedPropertyenvdata_rhylflatsRegionxsd:floatTimestamp: longHs : floatLon: floatLat: floatWaveHeightPropertyPREFIX cd: <http://www.semsorgrid4env.eu/ontologies/CoastalDefences.owl#>PREFIX sb: <http://www.w3.org/2009/SSN-XG/Ontologies/SensorBasis.owl#> PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> SELECT ?waveheight ?wavets ?lat ?lonFROM STREAM <http://www.semsorgrid4env/ccometeo.srdf> WHERE { ?WaveObs a cd:Observation; cd:observationResult ?waveheight; cd:observationResultTime ?wavets;cd:observationResultLatitude ?lat;cd:observationResultLongitude ?lon;cd:observedProperty ?waveProperty;cd:featureOfInterest ?waveFeature. ?waveFeature a cd:Feature;cd:locatedInRegioncd:SouthEastEnglandCCO. ?waveProperty a cd:WaveHeight. }(SELECT Lon,timestamp,Hs,Lat FROM envdata_rhylflats) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_hornsea) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_milford) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_chesil) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_perranporth) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_westbay) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_pevenseybay)SNEEqlSPARQLSTR

41. 10Future WorksOntology-based data access

42. SPARQL construct expressions, aggregates, projected operators

43. Implement adapters for other streaming sources

44. Add query rewriting algorithms

45. Ontology-based streaming data integration

46. Horizontal & vertical integration

47. Integrate streaming + stored data

48. RDF data sources integration

49. Streaming query optimization

50. Analyze cost models

51. Streaming sources statistics and metadata

52. Quantitative evaluation10SemanticIntegrationStreaming Data Sources

53. Thanks!11Enabling Semantic Integration of Streaming Data SourcesEnabling Semantic Integration of Streaming Data Sources

54. 12Red de Ontologías para el Camino de SantiagoReferencesArasu, A., Babcock, B., Babu, S., Cieslewicz, J., Datar, M., Ito, K., Motwani, R., Srivastava, U., Widom, J.: Stream: The stanford data stream management system. In Garofalakis, M., Gehrke, J., Rastogi, R., eds.: Data Stream Management. (2006)

55. Sahoo, S.S., Halb, W., Hellmann, S., Idehen, K., Jr, T.T., Auer, S., Sequeda, J., Ezzat, A.: A survey of current approaches for mapping of relational databases to RDF. W3C (January 2009)

56. Arasu, A., Babu, S., Widom, J.: The cql continuous query language: semantic foundations and query execution. The VLDB Journal 15(2) (June 2006) 121-142

57. Brenninkmeijer, C.Y., Galpin, I., Fernandes, A.A., Paton, N.W.: A semantics for a query language over sensors, streams and relations. In: BNCOD '08. (2008) 87-99

58. Barrasa, J., Oscar Corcho, Gomez-Perez, A.: R2O, an extensible and semantically based database-to-ontology mapping language. In: SWDB2004. (2004) 1069-1070

59. Lenzerini, M.: Data integration: a theoretical perspective. In: PODS '02. (2002) 233-246

60. Barrasa Rodriguez, J., Gomez-Perez, A.: Upgrading relational legacy data to the semantic web. In: WWW '06. (2006) 1069-1070

61. Barbieri, D.F., Braga, D., Ceri, S., Della Valle, E., Grossniklaus, M.: C-sparql: A continuous query language for rdf data streams (to appear). In: (IJSC). (2010)

62. Bolles, A., Grawunder, M., Jacobi, J.: Streaming SPARQL - extending SPARQL to process data streams. In: ESWC 08. (2008) 448-462

63. Kossmann, D.: The state of the art in distributed query processing. ACM Comput. Surv. 32(4) (2000) 422-469

64. Perez, J., Arenas, M., Gutierrez, C.: Semantics and complexity of sparql. ACM Trans. Database Syst. 34(3) (2009) 1-45

65. Calvanese, D., De Giacomo, G., Lembo, D., Lenzerini, M., Rosati, R.: DL-Lite: Tractable description logics for ontologies. In: AAAI 2005. (2005) 602-607

66. Poggi, A., Lembo, D., Calvanese, D., Giacomo, G.D., Lenzerini, M., Rosati, R.: Linking data to ontologies. J. Data Semantics 10 (2008) 133-173

67. Perez-Urbina, H., Horrocks, I., Motik, B.: Ecient query answering for owl 2. In: ISWC 2009. (2009) 489-504Introduction & Scope13SemanticIntegrationStreaming Data SourcesSemSorGrid4Env Development of an integrated informationspace where new sensor networks can be easily discovered and integrated with existing ones and possibly other data sources (e.g., historical databases) Rapid development of flexible and user-centric decision support systems that use data from multiple autonomous independently deployed sensor networks and other applications.

68. Ontology-based data access & integrationSquirrelRDFRDBToOntoRelational.OWLSPASQLVirtuosoD2RQMASTROR2O + ODEMapsterODEMapsterMySQLOracle...othersODEMQLTransformrelational queryOntological queryOntological modelDatabaseOWLMappingR2OOBSERVERSIMSCarnotDWQPICSELMOMISOntological queryOntological modelTransformrelational queryDatabasesMappings14SemanticIntegrationStreaming Data Sources

69. 15Background: Approaches & TechnologiesDSMSDQPQPS-RDFOntology-based Data AccessHeterogeneous data IntegrationStreaming Data AccessDistributed Query ProcessingRDF Streams QueryingR2O + ODEMapsterC-SPARQL extensionsSNEE/SNEEqlSemantic Integratorq15SemanticIntegrationStreaming Data Sources

70. 16S2O: MappingStreamsto Ontologiesconceptmap-def WindSpeedMeasurementuri-as concat('ssg4env:WindSpeedMeasurement_',windsamples.sensorid,windsamples.ts) described-byattributemap-defhasSpeed operation "constant" has-column windsamples.speeddbrelationmap-def isProducedBytoConceptSensor joins-via condition "equals" has-column sensors.sensorid has-column windsamples.sensoridconceptmap-def Sensoruri-asconcat('ssg4env:Sensor_',sensors.sensorid) described-byattributemap-def hasName operation "constant" has-column sensors.sensornameS:WindSamplests

71. speed

72. direction

73. sensoridWindSpeedMeasurementhasSpeedxsd:floatMeasurementisProducedByT:Sensors- sensoridsensornameSensorhasNamexsd:string16SemanticIntegrationStreaming Data Sources

74. 17Red de Ontologías para el Camino de SantiagoQueryTransformationSemanticsConjunctiveQueries

75. Mappingexpressionoverstreamingsourcesconjunctivequery

76. 18From SPARQLSTRtoSNEEqlSemantic IntegratorSELECTconcat( ‘ssg4env.eu#Sensor' , sensors.sensorid ) as a1 , ( sensors.sensorname ) as name FROM sensorsSELECTconcat(‘ssg4env.eu#WindSpeedMeasurement' , windsensor.id , windsensor.ts ) as a1 , ( windsensor.speed ) as speed FROMwindsensor[ FROM NOW - 10 TO NOW MIN]SELECTconcat(‘ssg4env.eu#WindSpeedMeasurement' , windsensor.id, windsensor.ts ) as a1 , concat( ‘ssg4env.eu#Sensor' , sensors.sensorid ) as a2 FROM sensors, windsensor[ FROM NOW - 10 TO NOW MIN] WHERE ( sensors.sensorid = windsensor.id )PREFIX fire: http://www.semsorgrid4env.eu#

77. PREFIX rdf: http://www.w3.org/1999/02/22-rdf-syntax-ns#

78. SELECT ?speed ?name

79. FROM STREAM <http://www.ssg4env.eu/Readings.srdf>

80. [RANGE 10 MINUTE STEP 1 MINUTE]

81. WHERE {

82. ?WindSpeed a fire:WindSpeedMeasurement;

83. fire:hasSpeed ?speed;

84. fire:isProducedBy ?sensor;

85. fire:hasTimestamp ?time.

86. ?sensor a fire:Sensor;

87. fire:hasName ?name.

88. }Work in progress: removing redundant queries, basic optimisations, more complex scenarios18SemanticIntegrationStreaming Data Sources

89. 19SemanticIntegrationInteractionsSemantic IntegratorStreaming Data ResourceStored Data ResourceConsumerIntegrateAs (StrRes,StoRes,map)IntegratedResSPARQLExecuteFactory(IntegratedRes, query)SNEEqlExecuteFactory(StreamingRes, querySNEEql)accessStreamingResGetResponseItem(accessStreamingRes)repeatresultsSQLExecuteFactory(StoredRes, querySQL)resultsaccessIntegratedResGetResponseItem(accessIntegratedRes)19SemanticIntegrationStreaming Data Sources

Enabling semantic integration

More Related Content

Viewers also liked (7)

Similar to Enabling semantic integration (20)

More from Jean-Paul Calbimonte (20)

Recently uploaded (20)

Enabling semantic integration