DQ-MAN: A tool for multi-dimensional data quality analysis in IoT-based air quality monitoring systems

ABSTRACT: Air quality monitoring has traditionally been performed using robust specialized systems based on an air filter. These systems provide high quality data, but entail a high investment, thus limiting the scale of the deployment. An alternative way of measuring air pollution is the use of opt...

Full description

Autores:
Gaviria Gómez, Natalia
Buelvas Pérez, Julio Hernán
Múnera Ramírez, Danny Alexandro
Tipo de recurso:
Article of investigation
Fecha de publicación:
2023
Institución:
Universidad de Antioquia
Repositorio:
Repositorio UdeA
Idioma:
eng
OAI Identifier:
oai:bibliotecadigital.udea.edu.co:10495/35075
Acceso en línea:
https://hdl.handle.net/10495/35075
Palabra clave:
Exactitud de los Datos
Data Accuracy
Internet de las Cosas
Internet of Things
Control de la Calidad del Aire
Air Quality Control
Rights
openAccess
License
http://creativecommons.org/licenses/by-nc-nd/2.5/co/
id UDEA2_ee7de9d76a1707c7e1c0a504af5b3f42
oai_identifier_str oai:bibliotecadigital.udea.edu.co:10495/35075
network_acronym_str UDEA2
network_name_str Repositorio UdeA
repository_id_str
dc.title.spa.fl_str_mv DQ-MAN: A tool for multi-dimensional data quality analysis in IoT-based air quality monitoring systems
title DQ-MAN: A tool for multi-dimensional data quality analysis in IoT-based air quality monitoring systems
spellingShingle DQ-MAN: A tool for multi-dimensional data quality analysis in IoT-based air quality monitoring systems
Exactitud de los Datos
Data Accuracy
Internet de las Cosas
Internet of Things
Control de la Calidad del Aire
Air Quality Control
title_short DQ-MAN: A tool for multi-dimensional data quality analysis in IoT-based air quality monitoring systems
title_full DQ-MAN: A tool for multi-dimensional data quality analysis in IoT-based air quality monitoring systems
title_fullStr DQ-MAN: A tool for multi-dimensional data quality analysis in IoT-based air quality monitoring systems
title_full_unstemmed DQ-MAN: A tool for multi-dimensional data quality analysis in IoT-based air quality monitoring systems
title_sort DQ-MAN: A tool for multi-dimensional data quality analysis in IoT-based air quality monitoring systems
dc.creator.fl_str_mv Gaviria Gómez, Natalia
Buelvas Pérez, Julio Hernán
Múnera Ramírez, Danny Alexandro
dc.contributor.author.none.fl_str_mv Gaviria Gómez, Natalia
Buelvas Pérez, Julio Hernán
Múnera Ramírez, Danny Alexandro
dc.contributor.researchgroup.spa.fl_str_mv Grupo de Investigación en Telecomunicaciones Aplicadas (GITA)
Intelligent Information Systems Lab.
dc.subject.decs.none.fl_str_mv Exactitud de los Datos
Data Accuracy
Internet de las Cosas
Internet of Things
Control de la Calidad del Aire
Air Quality Control
topic Exactitud de los Datos
Data Accuracy
Internet de las Cosas
Internet of Things
Control de la Calidad del Aire
Air Quality Control
description ABSTRACT: Air quality monitoring has traditionally been performed using robust specialized systems based on an air filter. These systems provide high quality data, but entail a high investment, thus limiting the scale of the deployment. An alternative way of measuring air pollution is the use of optical sensors, which are mounted on an embedded system, leading to a lower cost, as compared to the traditional solution. While these systems allow for a wider deployment at a lower cost, there is a concern on the quality of the data provided by them. In this context, the analysis of Data Quality (DQ) takes special relevance, in order to meet the requirements established by environmental agencies. In order to tackle this issue, this paper proposes a multi-dimensional model that estimates a unified DQ index, based on the integration of the relevant DQ dimensions and the subjective preferences of experts in the field. We present the development of DQ-MAN, a tool that allows the end-user to assess and visualize the DQ metrics over different time frames, and to compute the corresponding DQ index. Our tool allows the user to publish the summarized results in a web report. We validate DQ-MAN using a synthetic dataset to assess the correctness of our tool, as well as a real dataset of a low-cost monitoring system deployed in Medellín, Colombia. Based on the evaluation, we conclude that DQ-MAN is aware of changes in DQ, and how each dimension affects the overall DQ assessment.
publishDate 2023
dc.date.accessioned.none.fl_str_mv 2023-05-19T19:51:22Z
dc.date.available.none.fl_str_mv 2023-05-19T19:51:22Z
dc.date.issued.none.fl_str_mv 2023
dc.type.spa.fl_str_mv Artículo de investigación
dc.type.coar.spa.fl_str_mv http://purl.org/coar/resource_type/c_2df8fbb1
dc.type.redcol.spa.fl_str_mv https://purl.org/redcol/resource_type/ART
dc.type.coarversion.spa.fl_str_mv http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.driver.spa.fl_str_mv info:eu-repo/semantics/article
dc.type.version.spa.fl_str_mv info:eu-repo/semantics/publishedVersion
format http://purl.org/coar/resource_type/c_2df8fbb1
status_str publishedVersion
dc.identifier.issn.none.fl_str_mv 2543-1536
dc.identifier.uri.none.fl_str_mv https://hdl.handle.net/10495/35075
dc.identifier.doi.none.fl_str_mv 10.1016/j.iot.2023.100769
dc.identifier.eissn.none.fl_str_mv 2542-6605
identifier_str_mv 2543-1536
10.1016/j.iot.2023.100769
2542-6605
url https://hdl.handle.net/10495/35075
dc.language.iso.spa.fl_str_mv eng
language eng
dc.relation.ispartofjournalabbrev.spa.fl_str_mv Internet Things J.
dc.relation.citationendpage.spa.fl_str_mv 18
dc.relation.citationstartpage.spa.fl_str_mv 1
dc.relation.citationvolume.spa.fl_str_mv 22
dc.relation.ispartofjournal.spa.fl_str_mv Internet of Things
dc.rights.uri.*.fl_str_mv http://creativecommons.org/licenses/by-nc-nd/2.5/co/
dc.rights.uri.spa.fl_str_mv https://creativecommons.org/licenses/by-nc-nd/4.0/
dc.rights.accessrights.spa.fl_str_mv info:eu-repo/semantics/openAccess
dc.rights.coar.spa.fl_str_mv http://purl.org/coar/access_right/c_abf2
rights_invalid_str_mv http://creativecommons.org/licenses/by-nc-nd/2.5/co/
https://creativecommons.org/licenses/by-nc-nd/4.0/
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.extent.spa.fl_str_mv 18
dc.format.mimetype.spa.fl_str_mv application/pdf
dc.publisher.spa.fl_str_mv Elsevier
dc.publisher.place.spa.fl_str_mv Países Bajos
institution Universidad de Antioquia
bitstream.url.fl_str_mv https://bibliotecadigital.udea.edu.co/bitstreams/7c644fb9-1627-4ed2-88ed-8121acbba153/download
https://bibliotecadigital.udea.edu.co/bitstreams/2ba654d8-0901-4738-8246-9b6c6c2868ea/download
https://bibliotecadigital.udea.edu.co/bitstreams/fa65c45d-6766-4687-82e2-b9fd1d9e47e7/download
https://bibliotecadigital.udea.edu.co/bitstreams/bdf49c1c-4314-453d-b5ac-1d034a66d48e/download
https://bibliotecadigital.udea.edu.co/bitstreams/a8045531-2b50-4a9b-8d21-750b848ec0b3/download
bitstream.checksum.fl_str_mv 3eca31d185558f955bc8cc02b8fe1ef7
b88b088d9957e670ce3b3fbe2eedbc13
8a4605be74aa9ea9d79846c1fba20a33
4bf696da20dc0eac9070048a1ea687e0
e7791e66a20dc60e0961ad3c19904e5f
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositorio Institucional de la Universidad de Antioquia
repository.mail.fl_str_mv aplicacionbibliotecadigitalbiblioteca@udea.edu.co
_version_ 1851052612378427392
spelling Gaviria Gómez, NataliaBuelvas Pérez, Julio HernánMúnera Ramírez, Danny AlexandroGrupo de Investigación en Telecomunicaciones Aplicadas (GITA)Intelligent Information Systems Lab.2023-05-19T19:51:22Z2023-05-19T19:51:22Z20232543-1536https://hdl.handle.net/10495/3507510.1016/j.iot.2023.1007692542-6605ABSTRACT: Air quality monitoring has traditionally been performed using robust specialized systems based on an air filter. These systems provide high quality data, but entail a high investment, thus limiting the scale of the deployment. An alternative way of measuring air pollution is the use of optical sensors, which are mounted on an embedded system, leading to a lower cost, as compared to the traditional solution. While these systems allow for a wider deployment at a lower cost, there is a concern on the quality of the data provided by them. In this context, the analysis of Data Quality (DQ) takes special relevance, in order to meet the requirements established by environmental agencies. In order to tackle this issue, this paper proposes a multi-dimensional model that estimates a unified DQ index, based on the integration of the relevant DQ dimensions and the subjective preferences of experts in the field. We present the development of DQ-MAN, a tool that allows the end-user to assess and visualize the DQ metrics over different time frames, and to compute the corresponding DQ index. Our tool allows the user to publish the summarized results in a web report. We validate DQ-MAN using a synthetic dataset to assess the correctness of our tool, as well as a real dataset of a low-cost monitoring system deployed in Medellín, Colombia. Based on the evaluation, we conclude that DQ-MAN is aware of changes in DQ, and how each dimension affects the overall DQ assessment.COL0044448COL002593418application/pdfengElsevierPaíses Bajoshttp://creativecommons.org/licenses/by-nc-nd/2.5/co/https://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccesshttp://purl.org/coar/access_right/c_abf2DQ-MAN: A tool for multi-dimensional data quality analysis in IoT-based air quality monitoring systemsArtículo de investigaciónhttp://purl.org/coar/resource_type/c_2df8fbb1https://purl.org/redcol/resource_type/ARThttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionExactitud de los DatosData AccuracyInternet de las CosasInternet of ThingsControl de la Calidad del AireAir Quality ControlInternet Things J.18122Internet of ThingsPublicationORIGINALBuelvasJulio_2023_DQ-MANDataAnalysisMonitoringSystems.pdfBuelvasJulio_2023_DQ-MANDataAnalysisMonitoringSystems.pdfArtículo de investigaciónapplication/pdf2329664https://bibliotecadigital.udea.edu.co/bitstreams/7c644fb9-1627-4ed2-88ed-8121acbba153/download3eca31d185558f955bc8cc02b8fe1ef7MD51trueAnonymousREADCC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8823https://bibliotecadigital.udea.edu.co/bitstreams/2ba654d8-0901-4738-8246-9b6c6c2868ea/downloadb88b088d9957e670ce3b3fbe2eedbc13MD52falseAnonymousREADLICENSElicense.txtlicense.txttext/plain; charset=utf-81748https://bibliotecadigital.udea.edu.co/bitstreams/fa65c45d-6766-4687-82e2-b9fd1d9e47e7/download8a4605be74aa9ea9d79846c1fba20a33MD53falseAnonymousREADTEXTBuelvasJulio_2023_DQ-MANDataAnalysisMonitoringSystems.pdf.txtBuelvasJulio_2023_DQ-MANDataAnalysisMonitoringSystems.pdf.txtExtracted texttext/plain90886https://bibliotecadigital.udea.edu.co/bitstreams/bdf49c1c-4314-453d-b5ac-1d034a66d48e/download4bf696da20dc0eac9070048a1ea687e0MD54falseAnonymousREADTHUMBNAILBuelvasJulio_2023_DQ-MANDataAnalysisMonitoringSystems.pdf.jpgBuelvasJulio_2023_DQ-MANDataAnalysisMonitoringSystems.pdf.jpgGenerated Thumbnailimage/jpeg14421https://bibliotecadigital.udea.edu.co/bitstreams/a8045531-2b50-4a9b-8d21-750b848ec0b3/downloade7791e66a20dc60e0961ad3c19904e5fMD55falseAnonymousREAD10495/35075oai:bibliotecadigital.udea.edu.co:10495/350752025-03-27 01:04:12.237http://creativecommons.org/licenses/by-nc-nd/2.5/co/open.accesshttps://bibliotecadigital.udea.edu.coRepositorio Institucional de la Universidad de Antioquiaaplicacionbibliotecadigitalbiblioteca@udea.edu.coTk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=