A Big Data Platform for Smart Meter Data Analytics

Wilcox, Tom and Jin, Nanlin (2019) A Big Data Platform for Smart Meter Data Analytics. Computers in Industry, 105. pp. 250-259. ISSN 0166-3615

[img] Text
Wilcox, Jin - A Big Data Platform for Smart Meter Data Analytics AAM.pdf - Accepted Version
Restricted to Repository staff only until 22 January 2021.

Download (1MB)
Official URL: https://doi.org/10.1016/j.compind.2018.12.010

Abstract

Smart grids have started generating an ever increasingly large volume of data. Extensive research has been done in meter data analytics for small data sets of electrical grid and electricity consumption. However limited research has investigated the methods, systems and tools to support data storage and data analytics for big data generated by smart grids.

This work has proposed a new core-broker-client system architecture for big data analytics. Its implemented platform is named Smart Meter Analytics Scaled by Hadoop (SMASH). Our work has demonstrated that SMASH is able to perform data storage, query, analysis and visualization tasks on large data sets at 20 TB scale. The performance of SMASH in storing and querying large quantities of data are compared with the published results provided by Google Cloud, IBM, MongoDB, and AMPLab. The experimental results suggest that SMASH provides industry a competitive and easily operable platform to manage big energy data and visualize knowledge, with potential to support data-intensive decision making.

Item Type: Article
Uncontrolled Keywords: Big data, Smart grid, Meter data analytics
Subjects: G400 Computer Science
G500 Information Systems
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Paul Burns
Date Deposited: 13 Dec 2018 13:34
Last Modified: 28 Jan 2019 09:31
URI: http://nrl.northumbria.ac.uk/id/eprint/37237

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics


Policies: NRL Policies | NRL University Deposit Policy | NRL Deposit Licence