Future of iot and big data
1 like•385 views
1) IOT and big data focus on real-time processing which can create autonomous control to reduce cost, time, energy and resources. When trillions of devices are connected through IP addresses, they will produce huge amounts of data which is challenging to control. 2) IOT and big data have applications in smart homes, cities, transportation and industry to make human life easier with less energy, money and time. Data from IOT devices is stored in big data for analysis using techniques like heterogeneous, nonlinear, high-dimensional and distributed parallel processing. 3) Key challenges for IOT, big data and their engineers include securing and authenticating the huge amounts of data from diverse sources, dealing with unreliable data and
![Future of IOT and Big data
By
Kashif khan
Kashif.namal@gmail.com
Professor Massimo Callistodedonato
massimo.callistodedonato@gruppofilippetti.it
Sheraz Ahmad
ahmadsheraz.cs@gmail.com
Abstract
In the current era, data is created by humans, robots and automatic machines which can be embedded
into sensors, electronics and other network connections. IOT and big data mainly focus on real-time
processing which can be create a new form of autonomous control which lead to reduce cost, time,
energy, resources. The idea behind the IOT is that every device will be connected through IP address.
When trillions of devices are connected to each other they will produce huge amount of data and
controlling this data is a big challenge. The big challenge for big data is that it will store real time data
continuously from different source of data. IOT forcing companies to upgrade systems, tools to
accommodate additional and real time data to take good advantage and take good result. In this paper
we will focus on what are the challenges and possible future technologies of IOT and Big data.
Introduction:
Big Data and IOT(Internet of thing) are the two emerging technologies which had great impact on future.
When we talk about IOT two things come to our mind connection and collection. In connections it discus
devices which can be connected to internet, sensors, and other communicating devices while in
collection it collect large groups of data[2]. Big data deal with three Vs challenges while IOT deal with
the combination of them. We almost think about smart cities, new transportation system, grids which
IOT will deal with it. The best thing in these two technologies is that it works on real time data which can
be fix before bugs, which can be predictive and which can be easily configurable with the integrations of
Human and machines.
There is also close interaction between Big Data and Business Intelligence. All business are going to
make a platform how they collect data for analysis, they take information from data and learn from it. If
we look at the whole data 2.8 trillion gigabytes of data are existing in the digital universe. And the
volume of data double every 1.5 years. Now if they the computer make a prediction or decision and
learn from data that what to do then it will be easy for humans to waste more time and cost. San jose in
California reported that IOT devices and application will reduce noise, pollution, resources air quality
etc.](https://image.slidesharecdn.com/futureofiotandbigdata-170514143706/85/Future-of-iot-and-big-data-1-320.jpg)
![IOT and big data have various applications let’s say people are going to get alert when the tray of meat is
empty in the refrigerator, or open the door for some special guest through IOT connected systems, and
specially IOT will be more helpful when you are away from your home and you want to off the electric
machines or the electric machine you will do it with the help of IOT applications. IOT and big data have
vital role in the industry and other daily life applications. In 2050 you will see world of machines and all
this will have only one goal to make human life easier with less energy, less money and the most
important is less time.
Fig 1 Framework of data with IOT
IOT and Big data are 2 sides of one coin, they have close relationship with each other. Data come from
IOT connected devices which may be heterogeneous or homogenous data but they all are stored in big
data storage. In the figure 1 it shows that analysis of data can be done through 4 different techniques. 1.
Heterogeneous data processing 2. Nonlinear data processing 3. High dimensional data processing 4.
Distributed and Parallel data processing [4].
Future Smart Cities:
Advanced technologies are going to make the cities smarter than before. It will improve quality of life,
they will make more luxuries and more facilitate the humans. They will manages resources, make more
easy roads with more facilities and the best thing is that it will reduced the environmental pollutions. As](https://image.slidesharecdn.com/futureofiotandbigdata-170514143706/85/Future-of-iot-and-big-data-2-320.jpg)
![according to NJIT university in 2023 smart cities will grow to 27 billion while in 2025 the world will be
divided into 88 smart cities and it will help to make global village. One of the main focus of IOT is
building smart homes that will allow home owners to adjust temprature, Hot water setting through
smart phones[7]. There will be some sensors which will read body tempratures and will ajust room
temprature.
Impacts of IOT on Big data:
IOT is basically network of connected physical devices which can be implemented through software,
sensor, other connected hardware’s and some electronic devices. It enhance the properties of
connected devices with the use of computer. Some of the advance technologies like NoSql, Data
Analysis, Hadoop, HDFS, HB Database, and Column Oriented etc. enhance the properties of IOT on Big
Data. There are 4 big factors which can be effected on big data by IOT.
a. Big Data Storage:
Big data solve many problem for data in emerging world. So for IOT big data storage is one of the
challenging task as the data rate goes faster than the normal rate. Big data stores consist of 3 Vs which
store huge amount of data with continuous balancing and provide input and output operation in
seconds and milliseconds. The most beautiful part in the big data is they store data from different data
sources which make the data more complex and huge. Looking to the needs of new world technologies
most companies are going to change the platform to PaaS (Platform as a service) model to handle
continuous data which give flexibility, scalability, reliability to IOT platform. Paas also use cloud storage
which also have the option to keep the data public, secure, or highlight the data which mostly depend
on the company requirements.
b. Big Data Security:
When heterogeneous data stored in the database the security problem takes place because its easy for
the attacker to hack the data. The lack of experience in heterogeneous data increase the high risk. For
IOT devices organization will change the authentication address to face the new world problem. Proper
segmentation of the network will help to prevent attacker to hack the data. Let say how you deal with
your home TV and your home camera that they are connected with unknown Wi-Fi. SDN technologies
can be use to connected point to point and point to multipoint with combination of identity and polices.
c. Big Data Analytics:
Extracting data from IOT is one of big challenge for the companies, organization should make proper
arrangement and a platform where they analyses and find that not all the data are important for IOT.
Big data is the analysis of data through to take information from raw facts. Big data consist of 3 Vs which
are huge Volume, Velocity, and Variety. High volume can be measured in PT or ZB, and the sources for
high Volume may be Sensors, Website, Social Data, and Connected Devices etc. While Variety may be of
structured and unstructured data and it could be different forms of data which may consist of 3d data,
2d data, log files, string, integers, doubles etc. Velocity of big data refers to the speed of data](https://image.slidesharecdn.com/futureofiotandbigdata-170514143706/85/Future-of-iot-and-big-data-3-320.jpg)
![We need to improve the technologies to solve the real problem we are facing with IOT and big data.
There are some areas like security, data storage, analysis which we must improve and upgrade. We
should use new technologies of IOT and big data to decrease time, resources and money. But this is true
that IOT and big data are made for each other.
Reference:
[1].http://www.kdnuggets.com/2015/07/impact-iot-big-data-landscape.html
[2]. http://www.tutorialspoint.com/articles/how-iot-impacts-big-data
[3]. http://data-informed.com/the-impact-of-internet-of-things-on-big-data/
[4]: Big Data Analytics in Future Internet of Things by Guoru Ding, Long Wang, Qihui Wu College of
Communications Engineering.
*5+: International Telecommunication Union (ITU), “ITU internet reports 2005: The internet of things,”
ITU, Executive Summary, Nov. 2005, http://www.itu.int/pub/S-POL-IR.IT-2005 [Accessed on: 2013-10-
25].
*6+. “The internet of thing and Big data systems. The international Bazar” by Phillip A. Laplante.
[7]. http://www.telegraph.co.uk/technology/ces/11340738/10-technologies-that-will-make-the-
Internet-of-Things-a-reality.html](https://image.slidesharecdn.com/futureofiotandbigdata-170514143706/85/Future-of-iot-and-big-data-5-320.jpg)
Future of iot and big data
- 1. Future of IOT and Big data By Kashif khan [email protected] Professor Massimo Callistodedonato [email protected] Sheraz Ahmad [email protected] Abstract In the current era, data is created by humans, robots and automatic machines which can be embedded into sensors, electronics and other network connections. IOT and big data mainly focus on real-time processing which can be create a new form of autonomous control which lead to reduce cost, time, energy, resources. The idea behind the IOT is that every device will be connected through IP address. When trillions of devices are connected to each other they will produce huge amount of data and controlling this data is a big challenge. The big challenge for big data is that it will store real time data continuously from different source of data. IOT forcing companies to upgrade systems, tools to accommodate additional and real time data to take good advantage and take good result. In this paper we will focus on what are the challenges and possible future technologies of IOT and Big data. Introduction: Big Data and IOT(Internet of thing) are the two emerging technologies which had great impact on future. When we talk about IOT two things come to our mind connection and collection. In connections it discus devices which can be connected to internet, sensors, and other communicating devices while in collection it collect large groups of data[2]. Big data deal with three Vs challenges while IOT deal with the combination of them. We almost think about smart cities, new transportation system, grids which IOT will deal with it. The best thing in these two technologies is that it works on real time data which can be fix before bugs, which can be predictive and which can be easily configurable with the integrations of Human and machines. There is also close interaction between Big Data and Business Intelligence. All business are going to make a platform how they collect data for analysis, they take information from data and learn from it. If we look at the whole data 2.8 trillion gigabytes of data are existing in the digital universe. And the volume of data double every 1.5 years. Now if they the computer make a prediction or decision and learn from data that what to do then it will be easy for humans to waste more time and cost. San jose in California reported that IOT devices and application will reduce noise, pollution, resources air quality etc.
- 2. IOT and big data have various applications let’s say people are going to get alert when the tray of meat is empty in the refrigerator, or open the door for some special guest through IOT connected systems, and specially IOT will be more helpful when you are away from your home and you want to off the electric machines or the electric machine you will do it with the help of IOT applications. IOT and big data have vital role in the industry and other daily life applications. In 2050 you will see world of machines and all this will have only one goal to make human life easier with less energy, less money and the most important is less time. Fig 1 Framework of data with IOT IOT and Big data are 2 sides of one coin, they have close relationship with each other. Data come from IOT connected devices which may be heterogeneous or homogenous data but they all are stored in big data storage. In the figure 1 it shows that analysis of data can be done through 4 different techniques. 1. Heterogeneous data processing 2. Nonlinear data processing 3. High dimensional data processing 4. Distributed and Parallel data processing [4]. Future Smart Cities: Advanced technologies are going to make the cities smarter than before. It will improve quality of life, they will make more luxuries and more facilitate the humans. They will manages resources, make more easy roads with more facilities and the best thing is that it will reduced the environmental pollutions. As
- 3. according to NJIT university in 2023 smart cities will grow to 27 billion while in 2025 the world will be divided into 88 smart cities and it will help to make global village. One of the main focus of IOT is building smart homes that will allow home owners to adjust temprature, Hot water setting through smart phones[7]. There will be some sensors which will read body tempratures and will ajust room temprature. Impacts of IOT on Big data: IOT is basically network of connected physical devices which can be implemented through software, sensor, other connected hardware’s and some electronic devices. It enhance the properties of connected devices with the use of computer. Some of the advance technologies like NoSql, Data Analysis, Hadoop, HDFS, HB Database, and Column Oriented etc. enhance the properties of IOT on Big Data. There are 4 big factors which can be effected on big data by IOT. a. Big Data Storage: Big data solve many problem for data in emerging world. So for IOT big data storage is one of the challenging task as the data rate goes faster than the normal rate. Big data stores consist of 3 Vs which store huge amount of data with continuous balancing and provide input and output operation in seconds and milliseconds. The most beautiful part in the big data is they store data from different data sources which make the data more complex and huge. Looking to the needs of new world technologies most companies are going to change the platform to PaaS (Platform as a service) model to handle continuous data which give flexibility, scalability, reliability to IOT platform. Paas also use cloud storage which also have the option to keep the data public, secure, or highlight the data which mostly depend on the company requirements. b. Big Data Security: When heterogeneous data stored in the database the security problem takes place because its easy for the attacker to hack the data. The lack of experience in heterogeneous data increase the high risk. For IOT devices organization will change the authentication address to face the new world problem. Proper segmentation of the network will help to prevent attacker to hack the data. Let say how you deal with your home TV and your home camera that they are connected with unknown Wi-Fi. SDN technologies can be use to connected point to point and point to multipoint with combination of identity and polices. c. Big Data Analytics: Extracting data from IOT is one of big challenge for the companies, organization should make proper arrangement and a platform where they analyses and find that not all the data are important for IOT. Big data is the analysis of data through to take information from raw facts. Big data consist of 3 Vs which are huge Volume, Velocity, and Variety. High volume can be measured in PT or ZB, and the sources for high Volume may be Sensors, Website, Social Data, and Connected Devices etc. While Variety may be of structured and unstructured data and it could be different forms of data which may consist of 3d data, 2d data, log files, string, integers, doubles etc. Velocity of big data refers to the speed of data
- 4. processing. Data from different devices like mobile devices, machine to machine, continuous data processing and real time processing. d. Tools of Big data and use: Now a days many providers and companies are going to change the platform and use the IOT technologies to reduce cost time etc. Now many of the providers are enhancing the products to use for IOT technologies. As far as companies are also going to enhance big data technologies like from SQL the produce no SQL, HB database etc. Organization already started experiment with existing challenges and they are going to enhance to solve more issues and problems. Big data Improve our life style, the camera will catch that how much time a teacher spend in the class in front of blackboard. Smart Sensor and devices could save a lot of power, energy, and money especially when you are away from home electrical devices. The rapid growth of IOT and Big data will change the complete system of life style. Issue for Reliability for Engineers: One of the big challenge for the IOT engineer is reliability and the reliability include signal loss, noise data, nonfunctional hardware, failure of sensor, and the most important is secure the network from attacks. There are 3 major challenges which are 1. Security 2. Uncertainty 3. Authentication The Big issue is Security in 2018 IDC reported that 66% of IOT networks have Security problems which mean IOT infrastructure is still in the trouble while engineers are trying to make more powerful platform for IOT. Uncertainty is also a big issue data could be corrupted or noisy data then it can also effect the communication. This is also issue like through which algorithm it will find which sensor is offline, or sensor missing data, or through which algorithm will make decision to retrieve data from offline servers. Authentication is also big issue which is related to trust. On which sensor a system can trust. When wrong sensor send the data to server or a very sensitive sensor down in a special area so how to resolve this issue. Major Challenges There are some big Challenges for the big data an IOT which are How to secure the data, How to make new business models, Rapid growth of data, how easy to get data, Reliability of data, analysis of data and how to avoid authentication problems these are some challenges which the engineers are working and are going to resolve the problems. Conclusion: This paper review about the impacts of IOT on big data, possible technologies and challenges. IOT and big data is completely new domain and most of the business companies adopt this to find useful values.
- 5. We need to improve the technologies to solve the real problem we are facing with IOT and big data. There are some areas like security, data storage, analysis which we must improve and upgrade. We should use new technologies of IOT and big data to decrease time, resources and money. But this is true that IOT and big data are made for each other. Reference: [1].http://www.kdnuggets.com/2015/07/impact-iot-big-data-landscape.html [2]. http://www.tutorialspoint.com/articles/how-iot-impacts-big-data [3]. http://data-informed.com/the-impact-of-internet-of-things-on-big-data/ [4]: Big Data Analytics in Future Internet of Things by Guoru Ding, Long Wang, Qihui Wu College of Communications Engineering. *5+: International Telecommunication Union (ITU), “ITU internet reports 2005: The internet of things,” ITU, Executive Summary, Nov. 2005, http://www.itu.int/pub/S-POL-IR.IT-2005 [Accessed on: 2013-10- 25]. *6+. “The internet of thing and Big data systems. The international Bazar” by Phillip A. Laplante. [7]. http://www.telegraph.co.uk/technology/ces/11340738/10-technologies-that-will-make-the- Internet-of-Things-a-reality.html