Thursday, October 16, 2014

Transforming Cities with Big Data

The concept of using data to assist cities is nothing new. It has existed for a long time. However, with the advent of cheaper data storage and processing technologies, it has become relatively easy for cities to start using newer sources of data and existing public data in larger scale. The benefits of utilizing Big Data analytics are many -- to name a few: a more informed policy making, better crime predictions, improved roads and traffic regulation, a smarter energy grid.

Chicago has been a model city in this area. It has been one of the first cities in the US to vigorously implement Big Data technologies to improve its administration. Recently, Chicago developed a product called “WindyGrid”, which processes 7 million lines of code every day from various sources such as tweets, security cameras, traffic lights etc. The platform's primary objectives are to provide situational awareness and incident monitoring, historical data retrieval, and real-time advanced analytics to various departments in the city to give them greater access and visibility to city wide data.

Additionally, Chicago's Department of Streets and Sanitation has started analyzing data from 311 calls to predict where the next rodent breakout is most likely to occur. Based on this data, the department is trying to send out rat-baiters before the outbreak occurs, as a result, saving money. Chicago has also established its own online data portal where city data can be accessed and downloaded for free. Third party developers can easily utilize this data to create their own smart city solutions. 


Image Source: http://datasmart.ash.harvard.edu/


Like Chicago many American cities have also launched online data portals. In fact, many states have also launched such portals to make statewide data easily accessible. Unstructured data from tweets, facebook posts, phone recordings can easily be analyzed using Hadoop based technologies. The data is there and the technology is there. It is only a matter effectively analysing this data and building right innovative solutions to build smarter cities.

Some Links:

Chicago Data Portal: https://data.cityofchicago.org/
IL Data Portal: https://data.illinois.gov/
Federal Government Data Portal: https://www.data.gov/

Friday, October 10, 2014

GE and The Industrial Internet

Just yesterday (9th October 2014) GE officially opened up its flagship Industrial Big Data platform called Predix to third party development. Predix puts the spotlight on something now commonly referred to as the "Industrial Internet", a system of large-scale data collection from sensors placed into machines and the analysis of this data to improve industrial processes.


Image source: www.trainordavisdesign.com

GE has already deployed around 10 million sensors into the many types of industrial equipment it manufactures. Currently, these sensors are generating over 50 millions units of data every data. Using the Predix platform and the data from these sensors, GE aims to build a smart network of machines laced with advanced analytics, wherein the machines get to communicate with each other and their human operators to create large efficiency improvements in their performance. Pedix platform is not just restricted to GE products; it can be used by any vendor and, furthermore, anyone (customers, vendors, or third-party developers) is free to develop apps on this platform to fit their needs.

Industrial data if applied smartly and analyzed correctly has a huge potential. The manufacturing plants of the future might not have to worry about costly downtime anymore -- with the help of the industrial internet, these facilities might be able to predict if there is a problem in a machine and fix it preemptively. The airline industry looses billions of dollars every year due to flight delays resulting from unscheduled maintenance. Equipping jet engines with sensors and monitoring the engine performance could greatly reduce the frequency of such incidences. Just knowing how a machine is performing and where specifically a problem has occurred could greatly assist in fixing the machine correctly and with ease. Furthermore, by using this data, machine manufacturers such as GE, will be able to design more resilient machines in the future.

The possibilities are endless. However, it is important to note that as with any technology, a cautious approach is needed. A large scale usage of the industrial internet before testing it out fully and establishing foolproof security measures could have huge negative consequences. All in all, there is no doubt that this is a great time to launch the Predix platform. The Industrial world, which has been largely untouched by the internet revolution, is hungry for a technological revolution of its own.


Some Links:

TED talk on Industrial Internet by Marco Annunziata: https://www.youtube.com/watch?v=QBDShp6U7tU

GE Predix Platform Webpage: https://www.gesoftware.com/platform

NY time Blog on Predix: http://bits.blogs.nytimes.com/2014/10/09/ge-opens-its-big-data-platform/?_php=true&_type=blogs&_r=0

GE news on opening up its platform to all users: http://www.genewsroom.com/press-releases/ge-open-predix-industrial-internet-platform-all-users-278755