VALENCIA SMART CITY powered by TELEFONICA Global IoT Platform & RED HAT IoT & mobile solutions
David Bericat, Red Hat Global Partner IoT Solution Architect
Jose Antonio Polo, Red Hat GAM Telefonica
Alberto Torres, Red Hat Iberia Solution Architect
30th June 2016
AGENDA
l OVERVIEW
l VALENCIA SMART CITY
l GLOBAL IoT PLATFORM...
l ...POWERED BY : WHERE & WHY?
l WHAT IS NEXT?
WHO IS ?
Presence in 21 countries 125,000 professionals.322+ Million total accesses at Mar 2016€ 10,784 Million consolidated revenues in Jan-Mar 2016
“We want to create, protect and boost connections in life so people can choose a world of unlimited
possibilities. And by focusing on people, we aspire to become an Onlife Telco.
We want to be an ONLIFE TELCO, a telco for the people, a telco for your life.”
VIDEO
's IoT / SMART CITIES VISION
“Smart m2m technology enables intelligent interaction between objects, safely and affordably. The core of the Internet of Things; the hyper-connected world of the future, is available today within Telefonica portfolio of solutions for businesses”
VIDEO
& MOBILIZING THE WORLD TOGETHER
“Telefonica's decision to establish the Red Hat Mobile Application Platform as its reference platform for mobile development aligns with our strategy to deploy multitenant, multi-operator solutions based on open standards.
JUAN MANUEL MORENO
TELEFONICA BUSINESS SOLUTIONS’ CLOUD DIRECTOR”
& MOBILIZING THE IoT WORLD
Smart Cities Success Case - Valencia
Telefonica IoTEnero 2016
Valencia deployed a global platform, “Plataforma VLCi” for smart city management, that collects key indicators of municipal services , improving their efficiency and offering them transparently to the citizens.
Benefits✓Improve the quality of services provided✓Improve the environmental quality of the city✓Increase available information and additional services for citizens and businesses
✓Reduce public spending✓Encouraging innovation and entrepreneurship, thereby promoting the development of new businesses and local ideas
✓Improving, via additional and complete information, decision-making by the public administrator
OPEN DATA PORTAL DEMO
-Dashboard with city KPIs based on ISO 37120 standard platinum (12th city in the world to obtain this certification).
-Open data portal with more than 120 sets of data from multiple areas: tourism, transport, environment, health, urban planning.
-Management of city data from a single platform to give a holistic view of city services and making information accessible to citizens.
-Deployment of FIWARE compliant , Telefonica platform with availability of multiple modules and features:
•IoT Agents•NGSI API•BigData
•Business Intelligence •OpenData•
VIDEO
REAL TIME PARKING INFORMATION
COMPLEX AND HETEROGENEUS SYSTEMS TO CONNECT
THE CHALLENGES
VALENCIA SYSTEMS
Interface
Valencia Systems
Smart City Platform
HIGH LEVEL ARCHITECTURE
Interface
Interface
COMPOSE HOMOGENEOUS
DATA
Information acquisition• Sensor data with different technologies and protocols• Batch mode data from heterogeneus systems• Heterogeneus systems real-time data • Data to information transformation
Information distribution• Several sources management • Big volumes information
DATA BROKER
Information presentation• Report generation • Dashboards• Open data management
KPISDASHBOARD OPEN DATA
SMART CITY PLATFORM
SENSORS SYSTEMS
BIG DATA ANALYTICS TOOLSStorage and data analytics• Statistic and predictive analytics• Big Data analytics• Big volumes storage: structure and non structure
SMART CITY PLATFORM CAPABILITIES
Context Broker
Retrieves, maintains and deliver Context Information into the IoT Platform components and external systems Supports standard OMA NGSI9/10 Publish-Subscribe APIs
Connector Framework (Cygnus)Adapts NGSI data from Context Broker
to internal or external systems
IoT AgentsCollects data from devices using heterogeneous protocols and translates them
into standard NGSI entities.Supports UL/2.0, MQTT, Push/Pull Commands
PortalPlatform configuration portal
simplifying service set up
Big DataMap & Reduce based on Apache Hadoop
ST HistoricAllows users to search short term historic data
Open Data
Expose public data (based on CKAN de-
facto standard)
Iden
ti ty Man
ag
em
en
tP
rovid
es th
e plat fo
rm A
uth
e ntica
tion
& A
uth
orizat io
n
system: se
r vices
, user s, ro
l es an
d p
ermis
sion
s (O
au
th
2.0)
CEPAnalyses events, enabling instant predefined actions
ESB
ETL
SMART CITY PLATFORM COMPONENTS
IoT Agents
• Sensors/devices management and data capturing• High performance and scalability. Device integration.
• Data information modeling. Information normalization. Data enrichment
• Protocol support in production: HTTP/MQTT UL2.0 y HTTP/MQTT JSON (working on OneM2M, Sigfox, LWM2M)
• Plugins development framework for new protocols/sensors.
• Device inventory management. • Asset management tools. • New sensor integration APIs •
IoT DEVICES INTEGRATION
Context Broker
• Platform key component. • Information producers create or update contexts.
• Consumers consult or suscribe to contexts. • Decouple different platform components which allows flexibility.
• Blackboard architectural model based integration VS traditional ad-hoc interfaces
• Publish / suscribe / consult mechanisms• Request - Response (pull) working modes or subscription (push) suscripción-notificación (push) in producers and consumers
• Standard interfaces NGSI 10 & NGSI 9 REST (data and metadata management & remote context registration)
DATA BROKER
HDFS
• Hadoop Distributed File System• Platform long term storage• Large capacity (Big Data)• Distributed file system• Data redundancy (storage in several cluster nodes)
• Aggregated high bandwidth at cluster level
CKAN
• Data storage to be published as open data• Dataset lifecycle management• Data read and import through API• Several data catalog support (including W3C DCAT)
Analytic Database
• Structured information platform storage• SQL dababase manager• Database used to be queryed by the BI tool.• Pre-processed and consolidated data to generate reports
• Report generation performance optimization
ETL• Talend• String management• 450 connectors• Several data sources • Graphical tool to create jobs
DATA STORAGE
Big Data
• Hadoop-based Big Data component• Capacity analysis and big data analytics and processing
• Execution over HW clusters (resources management done by Hadoop YARN)
• Map/Reduce paradigm implementation• Supported by HDFS storage• Hue-based UI• Ambari cluster management• Hive, HCat, Pig and Oozie included
Analytic Tools
• Analytic Python-based tools: Nump y SciPy• Numeric, statistic and predictive analytics• Explode data stored on the HDFS
CEP
• CEP component• Produce, detect, consume and generate responses over a real-time data stream.
• Identification, analysis and trigger actions over event patterns like: send email / SMS / tweet, update context, REST request
• Minimum latency on event generation• Rules engine associated to patterns based on Esper
• EPL event processing language
DATA ANALYSIS
Enterprise Service Bus (ESB)
• Lightweight and flexible • Easy to use• Open source technologies and protocols• Apache Camel integration framework included with integration components
• JBoss Developer Studio integrated with Eclipse
• Bus federation with city council private bus.
WHERE IS & WHY?
EXTERNAL SYSTEMS DATA INTEGRATION
OLD PARKING CONSOLIDATION SYSTEM
VALENCIA TOWN HALL SYSTEMS
VALENCIA TOWN HALL APPS
- No real time information
- Impossible to connect old parkings
- Impossible to provide data model for newsystems
HOW DID WE SOLVE VALENCIA's CHALLENGES?
& TO THE RESCUE
VALENCIA TOWN HALL APPSSMART CITY PLATFORM
VALENCIA TOWN HALL SYSTEMS
ARCHITECTURE: DEEP DIVE
RED HAT JBOSS A-MQ: Message Queue
RED HAT JBOSS FUSE: Camel route & REST services
PLATFORM CONTEXT BROKER
RED HAT JBOSS FUSE: Camel route
DATA READY TO BE CONSUMED & DISTRIBUTED
COUNCIL SERVICES LAYER
GIS SYSTEM(Generic parking data)
-Parking Validation
-Update Parking places
-Return Parking
WHAT'S NEXT?(HOPEFULLY...)
25
DATACENTER
GATEWAYS
DEVICES
Driving datacenter function to the edge
• Business processing• Reporting• Long-term data analytics• Data infrastructure• Enterprise integration• Software-defined storage
• Communications/messaging• Data pre-processing• Real-time data analytics• Real-time actions/rules• Software-defined storage
• Communications/messaging• Data acquisition
ENTERPRISE IoT ARCHITECTURE
LEARN MORE
IoT: Connect your analog business to a digital worldRoom 2020 @ 4:45pm
www.redhat.com/iot developers.redhat.com/iot
iot.telefonica.com/smart-cities
BACK UP SLIDES
ARCHITECTURE: DATA FLOW
IOT Openstack Based (CORE)