Snap4City, Antwerp, 21st August 2019 1
LIVING LAB
Snap4City platform: from cloud to data analytics as a Living Lab for city stakeholders
Nicola Mitolo, Snap4City – DISIT Lab
Snap4City, Antwerp, 21st August 2019 2
Title
Nicola Mitolo, [email protected]://www.Km4City.org ‐ https://www.disit.org
https://www.snap4City.orgPowered by
Snap4City platform:From cloud to data analytics as a Living Lab for city stakeholders
Living Lab Flexibility• Multiple modalities to perform the same activities
• Tuned for Beginners and Skilled people• Visual interface and programming tools• Resources and artefacts sharing for learn acceleration and co‐working
• Open Living and co‐working Portal: https://www.Snap4City.org
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3
Snap4City Satisfies all Requirements of ENOLLSelect4Cities and EIP‐SCC
Snap4City, Antwerp, 21st August 2019 4
architettura
BIG DATA ANALYTICS: AI, MACHINE LEARNING
Standards and Interoperability
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 5
Compliant with: AMQP, COAP, MQTT, OneM2M, HTTP, HTTPS, Rest Call, SMTP, TCP, UDP, NGSI, LoraWan, TheThingsNetwork, SigFOX, DATEX II, SOAP, WSDL, Twitter, FaceBook, Telegram, SMS, OLAP, MySQL, Mongo, HBASE, SOLR, SPARQL, EMAIL, FTP, FTPS, WebSocket, WebSocket Secure, ModBUS, OPC, RS485, WFS, WMS, ODBC, JDBC, Elastic Search, Phoenix, XML, JSON, GeoJSON, Enfuser FMI, Android, Raspberry Pi, Local File System, ESP32, Libelium, IBIMET, OBD2, etc.
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 6
Knowledge baseSemantic reasoners
Data SourcesPULL Data
Data Sources, Brokers, External ServicesData
Driven, Real Time
Data Ingestion, aggregation, regularization,
reconcile
ETL, NIFI, DISCES
Big Data ClusterHDFS, Hbase, Phoenix Search and
Query, Smart City APIFacet, semantic
search Indexing and aggregatingElastic search
Data AnalyticsR, Tensor Flow, Python, MapReduce, …
Visual AnalyticsSpecial dash/tools
RenderingActing, Widgets, MicroApps
User interface,Interactive Dashboard,Drill down,
maps,heatmaps
Inform, announce, Act!, warning, alarms, What‐IF, ..
IOT ApplicationsNode‐RED + Snap4City MicroSrvs
The Lambda Architecture for Smart Cities
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 7
Sentient SolutionsDashboards with IOT Applications for enforcing data driven smart and intelligence
Dashboards and AppsIOT and City data World IOT Applications
My IOT Devices Big Data Analytics, Artificial Intelligence
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019
City Dashboard + IOT AppControl Room OperatorWould like to:‐ Monitor traffic flow,
Environment, Car parking, Cycling, First aid, temp., …
‐ Act and monitor Dynamic Plates
‐ Act and monitor red lights
Driver, PolicemanWould like to:‐ Monitor traffic, Parking,
env., speed limit, …‐ Act and monitor red lights
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 9
Integrated Urban Platform• Produce value from data supporting Living lab
– Stimulate virtuous behavior, influence City Users!– Put in action CITY Strategies
• Data Exploitation performing– predictions, reasoning, business intelligence, ..– users behavior analysis, decision support system, ..– Control Room, Real Time Monitoring tools, ….
• Aggregate & integrate data – Multiple protocols from urban operators, ....– open data, IOT, sensors, internet of everything, cloud, mobile devices, Wi‐Fi, social media, ...
Snap4City, February 2019 10
DASHBOARDS: FROM CITY DASHBOARD
TO APPLICATIONS
Dashboards List
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 11
12SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019
https://www.snap4city.org/dashboardSmartCity/view/index.php?iddasboard=MjE5MA==#
Snap4City, Antwerp, 21st August 2019 13SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019
https://www.snap4city.org/dashboardSmartCity/view/index.php?iddasboard=MTQwNg==
Snap4City, Antwerp, 21st August 2019 14SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019
https://www.snap4city.org/dashboardSmartCity/view/index.php?iddasboard=MTQwNw==
Snap4City, February 2019 15
FORGING & MANAGINGFLEXIBLE MOBILE APPS, Web Apps and MicroApplications
Snap4City (C), June 2019 16
Mobile App Features• Discovery POI/services• Search: POI, streets, suggestions• Mobility and transport: Pub/priv, routing, car position,
time table, park, sharing, tickets, etc.• Environment and Weather: values, sensors, heatmaps,
notifications• Assistant, Forum, Developer Assistant• Goal Experiences (Engagement)• Personal data, activities, POI, tracking, IOT App,
Dashboards, etc.• Events: entertainment, critical• Sharing position and trajectories with friends• Monitoring city and personal Dashboards• Personalized for Operators and Developers full control of
their applications on cloud
Snap4City (C), June 2019 17
DATA ANALYTICS,Big Data Science
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 18
Snap4City (C), June 2019 19
City official
ICT official
Developer
Citizen, tourist, visitor
Business owner
City officials
City officials Domain experts
City officials City developers
Third party developers
Citizen
Citizens with respiratory problems
Tourists
Business owners
Mobile
MIcroApplication
Tool, via Portal (ICT Developers)
Dashboards
Main Data Sources
Discovery near to me X X X X X X X X X X X X X X X POI, OSMDiscovery along a path X X X X X X X X X X X X POI, OSMDiscovery in an area, shape X X X X x X X X X X X X x X X POI, OSMbrowsing Public Transport X X X X x X X X X X X X x X X OSM, GTFSFull Text search X X X X X X X X X X X X X X POI, OSMRouting: pedestrian X x X X X X X x X X OSMRouting: pedestrian quite X x X X X X X x X X OSMRouting: private vehicles X X X X X X X X X X X OSMRouting: Multimodal Public Transport X X X X X X X X OSM, GTFSheatmaps: weather (Temp, Humidity) X X X X X X X X X X X X X Sensors data, OSMheatmaps: environmental variables, PM10, PM2.5, NO2, EAQI X X X X X X X X X X X X X Sensors data, OSMheatmaps: environmental variables, Noise X X X X X X X X X Sensors data, OSMheatmaps: safe on bike (Antwerp) X X X X X X Spec. Portalheatmaps: Enfuser prediction, PM10, PM2.5, AQI X X X X X X X X X Enfuser dataheatmaps piking values any place X X X X X X X X X Computed Heatmpsheatmaps: GRAL prediction, PM10 X X X X X X X X X OSM, Traffic, WeatherComparsison: Enfuser, Gral, Real Time X X X Enfuser, Sensors, GRALSensors Data Time Trends, & drill down X X X X X X X X X X Sensors data, OSMWeather Forecast X X X X X X X X X X X X X Forecast ServiceOrigin Destination Matrices X X X X X X X X X X Snap4City Mobile AppTypical trajectories X X X X X X X X X X X X Snap4City Mobile AppHot Area in the city X X X X X X X X X X X X X X X X Snap4City Mobile AppHot Places in Smart Zone X X X X X X X X Snap4City PAXcountersServices Suggestions on mobiles X X X X X X Snap4City Mobile AppAlerts on critical cases: several variables X X X X X X X X X Sensors data, OSMThe most used services X X X X X X X X X Snap4City Mobile AppTwitter Trends Daily X X X X X X X X X X X Twitter VigilanceThe auditing of user and living lab X X X X Snap4City PortalSelf assessment X X X X X X X X X X X X X X Snap4City Portal
Antwerp Helsinki Where
PredictingModels for Administrators & City Users
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019
• Aiming at improving – quality of service, distributing workload – early warning
• Data Analytics: Machine Learning, Natural Language Processing, Sentiment Analysis, …
• Parking Prediction: Short (next 15 min, 30 Min) and Mid Term (1 week) Predicting at EXPO2015
Early Warning Water Bomb
Early Warning Hot in Tuscany
Predicting City Users on Areas
20
12 parking areas in Florence
User Behaviour Analysis
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019
• Monitoring movements by traffic flow sensors– Spires and virtual spires (cameras)
• Monitoring movements from Mobile Cells– Unsuitable for precise tracking and OD production
• Monitoring movements from Wi‐Fi• Monitoring movements and much more from mobile Apps
21
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 22
https://www.snap4city.org/dashboardSmartCity/view/index.php?iddasboard=MTc2MQ==https://www.snap4city.org/dashboardSmartCity/view/index.php?iddasboard=MTc2MQ==
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 23
http://firenzetraffic.km4city.org/newSensors.html
real time
Snap4City (C), June 2019
Prediction and Identification of Anomalies
Cluster confidence
AP average and confidence
Actual AP trend for today
AP prediction for the next time slot in the day on the basis of past weeks
Guessing number of users of Wi‐Fi Access Points
24
Predictive precision of the 95%
Snap4City (C), June 2019 25
Data Analytics: Heatmaps• Over the Gaussian Heatmaps• Calibrated heatmaps on the basis of Interpolated data for:– From 200x200 to 4x4 mt– PM10, PM2.5, SO2, NO2, Noise, NO, O3, Enfuser, GRAL,….– Any programmed Color map– Animations over H24– Picking values in any place, values on their position.– On Web and Mobile App
Snap4City (C), June 2019 26
Environmental Data Predictions: GRAL• GRAL predictions: PM10, NOX, ….
– Comparison wrt real time values in actual value of Sensors
– Graz Lagrangian Model. • GRAL model takes into account:
– pollution sources (for example the vehicles, their distribution on the streets, the about of pollution they produce according to their distribution over time and space, etc.),
– structure of the city (streets and shape 3D of the buildings),
– weather forecast (wind intensity and direction), etc.
• GRAL can be applied on NOX, PM10, PM2.5, … or any other particles
SNAP4CITY LIVING LABFOR COLLABORATIVE WORK
Snap4City (C), June 2019 27
Snap4City (C), June 2019 28
Your Level
SLIDES
NewsFlyer
Exercises
Full Search
All Tools
Personalized Suggestions
SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 29
Main Projects/Pilots, 2019• Sii‐Mobility mobility and transport• REPLICATE Control Room: ICT, Energy, IOT• RESOLUTE Resilience, ICT, Big Data• GHOST strategies, smart city• TRAFAIR environment & transport• MOSAIC mobility and transport• WEEE Life waste, environment• Smart Garda Lake Smart city, environment• 5G Industry 4.0 vs SmartCity, water management• Green Impact Industry 4.0, chemical plant• PISA Agreement data aggregation, smart city• Lonato City data aggregator, smart reasoning• SmartBed health monitoring
Green Impact
Snap4City (C), June 2019 30
Be smart in a SNAP!
Nicola Mitolo, [email protected]://www.Km4City.org ‐ https://www.disit.org