NIMO Nordic Interaction and Mobility Research Platform Professor Timo Ojala University of Oulu Department of Computer Science and Engineering MediaTeam Oulu research group Finland Sep 19, 2012

NIMO (Nordic Interaction and Mobility Research Platform) • • • • http://www.nimoproject.org

Timespan: 6/2011 – 5/2014 (36 months) Consortium • Luleå University of Technology, Sweden (LTU) (coordinator) • University of Oulu, Finland (UO) • University of Lapland, Finland (UL) Total budget: 1.45 MEUR • Main public financier: Interreg IV A Nord program • UO budget: 285 kEUR • Co-funders: BusinessOulu, OBP Research Ltd.

UO objectives

• Open 3D virtual model of Oulu city centre (”Oulu3D”) • Pervasive city game for youth

NIMO: Advisory group • • • • • • • • • • • • • • • • • • • • Kari Autio, UO / CIE Tommi Hollström, Adminotech Jussi Kangasoja, OUAS Jarmo Laitinen, City of Oulu / Center of Youth Affairs Uki Lahtinen, City of Oulu / Technical Centre Tony Manninen, Ludocraft Ville Mickelsson, Cyberlightning Juhani Miettunen, Nokia Pekka Nisula, OUAS Timo Ojala, UO Ilpo Okkonen, Oulu3D Jyrki Okkonen, Nokia Johannes Peltola, VTT Harri Pesola, Codemate Jani Pirkola, Cyberlightning / realXtend Foundation Toni Piirainen, Codemate Janne Salmi, CubiCasa Mika Sorvisto, CENTRIA Christian Sundell, Business Oulu Eero Tervo, Evocons

NIMO: UO WP3 objective #3-1: Oulu3D •

Joint initiative to build open interactive 3D virtual model of downtown Oulu atop the realXtend platform

• Outdoor modeling of selected blocks • • Indoor modeling of selected key buildings Hosting of the model in public Internet • Phasing of the model • Phase #1: ”9” (available in 2012) • • Phase #2: ”50” (available in 2013 if additional funding is obtained) Phase #3: ”City” (available in ?) • Division of activities • Data collection (photographs, blueprints, laser scanning) • • realXtend modeling Hosting of the model • • IPR and O&M of the model Utilization of the model

realXtend - Open source platform for the 3D Internet • • • • http://www.realxtend.org

Client-server architecture Tundra SDK, Naali viewer Extensible scene architecture Example shared presentation Alatalo T (2011) An entity-component model for extensible virtual worlds. IEEE Internet Computing 15(5):30-37.

Oulu3D: Phase #1 area (”9” blocks)

Oulu3D: Phase #2 area (”50” blocks) (tentative)

Oulu3D: Modeling process

NIMO CENTRIA

DATA 3D MODELING TEXTURING MOVE MODEL TO REALXTEND

ADMINOTECH

HOSTING OF REX MODEL

Oulu3D: Photographing of building facades Pakkahuoneenkatu 14 facade south

Oulu3D: Photographing of blueprints Pakkahuoneenkatu 14 facade south

Oulu3D: Photographing of blueprints (2) Pakkahuoneenkatu 14 floorplan

Oulu3D: Laser scanning Laser scanning equipment 3D visualization of Puistola block from laser data

Video (30 seconds, disk)

Oulu3D: Laser scanning example (1) Oulu market: Scan #1

Oulu3D: Laser scanning example (2) Oulu market: Scan #2

Oulu3D: Laser scanning example (3) Oulu market: Scan #3

Oulu3D: Laser scanning example (4) Oulu market: Scans #1-#3 merged

Oulu3D: Laser scanning phase #1 (fall 2011) 50 scanning points

Oulu3D: realXtend modeling example Which part is realXtend model and which part is photo?  Differences between realXtend model (low polygon) and CAD models (high polygon) have to be understood

Oulu3D: Current ”9” block realXtend model

Oulu3D: realXtend indoor modeling of buildings Byström’s house selected as pilot for indoor modeling

Oulu3D: Hosting NIMO purchases hosting from Adminotech (uses Amazon cloud)

Oulu3D: IPR and O&M model Cases

CorpX Scene CompX Scene(s)

Server Instance(s) (hosting operator) streetartgangs.net

NIMO Scene(s)

Server Instance(s) (hosting operator) MCT3D.net

MCT Scene(s)

Server Instance(s) (hosting operator) Oulu3Dlive.net (Univ. of Oulu) www.ouka.fi/3D

City of Oulu Scene(s)

Server Instance (hosting operator) Model Elements Commercial services Nonprofit services Administration (administrative operator) REX Contributions NIMO

Root Scene

Root Model (Creative Commons) MCT City of Oulu Organisation A Company B Company C ...

realXtend Server (hosting operator)

Oulu3D: Example of utilization in research UO/CIE: ServiceFusion Real-world online services are ”fused” into the Oulu3D virtual model

Oulu3D: Example of utilization in research UO/CIE: Reality vs virtual reality in mobile AR UI • Comparison of camera-based augmented reality UI and 3D virtual model based UI • Wizard-of-Oz testing at downtown Oulu with simulated location-based mobile services

Oulu3D: Example of utilization in public service City of Oulu: Urban planning (1)

Oulu3D: Example of utilization in public service City of Oulu: Urban planning (2)

Oulu3D: Example of utilization in business Cyberlightning Ltd.: CyberSlide Oulu3D model as a virtual 3D presentation environment

NIMO: UO WP3 objective #3-2: Pervasive city game • Pervasive gaming ~ seamless integration and interaction of real world and game world • Design and implementation of incremental prototypes of pervasive games for youth utilizing the 3D virtual model • Evaluation via game play by significant number of real players in authentic urban setting • Close collaboration with the upcoming MESSI project of City of Oulu’s Centre of Youth Affairs

First pervasive city game ”Street Art Gangs” • Teams of players try to create virtual graffitis around downtown Oulu, at the same time stopping other teams from creating graffitis 29

Street Art Gangs: Conceptual architecture

• • Street Art Gangs: Mobile client screenshots Real (physical) game world at downtown Oulu Game is played with a mobile client Game objective is to create virtual graffitis around downtown

Street Art Gangs: PC client screenshots • • Virtual game world in Oulu3D model Game is played in the Oulu3D model on a PC Players guide their teammates at downtown via instant messaging

Street Art Gangs: Snapshots from 3D world

Future work • UO WP3 objective #3-1: Oulu3D • Operationalize O&M • Add first services • Release model to general public (Dec 2012 ?) • Obtain additional funding to build phase #2 (”50” blocks) • UP WP3 objective #3-2: Pervasive city game • Finalize implementation of Street Art Gangs ver. 1 • Conduct field trial with Street Art Gangs ver. 1

Oulu3D has brought the players together!

• • • •

Objectives Open Community-based Comprehensive Realistic

• • •

Utilization Business Public service R&D

•

Visible landmark for Oulu’s 3D Internet competence

•

realXtend platform