DELIVERABLE · 2019. 11. 26. · Project Acronym: FotoInMotion Grant Agreement number: 780612...

Project Acronym: FotoInMotion Grant Agreement number: 780612 (H2020-ICT-20-2017-1, RIA) Project Full Title: Repurposing and enriching images for immersive storytelling

through smart digital tools Project Coordinator: INTRASOFT International

DELIVERABLE

D1.2 - FotoInMotion use cases and requirements v1

Dissemination level PU - Public

Type of Document Report

Contractual date of delivery M6

Deliverable Leader NOOR

Status - version, date V1, 30.06.2018

WP / Task responsible WP1

Keywords Use case, Requirements, Photojournalism, Fashion, Festival

2

FotoInMotion H2020 Contract No. 780612

D1.2 - FotoInMotion use cases and requirements v1 Final 1.0, 30/06/2018

Deliverable Leader: NOOR

Contributors: NOOR, Worldcrunch, Marni, TBNFF

Reviewers: ATC , TBNFF

Approved by: INTRASOFT

Document History

Version Date Contributor(s) Description

0.1-0.3 26.06.2018 NOOR,

Worldcrunch, Marni, TBNFF

INTRASOFT internal early revisions

0.4 Version distributed for review and partner

input (on reviewers list and risks)

0.5 Consolidated version after review and inputs

0.6 Version for QM

1.0 Final version for submission to the EC

3



Table of Contents Definitions, Acronyms and Abbreviations ......................................................................... 4

1 Executive Summary & Introduction .................................................................................... 6

1.2 Relation to Other WPs and tasks ................................................................................ 8

1.3 Structure of the Deliverable ....................................................................................... 9

2. Methodology .................................................................................................................... 10

3. Broad User Scenarios ....................................................................................................... 14

3.1 FotoInMotion Workflow ........................................................................................... 14

3.2 PhotoJournalism Scenario ........................................................................................ 17

3.2.1 Scenario Phjm1: Pro Device Capture + Edit ........................................................... 18

3.2.2 Scenario Phjm2: Pro Device Capture + Image Library +Edit ................................. 20

3.2.3 Scenario Phjm3: Pro Device Capture +Edit+ Dissemination ................................. 22

3.3 Fashion Scenarios ...................................................................................................... 24

3.3.1 Scenario Fs1: Image Library + Edit ........................................................................ 25

3.3.2 Scenario Fs2: Pro Device Capture + Edit ................................................................ 27

3.4 Festival Scenarios ..................................................................................................... 29

3.4.1 Scenario Fest1: Pro Device Capture + Edit ............................................................ 29

3.4.2 Scenario Fest2: MobileDevice Capture + Edit ....................................................... 31

3.4.3 Scenario Fest3: Image Library + Edit ..................................................................... 33

3.4.4 Scenario Fest4: Disseminate ................................................................................. 35

4. Feature descriptions ........................................................................................................ 36

4.1 Comparison of FUNCTIONAL REQUIREMENTS according to User Scenarios .......... 36

4. 2 List of FUNCTIONAL REQUIREMENTS (expanded to use cases) .............................. 38

5. Conclusion ........................................................................................................................ 39

Annexes ................................................................................................................................ 39

Annex 1: List of Professional Photography Experts ......................................................... 39

Annex 2: Photojournalism Industry Questionnaire ....................................................... 41

Annex 3: Sample scenarios from photojournalism industry .............................................. 46

Scenario 1: Nina Berman ................................................................................................. 46

Scenario 2: ARKO DATTO ................................................................................................ 48

Annex 4. Samples of object recognition topology of the Festival use case ........................ 49

4



Definitions, Acronyms and Abbreviations

Acronym Title

CA Consortium Agreement

CO Coordinator; except when referring to a deliverable, in which case it refers to “Confidential”, i.e. only for members of the consortium (including EC Services)

CR Change Request

D Demonstrator

DL Deliverable Leader

DMS Document Management System

DoA Description of Action

Dx Deliverable (where x defines the deliverable identification number e.g. D1.1.1)

EC European Commission

ECAS European Commission Authentication Service

EU European Union

ExM Exploitation Manager

InM Innovation Manager

FM Financial Manager

GA General Assembly

GA Grant Agreement

KPI Key Performance Indicator

MSx project Milestone (where x defines a project milestone, e.g. MS3)

Mx Month (where x defines a project month, e.g. M10)

MoM Minutes of Meeting

O Other

P Prototype

PC Project Coordinator partner (INTRASOFT)

PM Person Month (a unit to count workload)

PO Project Officer

PP Restricted to other programme participants (including the Commission Services)

PU Public

QA Quality Assurance

QM QA Manager

R Report

RE Restricted to a group specified by the consortium (including Commission Services)

TL Task Leader

WP Work Package

WPL Work Package Leader

WPS Work Package Structure

5



Term Definition

Beneficiary EC term used to designate the legal entity which has signed the Grant Agreement. This term is often substituted by the common language term ‘partner’.

Consortium Group of beneficiaries that have signed the Consortium Agreement and the Grant Agreement (either directly as Coordinator or by accession through the Form A).

Consortium Agreement

Contractual document signed by all the beneficiaries (and not the EC), explaining how the Consortium is managed and works together.

Deliverable Leader

Responsible for ensuring that the content of the deliverable meets the required expectations, both from a contractual point of view and in terms of usage within the project. Is also responsible for ensuring that the deliverable follows the deliverable process and is delivered on time.

Description of Action

Annex 1 to the Grant Agreement. It contains information on the work packages, deliverables, milestones, resources and costs of the beneficiaries, as well as a text with a detailed description of the action. The DoA is made of Part A (structured data collected in web forms and workplan tables) and Part B (text document describing the action elements).

Dissemination EC term for communication of information to a wide audience.

Foreground The results, including information, whether they can be protected or not, which are generated under the project. Such results include rights related to copyright, design rights, patent rights etc.

Grant Agreement

Contractual document which defines the contractual scope of the FotoInMotion project. It is signed between the EC and the beneficiaries.

Third party Any legal entity which does not sign the EC Grant Agreement. A subcontractor is a type of third party, but not the only one. In special circumstances the GRA accepts third parties whose costs may be eligible. Third parties are specified in the DoA, GRA (Article 14) and CA.

6



1 Executive Summary & Introduction This deliverable presents the analysis of user requirements for the FotoInMotion Project. The results presented in this document are derived from the first version of the user scenarios, cases and requirements to be implemented in the project by looking at the three use case industries addressed by the project: photojournalism, fashion, and festivals. The results will form the basis for the FotoInMotion architecture (modules and inter-connections) design that is considered necessary to fulfil the identified requirements. In this stage, we considered to define high-level requirements from use cases, with the focus set on developing open user scenarios. The document covers the results, the approaches and feedback from the three focus industries and their respective stakeholders based on two broad sources of data - firstly, the results derived from the deliverable 1.1. that presented the broad trends and needs within the digital photography and video tools landscape in regards the covered industries; secondly the results derived from the internal discussions and workshops of project partners, and lastly, results from the stakeholders of the project partners acquired through different methodologies including stakeholder surveys, internal work sessions and focus groups. The presented scenarios and requirements will be updated and iterated during the FotoInMotion project to address in the timely manner, needs and wishes of the project partners and the industry trends at large. Thus, this document facilitates the communication between partners from research, development, and from use case analysis activities. It describes concisely the process the consortium undertook for the collection and analysis of user requirements and the envisaged application scenarios for field of: photojournalism, fashion and festivals. As the core of the FotoInMotion project the following critical questions become imminent in both content production and dissemination contexts: how to repurpose this massive amount of content; what kind of innovative tools are most suitable for this process; and finally, how these tools can offer new forms of monetization possibilities for creative industries' professionals. FotoInMotion, sets to solve these critical questions and provide an innovative solution to the repurposing of content by offering automated tools for innovative contextual data extraction, object recognition according to the scope defined by the project and use cases, creative transformation, editing and text animation as well as state of the art 3D conversion options that allow content creators to transform their photos into highly engaging spatial and three-dimensional video experiences. FotoInMotion aims to build a web and mobile video-editing tool designed to transform single photographs into high-quality, low-cost videos for creative industries’ professional

7



and social usage. FotoInMotion will allow both professional content producers, as well as creative citizens, to automatically embed contextual information into a single photo or a set of photos, and produce videos with rich semi-automated editing functions and dynamic effects that can be easily shared on social media, as well as on professional digital content delivery platforms, engaging them into new forms of immersive and high impact storytelling in professional and social media utilizing video. FotoInMotion videos could be used:

• by news organisations to inform about an event or create high impact video editorials,

• by creative industries professionals and companies for the promotion of products or services through social and digital media marketing campaigns,

• by festivals and cultural events to provide on-site coverage and engage audiences, or generally ,

• by individuals who want to give a new power to their photographs, and explain contexts and settings under which they were taken.

Hence, this document includes the definition of these broad requirements by the three use case leaders: NOOR (professional photojournalism agency), MARNI (fashion conglomerate) and the Black Nights Film Festival (A class film festival and one of the top 15 film events in the world). For photojournalism, user scenarios were defined with a focus of enabling tools for creating a new body of work by using FotoInMotion tool as well as disseminating it with its help. For fashion, the focus was set on repurposing and creatively editing photos for fashion professionals to find new and innovative ways to showcase their products, present fashion shows, and their stores and outlets and hence engage users more broadly. Lastly, for the festival case, the focus was set on enabling new forms of audience informing and engagement through the combination of information presenting from festival's events, as well as delivering immersive marketing content to attract new audiences to creative events and festivals. Lastly, the information presented here reflect the decisions made by FotoInMotion consortium in terms of technical implementation with preliminary categorization in terms of concrete features and technical requirements, which will be updated in the following versions of this document. After the preliminary user scenarios are configured, the emphasis will then focus on defining user stories and the functional requirements associated to them. A proper configuration of user scenarios and subsequent requirements analysis will let us understand the user needs and smoothly distribute the tasks to perform during the whole duration of the project.

8



1.2 Relation to Other WPs and tasks The system architecture, development and implementation of FotoInMotion platform is crucially tied to the information obtained from user scenarios, use cases and requirements of the stakeholders. It is important to note that the project utilizes an iterative approach with two-way communication flow within diverse partners in the consortium - the creative partners, innovation leaders and technical partners. In other words, use cases are developed based on discussions between user expectation and present and future technical feasibility with the focus on developing new tools and technologies within the scope of the project. In doing so the user requirements and use cases have been primarily based on the deliverable 1.1. that mapped key trends, features and expectations in the stakeholder industries. The findings were then discussed with technical partners to evaluate and map potential technologies, priorities and architectural features. Upon that, creative partners devised methodologies for user analysis and provided results for further technical implementation. Hence, we see a strong impact of this document to the further development and technical implementation process of the FotoInMotion project. Key areas that will be addressed include image acquisition and sensors (WP2), image annotation and limited object recognition according to the use cases, image processing and editing functions, immersive conversion (WP3), and last but not least the general systems architecture (WP4). Lastly, the user requirements defined within this document are crucial in for testing and implementation of the FotoInMotion pilots carried out in WP5.

9



1.3 Structure of the Deliverable 1. Executive Summary & Introduction 1.2 Relation to Other WPs & Tasks 1.3 Structure of the Deliverable 2. Methodology 3. Broad User Scenarios 3.1 FotoInMotion Workflow 3.2 Typology of Users Acquired from Stakeholders 3.3 PhotoJournalism Scenarios 3.4 Fashion Scenarios 3.5 Festival Scenarios 4. Feature descriptions 4.1 Comparison of feature descriptions according to User Scenarios 4. 2 List of feature descriptions (expanded to use cases) 5. Conclusion

Annexes

10



2. Methodology The primary goal of FotoInMotion is to provide an innovative solution to the repurposing of photography content, used in three major creative industries sectors: photojournalism, fashion and festivals. With this purpose in mind, all the partners, both technical and creative are involved in the definition of the open user scenarios and detailed user stories organized around the three project use cases. A wide understanding of the market for photography, video, mobile and desktop platforms and upcoming immersive platforms, and its stakeholders started with the study conducted during the configuration of the first version of the Innovation report on creative industries (D1.1). This document set out the opportunities and the expectations from FotoInMotion by all the stakeholders, inside and outside the consortium. For the purpose of defining the user scenarios and requirements, each pilot partner adopted a methodology and toolset that were deemed most appropriate for the particular industry. In order to bring together the results, discussions were held between the working partners on how to situate and harmonize the results. These actions were performed according to the following criteria for use cases:

• Understandable and unambiguous, any open issue about different ways of interpreting a requirement definition should be clarified.

• Consistent according to the motivation of each user scenario.

• Relevant for, at least, one stakeholder group.

• Traceable, they must include information on author, feasibility, etc.

• Feasible or, at least, the feasibility of the requirements will be analysed, and technical partners will evaluate if the requirements can be implemented within the scope of the project. The set of requirements has been configured through an iterative process, until these requirements meet the characteristics above defined and the technical side of FotoInMotion had the information enough to distribute and contextualize the work among the tasks within the scope of the project.

11



Figure 1. FiM User scenarios and use case features process The identification of concrete user requirements was based on focus groups, questionnaires and interviews and was supported by the definition of intuitive use case scenarios, which highlight features and interactions that users cannot imagine of at present due to the limitation of the existing online platforms. Based upon the above listed criteria also a use case / requirements matrix was compiled where use cases were prioritized by their relevance and feasibility. It should be noted here that since some of the technologies implemented in the FotoInMotion project are currently in the research phase, this document and containing results will be iterated both in terms of user surveying as well as updating the user requirements where deemed necessary by the consortium partners. Pilot / Use Case Industry Methodology Stakeholders Photojournalism In Depth User Survey

and interviews Professional photojournalism photographers

Fashion Internal Focus Group Fashion marketing professionals Festivals Internal Focus Group PR professionals, festival

marketing and social media managers

Figure 2: Applied methodologies across stakeholders

12



In particular, the following methodologies (listed in Figure 2) were carried out by the consortium partner to develop the preliminary user scenarios and use cases. In the area of photojournalism NOOR conducted an expert panel with world leading photo professionals with the focus to evaluate the critical questions including what are the new risks being faced by photojournalists; How are the transformations in the media economy affecting photojournalists’ employment; What does this mean for image quality; How do photojournalists think about the manipulation of images or the staging of events? Given the rise of citizen journalism, digital technology and social media, will there even be professional photojournalists in the future. The list of experts is presented in the Annex 1 of this deliverable. The list of questions asked to the professionals is listed in the Annex 2. In the area of fashion, consortium partner MARNI carried out an internal focus group with the key players in the fashion industry to map the requirements and scenarios, most appropriate for the creation and dissemination of high quality fashion content. As (film) festivals include various stakeholders who all relate to the mediated festival experience, in its analysis and research for the use cases, consortium partner BNFF defined four key focus categories of users with the following methodologies and tools:

• In depth working session / focus group with Festival Press Manager and Marketing /Social Media Manager (May - June 2018). During the two intensive in depth sessions relevant workflows and use cases were defined, also typologies of relevant photos and categories were extracted and sample materials / photos were collected.

• questionnaire to festival employed professional and volunteer photographers (September-October 2018) - an in-depth questionnaire will be sent to some 30 professional and volunteer photographers to gain insights to the initial workflow and technical platform

• professional experts panel (January 2019) - a professional evaluation panel will be held with Estonian and international festivals and digital media experts to evaluate the prototype version of FotoInMotion

• testing of the prototype version with post testing questionnaire (April 2018) - FotoInMotion platform will be utilized during HOFF festival in April 2018 in real life context to provide usability and feature set feedback

• audience beta and questionnaire (November 2019) - a beta version test with limited focus groups from festival audience to gain insights in the audience feedback sector.

• Festival full pilot and evaluation (November December 2019) - an in-depth usage of the prototype platform and evaluation by press, marketing and social media teams.

13



Pilot / Use Case Industry Users Type of Users

Use case feature

NOOR (Photojournalism) photojournalists, human rights activists, politicians and opinion leaders, photo editors, directors of museum and photojournalism festivals, non-governmental and governmental organisations,

Professional Create and disseminate professional content

global citizens, students, millennials and general users

Consumer Mainly consume & disseminate content

MARNI (Fashion) Fashion Photographers Fashion Journalists


Fashion customers and audiences (mainly women in age group 18 – 55)

Consumer Mainly consume & disseminate content

TBNFF (Festivals & Events) Press officers Professional Create and disseminate professional content

Marketing managers Professional Create and disseminate professional content

Social Media Managers Professional Create and disseminate professional content

Professional event photographers


Volunteer event photographers Professional Create and disseminate professional content

14



Festival audience Consumer Mainly consume & disseminate content

3. Broad User Scenarios

3.1 FotoInMotion Workflow Based on the discussions between the consortium partners during the second worksession in The Hague (2-4 May 2018) it was agreed that a general workflow structure from professional photography industry proposed by NOOR will be adapted as the basis of the FotoInMotion workflow. The workflow steps were agreed upon in order for the partners to establish a join terminology and approach throughout the creative and technical deliverables and outcomes of the FotoInMotion project. The agreed structure will consist of the steps described below:

• research The first step in a production of photography project would be a research of the existing content within the same topic or location done over the previous years and published. Tools like Google maps are useful in researching the location's specifications. Research through keywords and tags, would allow having a proper overview of photographs within the same subject matter. The user would research any contextual information (historical content, data overviews, academic papers, media coverage etc.) in order to have a social and political background and knowledge of the previous photography projects linked to the same location, topic or a person.

• pre production When the angle of the project is established, the user examines ambient parameters in order to arrange the conditions of the photoproduction.

• production On the ground, user is searching for a relevant scene in order to take the picture (or/and video footage), records the ambient sound or interviews with subjects. After the shoot the user uploads the material on a hard drive using a specific number organisation in order to facilitate future SEO and archiving his-her work

• post production Postproduction process happens after the shoot is completed. In this phase, the user will adjust colorimetry on his photographs, re-touching, and different potential visual filters. The

15



user will also caption and keyword his-her photographs Then the user will make an editing of the material by choosing the best / more relevant photographs and sequencing them in order to create stronger visual story / feature

• dissemination When the work is ready, the user will start the second step of his /her photographic process as the work is now completed. The completed work is shared with a client or an audience through a download link or website, social media

• audience analytics Online tools are giving a possibility to analyze audience behavior: number of ‘likes’, unique visitors or downloads in case of professional archiving systems.

As the second step, the project Innovation management partner TBNFF devised an expanded workflow where general steps were put in align with technical components of the project, to provide and exemplify the processes and procedures primarily to technical partners. Hence the technical elements - image annotation, editing, creative filters, immersive conversion and dissemination will all drawn from this extended schematic to develop interconnections between the different technical elements in the process.

16



17



3.2 PhotoJournalism Scenario The work practices of the professional photojournalist are currently undergoing rapid changes in the digital era. New technologies, platforms and methods of visual storytelling are exerting a range of pressures and influences that require photojournalists to adapt and respond in different ways. For photojournalism, user scenarios were defined with a test case in mind: creating a new body of work using FotoInMotion tool as well as disseminating it with its help. A group of internationally acclaimed photojournalists was asked to submit their technical requirements in order to facilitate production of the photojournalistic story. The requirements from this case, are strongly focused on authorship and pre- and post-production. The photojournalism case will test three user scenarios: 1) A scenario that would focus on a photographic investigation that would be possible by using a web and mobile video-editing tool designed to transform single photographs into high-quality, low-cost, immersive videos. 2) A scenario that focuses on showing the geographical changes through photography by combining archival and existing material. 3) A potential scenario that allows two users to work simultaneously on the same project and disseminate it among the audience. The detailed scenarios are available in Annex 3 of this deliverable. Scenario Pro Device Capture +

Edit Pro Device Capture + Image Library + Edit

Pro Device Capture + Edit + dissemination

Professional Photographer

x x x

Client x x General Audience x x x

18



3.2.1 Scenario Phjm1: Pro Device Capture + Edit The user wants to produce a high-quality project with professional photography device (a selected range DSLR camera defined by project use cases and pilots), record interviews and ambient sound, collect additional data (automatic geolocalisation, temperature, information about the air pollution) as well as aggregating any existing content. The user wants to edit the captured images and additional material into FotoInMotion story. The user will create the FotoInMotion story using the platform and export the final video story for other users to disseminate. Actor/user: professional photographer Preconditions: the photographer has a professional DLSR camera and/or sound recorder if available. Internet connection with access to FiM platform. Description:

1. The user wants or has been assign to produce high quality, transmedia project 2. The user will perform research of existing content (archive-present) by keywords

SEO from other agencies/ photographers/publications. (research) 3. The user will assess and save historical content (map-archive video-media

input. (research). 4. The user will capture images with DSLR camera. (production) 5. The user will capture sound with DSLR camera or sound recording device (optional)

(production) 6. The DSLR device will record timestamp and geolocation as well as will access

external information regarding the air density and air – pollution, temperature. (production)

7. The user will select a range of images as the main basis of the FotoInMotion story (post production).

8. The images will be uploaded to the system either through mobile or desktop platform (to be defined if transfer process needs to be documented

9. If image and sound are captured together on the same device they will be uploaded simultaneously to the system

10. The recorded sound will be uploaded to the system through mobile or desktop platform

11. The system will perform image analysis according to the following criteria: type of location (by giving an exact geolocation), face and person detection, timestamp, object detection and will pair it with the existing content gathered during the research

12. The system will generate a digital event from the image analysis and annotation and store annotations

19



13. The system will automatically annotate appropriate objects in the image and highlight these with boxes. The user can manually add additional tags for image recognition and annotation

14. The user will select key image as the basis of the FotoInMotion story (post production). For that the system will display a set of images uploaded to the system

15. The system will display post production tools (timeline, audio, filters and effects, text effects, immersive conversion)

16. The user will add the image to the editing timeline 17. The user will perform colour correction of the image using a colour correction

effect. The intensity of the effects can be controlled by system parameters. The effects can be layered on top of each other (Add) or removed (Delete)

18. The user will add 2D or 3D effects from the defined effects in the system. The intensity of the effects can be controlled by system parameters. The effects can be layered on top of each other (Add) or removed (Delete)

19. The user will add text element to the timeline on top of the photo. The font size, placement, opacity, colour, fade in and fade out can be edited by keyframes and parameters. Text element can be controlled by system parameters. The text can be layered on top of each other (Add) or removed (Delete)

20. The user will perform sound editing if sound is captured. The system will present t audio tracks. Ambient sound, captured sound, music.

21. The user can select pre-existing music and / or ambient sound uploaded to the system. The system will display a set of music tracks uploaded to the system. Audio file for each track will be added separately.

22. The user will perform the volume adjustments of the three tracks. 23. The user can add audio effects to the three tracks including fade in, fade out,

compression, equalization. The parameters of the effects can be edited by keyframes and parameters.

24. The user will perform immersive conversion (optional). The system will convert the image to 3-dimensional footage. After the conversion is done the user will be informed by a notification, during the process a process bar is being displayed.

25. The 3-dimensional footage can be interactive: the viewer can zoom in on certain photos or video and access the metadata with all the external information as well as external links. Possibility to incorporate videos into a bigger image – a map etc

26. The user will export the video for sharing with three options: save locally, save to a cloud service, share to social media. Before export a range of video resolutions is displayed.

27. The system will render the video and perform an export operation to local storage, cloud, or social media sharing. (dissemination)

28. The user will utilize the video for the desired purpose: social media delivery, communications, audience engagement. (dissemination)

Exceptions: Story can be created without sound capture, story can be exported without immersive conversion

20



Postconditions: Final FotoInMotion story or video file can be accessed by other users for dissemination

3.2.2 Scenario Phjm2: Pro Device Capture + Image Library +Edit The user wants to continue an ongoing project. The user had produced already a body of work (stills and video) as well as collected some google maps images that show the influence of the rising sea levels. The tool allows to access the image library and use it in the further part of the project as the user will come back to some locations to document the ongoing change in the environment. Description:

1. The user wants to produce high quality, photography project 2. The user will perform research of existing content (archive-present) by keywords

SEO from others agencies/ photographers/publications. (research) 3. The user will access and save historical content (map-archive video-media input).

(research) 4. The user will capture images with DSLR camera (production) 5. The user will capture sound with DSLR camera or sound recording device (optional)






10. The recorded sound will be uploaded to the system through mobile or desktop platform (to be defined if transfer process needs to be documented

11. The system will perform image analysis according to the following criteria: type of location, face and person recognition, timestamp, object recognition and will pair it with the existing content gathered during the research

12. The system will generate a contextual digital event from the image analysis and annotation and store annotations



21




16. The user will add the image to the editing timeline 17. The user will perform colour correction of the image using a colour correction effect.

The intensity of the effects can be controlled by system parameters. The effects can be layered on top of each other (Add) or removed (Delete)








25. The 3-dimensional footage can be interactive: the viewer can zoom in on certain photos or video and access the metadata with all the external information as well as external links. Possibility to incorporate videos into a bigger image – a map etc


27. The system will render the video and perform an export operation to local storage, cloud, or social media sharing.

28. The user will utilize the video for desired purpose: social media delivery, communications, audience engagement.

Exceptions: Story can be created without sound capture, story can be exported without immersive conversion Postconditions: Final FotoInMotion story or video file can be accessed by other users for dissemination on Instagram

22



3.2.3 Scenario Phjm3: Pro Device Capture +Edit+ Dissemination In the photojournalistic world quite often photojournalists are working together on a project to document the same issue from different perspective. The photographers would travel to create a connection between their subject, their images, and their feeling about the topic or a country and its social landscape. The platform could help to:

• Manage the project

• Disseminate it

• Create a personal blog through videos

• Engage with the audience Description:

1. The user creates a channel of communication with authors, screen sharing. (pre-production)

2. The user is accessing the material of other photographer connected to our account (pre-production)

3. The user will capture images with DSLR camera (production) 4. The user will capture sound with DSLR camera or sound recording device (optional)






9. The recorded sound will be uploaded to the system through mobile or desktop platform (to be defined if transfer process needs to be documented

10. The system will perform image analysis according to the following criteria: geolocation, face and person recognition, timestamp, object recognition and will pair it with the existing content gathered during the research



23






The intensity of the effects can be controlled by system parameters. The effects can be layered on top of each other (Add) or removed (Delete)







23. The user will perform immersive conversion (optional). The system will convert the image to 3 dimensional footage. After the conversion is done the user will be informed by a notification, during the process a process bar is being displayed.




27. The system will display the list of publicly shared FotoInMotion stories. 28. External users can engage with the video, linking it to their own FotoInMotion

stories Exceptions: none Postconditions: Analytics of the sharing of the story will be provided.

24



3.3 Fashion Scenarios Photos have always been key to the fashion industry. More than just selling a product, they convey the brand’s attitude and style. Each season, fashion designers devote high budgets to create their look-books that showcase the brand’s collection. The advent of social media is changing the traditional form of the catwalk. There are shows spreading out all over the year and aimed directly at the consumer (so-called “see-now-buy-now”). Fashion brands are also starting to engage consumers, by sharing details of their stores and outlets designs. In a design of a store, major brands try to tell their story, and create an immersive customer experience. Videos presenting a store’s design aim to incite consumers to visit and make purchases. The Italian luxury fashion brand MARNI heading the fashion pilot in FotoInMotion is looking for new ways to exploit their vast collection of photos by creating immersive and attractive videos, which will form the basis for their online marketing campaigns and e-commerce sites. Specifically, the Fashion case will test two user scenarios 1) A scenario that will focus on the use of the tool to edit and produce short videos out of pictures by the MARNI’s Marketing Department in the context of social media promotional campaigns. 2) A scenario based on the full photos production/selection including a photographer that is working with MARNI that will use FotoInMotion editing tool to edit the pictures taken in the context of a social media promotional campaign. The scenarios will be implemented according to following phases:

• Closed Pilot Phase: This phase will test the two proposed scenarios in parallel, in order to cover all the different features of FotoInMotion available for Fashion photographers. This phase will include MARNI’s Marketing Department workforce (both scenarios), as well as 1-2 Fashion photographers (scenario 2). Each phase will include a testing phase and an evaluation phase. The objective of this phase is to test the 1st prototype of the tool.

• Semi-Closed Pilot Phase: The objective of this phase is to test the full production of a social media promotional campaign using FotoInMotion tools to be tested on a group of MARNI’s employees.

25



• Large Scale Open Pilot Phase: The objective of this phase is to test the full production of a social media promotional campaign using FotoInMotion tools to be tested on a group of MARNI’s employees and selected customers + short feedback questionnaire for the selected testing customers

Scenario Pro Device Capture + Edit Image Library + Edit Marketing Department Professionals

x

Professional Fashion Photographers

x

3.3.1 Scenario Fs1: Image Library + Edit Summary: The user wants to create a FotoInMotion story on the preexising library of fashion images (either on hard drive, or cloud storage). The user will create the FotoInMotion story using the platform and export the final video story for other users in the marketing department to use. Photos will be used from MARNI’s photos databases (each photo is identified by a unique inventory number). This number will be used to match the picture with the relevant product, accessory or store to be promoted) will be used for making short videos using FotoInMotion tools. The goal is to transform and storytell photos of products, accessories and stores in short videos including the right messages that will be integrated into dedicated social media promotional campaigns created by the Marketing Team. These campaigns aim to boost MARNI’s online store sales and promote specific products, accessories and stores with the following KPIs: number of likes on social media: 50 (phase 1) 100 (phase 2) 200 (phase 3); N° of shares: 5 (phase 1) 10 (phase 2) 20 (phase 3). Actor/user: marketing department professionals Preconditions: the user has access to Marni media library and the FotoInMotion platform Description:

1. The user will select a range of images as the main basis of the FotoInMotion story. 2. The images will be uploaded to the system either through mobile or desktop

platform (to be defined if transfer process needs to be documented

26



3. The system will perform image analysis according to the criteria defined prior to the pilots.









12. The user will perform sound editing if sound is captured. The system will present audio tracks. Ambient sound, captured sound, music.






18. The system will render the video and perform an export to Instagram sharing Exceptions: Story can be created without sound capture, story can be exported without immersive conversion Postconditions: Final FotoInMotion story or video file can be accessed by other users for dissemination on Instagram

27



3.3.2 Scenario Fs2: Pro Device Capture + Edit Summary: The user wants to capture and create a FotoInMotion story during professional fashion shoot. The user will create the FotoInMotion story using the platform and export the final video story for other users in the marketing department to use. Photos from MARNI’s photos databases (each photo is identified by a unique inventory number. This number will be used to match the picture with the relevant product, accessory or store to be promoted) will be used for making short videos using FotoInMotion tools. The goal is to transform and storytell photos of products, accessories and stores in short videos including the right messages that will be integrated into dedicated social media promotional campaigns created by the Marketing Team. Actor/user: professional fashion photographer Preconditions: the photographer has a professional DLSR camera and / or sound recorder if available. Internet connection with access to FiM platform Description:

1. The user wants or has been instructed to record / document a festival event (premiere, press conference, gala, concert etc).

2. The user will perform research which kinds of images and additional information needs to be recorded from the event (typology of photos will be presented in the next version of the document) (research/pre production)

3. The user will capture images with DSLR camera (production) 4. The user will capture sound with DSLR camera or sound recording device

(optional) (production) with a pre-specified duration 5. The DSLR device will record timestamp and geolocation of the event 6. The user will select a range of images as the main basis of the FotoInMotion story 7. The images will be uploaded to the system either through mobile or desktop

platform (to be defined if transfer process needs to be documented. 8. If image and sound are captured together on the same device they will be uploaded

simultaneously to the system 9. The recorded sound will be uploaded to the system through mobile or desktop

platform (to be defined if transfer process needs to be documented. 10. The system will perform image analysis according to the criteria defined prior to the

pilots. 11. The system will generate a contextual digital event from the image analysis and

annotation and store annotations 12. The system will automatically annotate appropriate objects in the image and

highlight these with boxes. The user can manually add additional tags for image recognition and annotation

28

















Exceptions: Story can be created without sound capture, story can be exported without immersive conversion Postconditions: Final FotoInMotion story or video file can be accessed by other users for dissemination on Instagram

29



3.4 Festival Scenarios In the case of festivals a range of user scenarios were defined during the internal focus group session. The scenarios were devised keeping in mind the following users and stakeholders related to the festival who benefit from the FotoInMotion platform. They include: festival press managers, marketing managers, social media managers, professional event photographers, volunteer photographers and the general festival audience. A matrix of these scenarios is presented in the table below. In the following sections the scenarios and described also in more detail. Scenario Pro Device

Capture + Edit Mobile Capture + Edit

Image Library + Edit

Disseminate

Press Manager

x x x

Marketing Manager

x x

Social Media Manager

x x

Professional Event Photographer

x x

Volunteer Photographer

x x

General Audience

x x

3.4.1 Scenario Fest1: Pro Device Capture + Edit Summary: The user wants to capture a high-quality image from a festival event (premiere, press conference, gala, concert etc) with professional photography device (DSLR camera) and edit the captured images into FotoInMotion story. The user will create the FotoInMotion story using the platform and export the final video story for other users (press manager, marketing manager, social media manager to disseminate.

30



Actor/user: professional event / festival photographer Preconditions: the photographer has a professional photography device (a selected range DSLR camera defined by project use cases and pilots) and / or sound recorder if available. Internet connection with access to FiM platform Description:


2. The user will perform research which kinds of images and additional information needed to be recorded from the event (typology of photos will be presented in the next version of the document) (research/pre production)

3. The user will capture images with DSLR camera (production) 4. The user will capture sound with DSLR camera or sound recording device

(optional) (production) 5. The DSLR device will record timestamp and geolocation of the event 6. The user will select a range of images as the main basis of the FotoInMotion story 7. The images will be uploaded to the system either through mobile or desktop

platform (to be defined if transfer process needs to be documented 8. If image and sound are captured together on the same device they will be uploaded

simultaneously to the system 9. The recorded sound will be uploaded to the system through mobile or desktop

platform (to be defined if transfer process needs to be documented 10. The system will perform image analysis according to the following criteria: type of

event, face and person recognition, timestamp, object recognition (marketing material, sponsor material)





15. The user will add the image to the editing timeline 16. The user will perform color correction of the image using a color correction



18. The user will add text element to the timeline on top of the photo. The font size, placement, opacity, colour, fade in and fade out can be edited by keyframes and

31



parameters. Text element can be controlled by system parameters. The text can be layered on top of each other (Add) or removed (Delete)









Exceptions: Story can be created without sound capture, story can be exported without immersive conversion Postconditions: Final FotoInMotion story or video file can be accessed by other users for dissemination

3.4.2 Scenario Fest2: MobileDevice Capture + Edit Summary: The user wants to capture an image from a festival event (premiere, press conference, gala, concert etc) with Android mobile device and edit the captured images into FotoInMotion story. The user will create the FotoInMotion story using the platform and export the final video story to be shared on social media. Actor/user: professional event / festival photographer, volunteer photographer, PR manager, marketing manager, social media manager

32



Preconditions: user has a mobile device with image and sound recording. Internet connection with access to FiM platform. The mobile device needs to be Android platform Description:


2. The user will perform research which kinds of images and additional information needs to be recorded from the event (typology of photos will be presented in the next version of the document) (research/pre production)

3. The user will capture images with mobile device on Android (production) 4. The user will capture simultaneously sound with mobile device or sound recording

device (optional) (production) with a pre-specified duration 5. The mobile device will record timestamp and geolocation of the event 6. The user will select a range of images from mobile device image library as the main

basis of the FotoInMotion story 7. The images will be uploaded to the system either through mobile platform (to be

defined if transfer process needs to be documented 8. If image and sound are captured together on the same device they will be uploaded

simultaneously to the system 9. The system will perform image analysis according to the following criteria: type of







On mobile platform, the colour correction effects are joined by simple predefined pre-sets with limited editing functionality.

16. The user will add 2D or 3D effects from the defined effects in the system. On mobile platform, the effects are joined by simple predefined pre-sets with limited editing functionality. The effects can be layered on top of each other (Add) or removed (Delete)

17. The user will add text element to the timeline on top of the photo. The font size, placement, opacity, colour, fade in and fade out can be edited by keyframes and parameters. Text element can be controlled by reduced set of predefined parameters. The text can be layered on top of each other (Add) or removed (Delete)

33



18. The user will perform sound editing if sound is captured. The system will present three audio tracks. Ambient sound, captured sound, music.



compression, equalization. On mobile platform, the audio effects are joined by simple predefined pre-sets with limited editing functionality.




Exceptions: Story can be created without sound capture, story can be only exported without immersive version, effect parameters are simplified / reduced and presented mostly as predefined / pre-sets Postconditions: The FotoInMotion story will be mostly shared to social media

3.4.3 Scenario Fest3: Image Library + Edit Summary: The user wants to create a FotoInMotion story on the pre-existing library of images (either on hard drive or cloud storage). The user will create the FotoInMotion story using the platform and export the final video story for other users (press manager, marketing manager, social media manager to disseminate. Actor/user: press manager, marketing manager, social media manager Preconditions: the user has access to media library and the FotoInMotion platform

34



Description: 1. The user will select a range of images as the main basis of the FotoInMotion story. 2. The images will be uploaded to the system either through mobile or desktop

platform (to be defined if transfer process needs to be documented 3. The system will perform image analysis according to the following criteria: type of

















35




Exceptions: Story can be created without sound capture, story can be exported without immersive conversion Postconditions: Final FotoInMotion story or video file can be accessed by other users for dissemination

3.4.4 Scenario Fest4: Disseminate Summary: The user wants to disseminate a pre-existing FotoInMotion story. The user will export the story and share it as video file or on social media Actor/user: press manager, marketing manager, social media manager, general audience Preconditions: the user has access to FotoInMotion platform Description:

1. The user logs on to the FotoInMotion platform 2. The system will display the list of publicly shared FotoInMotion stories. 3. Based on user credentials the user can export the story to video (local, cloud

storage) or share directly to social media. 4. If exporting video the system displays before export a range of video resolutions is

displayed. 5. If sharing to social media, the social media platforms are integrated with API and

user can provide captioning 6. The story is disseminated.

Exceptions: none Postconditions: Analytics of the sharing of the story will be provided

36



4. Feature descriptions

4.1 Comparison of FUNCTIONAL REQUIREMENTS according to User Scenarios During the second work session of the FotoInMotion consortium a matrix of functional requirements was devised by creative and technical partners. In developing the matrix aspects such as user scenarios and use cases were considered, availability and feasibility of certain technologies and processes, and the scope and the breadth of the FotoInMotion project in general. The matrix was later reviewed through online sessions for additional feedback and upon these functional requirements of the system are being devised. Feature No

Description Technical Partner

Priority NOOR MARNI BNFF

1 Research n Keywords ATC low X 1c Historical content ATC low X 1d Before-After ATC low X 2 Pre-production X 2a general FIM Database

Queries ATC medium X

3 Production; location shoot

3a upload a picture ATC mandatory X X X 3b take a picture ATC mandatory X X X 3d recording sound ATC-

INESC high X X

3e project edit ATC high X X 3f geolocalisation INESC high X X X 3g Altitude INESC medium X X 3h Air (ext sensor) INESC low X - 3i Temperature (ext

sensor) INESC low X -

3j similar-image ATC low X x 3l safe storage ATC low X X X 3m auto-deletion ATC low X X X 4 Post-production 4x metadata generation INESC mandatory X x 4b post-production tools QDEPQ -

ATC mandatory X x x

timeline

37



voiceover music videoeffects (2d

simulation + 3d effects)

use of inventory products to use object recognition

transitions transitions - END sound effects rendering export keyframing text effects 4c editing facilities QDEPQ -

ATC mandatory X x

4d © authorship QDEPQ low X x 4e 2d to 3d QDEPQ mandatory X x 4f Geolocalisation context ATC medium X x 4g Crypted transfer

delivery ATC medium X x

5 Dissemination X 5a Social Media ATC mandatory X x 5b 3d exploration QdepQ medium X x 5c user participation /

collaborative ATC low X x

5d Online Dissemination - clients

ATC medium X x

5e Video dissemination - clients

ATC medium X x

5g Online subscription ATC- QdepQ

medium X x

5h online shop ATC- QdepQ

medium X

38



4. 2 List of FUNCTIONAL REQUIREMENTS (expanded to use cases)

• 3a upload a picture

• 3a1 batch upload a picture

• 3b take a picture with Android

• 3b1 take a picture with DLSR

• 3c take/store a "duplicate" picture automatically

• 3d record sound with Android device

• 3d1 record sound with external recorder

• 3f record and extract geolocation

• 3f1 record image EXIF data

• 3f2 record timestamp

• 3g record altitude

• 3h record Air parameters

• 3j record temperature

• 3j search for similar images in public repositories

• 3l safe storage (encrypted container)

• 3m auto delete images

• 4x extract and generate metadata & annotations

• 4x1 extract and generate for photojournalism

• 4x2 extract and generate for fashion

• 4x3 extract and generate for festivals

• 4x4 user annotation

• 4b provide post production tools

• 4b1 edit timeline

• 4b2 voiceover

• 4b3 soundtrack / music

• 4b4 ambient sound

• 4b5 inventory product synchronization

• 4b6 transitions

• 4b7 sound effects (volume, compression, level, normalize, fade in, fade out)

• 4b8 render composition

• 4b9 export video

• 4b10 effect keyframing

• 4b11 text effects

• 4c editing facilities (image tonal correction)

• 4d authorship

• 4e 2d to 3d conversion

• 4f geolocalization context

• 4g encrypted deliver

• 5a social media sharing

• 5b user centric 3d camera

39



• 5d online dissemination clients

• 5e video dissemination clients

• 5f online subscription

5. Conclusion This document gives and overview of the work conducted by all project partners to devise a set of user requirements and functionalities required for the further development of the FotoInMotion platform. Technical architecture, machine learning and annotation algorithms, and the post production tools as well as the pilots will be dependent on the user requirements and functionalities presented here. The next, iterated versions of this document will provide updated descriptions of the use cases as well as provide revisions where necessary based on discussions with industry stakeholders, progress of the technical partners, as well as the results and feedback from implemented pilots.

Annexes

Annex 1: List of Professional Photography Experts Benjamin Girette – Photojournalist and Founder of #Dysturb - #Dysturb is a network of photojournalists driven by the desire to make visual information freely accessible to a wider audience by pasting large images in city streets. Delphine Bedel - Delphine Bedel is an artist, lecturer, editor and publisher, who specialised in emerging practices in photography, design and publishing. Her work is exhibited internationally. She is the founder of Meta/Books and the Amsterdam Art/Book Fair, as well as Member of the Advisory Board of the Mondriaan Fonds and the German Photography Academy (DFA). Meta/Books, her publishing studio and research platform, is an experimental framework to publish art, theory and design and promote a new generation of artists and designers. Recent publications include the acclaimed photobooks ‘A Plastic Tool’ by Maya Rochat and ’Out of the Blue’ by Virginie Rebetez, short-listed for the Aperture Photobook Award in 2017.

40



Known for her cutting-edge publications, Delphine Bedel works with leading cultural institutions, art and design academies and corporate clients. She has lectured, served as a jury member and portfolio reviewer for museum and festivals including Musée National d’Art Moderne Paris (FR), Stedelijk Museum Amsterdam (NL), Rosfoto Museum and PhotobookFest Moscow (RU), Whitechapel Gallery, London (UK), Rencontres d’Arles (FR), Unseen (NL) and Fotomuseum Winterthur (CH). She is core tutor at the Masters Design Academy Eindhoven and Media Design / Piet Zwart Institute (NL). She has taught at the Geneva University of Art and Design (CH), Kunsthochschule Kassel (DE), Rietveld Academy and the Sandberg Institute (NL) among others. She is currently PhD Researcher at UCA – University for the creative Arts (UK), and contributes to books and magazines. Francesco Zizola - Conflict and documentary photojournalist and multimedia producer, with a concentration on migration and security. His photographs and video projects are noted for an artistic aesthetic in difficult settings. Tanya Habjouqa - Social documentary photographer specializing in gender, social, and human rights issues in the Middle East. She approaches her subjects with sensitivity and an eye for the absurd. She is the author of Occupied Pleasures, heralded by TIME magazine and the Smithsonian as one of the best photo books of 2015 (winning a World Press Photo award in 2014). She was the recipient of the Magnum Foundation 2013 Emergency Fund, and mentors grantees from across the Arab region for their “Arab Photographer Documentary Fund” with the Prince Claus Foundation and the Arab Fund for Arts and Culture. Tanya is a founding member of Rawiya, the first all female photo collective of the Middle East. She lectures ‘Narrative/ National Identity in Photography’ at Al Quds Bard University Marie Sumalla – Chief photo editor of Le Monde (http://www.lemonde.fr/) Major stories she has followed include the last chapter of the conflict in Libya, until the fall of Gaddafi, and the conflict in Syria. From 2008 to 2011, Sumalla was in charge of the editorial department responsible for press assignment, resale in Europe and editorial projects, at Magnum Photos in Paris. Prior to that, she was the PR in charge of events related to photography at the 2e Bureau press office. Nina Berman - Documentary photographer and educator with a primary focus in the political and social ramifications of militarizaton. She is an associate professor at Columbia University Graduate School of Journalism where she runs the photography program. Kadir van Lohuizen – Founder of NOOR - Photojournalist

http://www.lemonde.fr/

41



He has covered conflicts in Africa and elsewhere, but is probably best known for his long-term projects on the seven rivers of the world, the rising of sea levels, the diamond industry and migration in the Americas. Kadir has received numerous prizes and awards in photojournalism Kadir’s latest project is called ‘Wasteland’, where investigates in six megacities (Jakarta, Tokyo, Lagos, Amsterdam, São Paulo and New York) how they manage or mismanage their waste. For this project he uses photography, video, drone footage and audio. For this project he received 1st World Press Photo Prize in the Environmental category Gili Crouwel – Founder of The Gallery Club is a platform for photography, organized around exhibitions, and events. Every edition of The Gallery Club explores the work of a wide range of Dutch and international photographers through a different theme. Bas Vroege – Founder of Paradox - Paradox is a not for profit organisation founded in 1993. Paradox has developed more than 50 distinctive activities, traveling to some 120 venues worldwide. Paradox was founded with the aim of stimulating the development in photography. To reach this, Paradox produces traveling exhibitions, organises symposia and publishes audiovisual, digital and printed publications. The recording of history as it is unfolding, and the interaction between social, economic and technical factors, with the changes in society which flow from these changes, are recurring aspects in both our thematic and monographic projects.

Annex 2: Photojournalism Industry Questionnaire The questionnaire was designed by the research team of NOOR with input on various drafts from board members of the NOOR Foundation and the Panel Experts Hello, Thank you so much for participating in this survey. We are working with few partners on a new project called : FotoInMotion We believe: "A picture is worth a thousand words" but sometime, we wish to have a bit more.

42



FotoInMotion is a project to build a web and mobile video-editing tool designed to transform single photographs into high-quality, low-cost videos for creative industries’ professional and social usage. FotoInMotion will allow both professional content producers, as well as creative citizens, to automatically embed contextual information into a single photo or a set of photos, and produce videos with rich semi-automated editing functions and dynamic effects that can be easily shared on social media, as well as on professional digital content delivery platforms. Contextual information will consist of context metadata and audio/text narratives: they will offer pertinent context to describe specific aspects of the image and serve as a vehicle to tell a story and convey an intended message. The photo-editing and video creation process with 3D effects will draw attention to high-quality photography, by inciting users to select their best photos and provide them with a range of specifically designed artistic effects. It will engage users in new forms of immersive and high impact storytelling in professional and social media utilizing video Basically, we want to create a 360 environment around the image. We believe that your experience, your vision, could really help us building the best project ever, thanks a lot

Questions You are:

• A professional Image Buyer

• A professional Image Maker

• A professional Video Buyer

• A professional Video Maker

• A professional Art Buyer

• A journalist

• A photographer

• A picture Editor

• An Amateur

• A fan of photography

• A fan of video

• A visual Storyteller

• Other:

43



How old are you?

• 20-25

• 25-35

• 35-45

• 45-55

• 55-65

• more Your Sex?

• Female

• Male

• other Are you taking photographs? Videos? Sound? Are you using Visual Story-Telling Tools? What will be the best Story-telling tool for you? If you have to note from 1 to 3 what is the most important between:

• Autorship

• Context

• Engagement? Are you on Social Media?

• Facebook Inc.

• Facebook Messenger

• WhatsApp

• WeChat

• Tencent QQ

• Viber

• Instagram

• Tencent Qzone

• Sina Weibo

• Twitter

• Skype

• Baidu Tieba

• LINE

44



• Google+

• Telegram

• Pinterest

• Snapchat

• King of Glory

• LinkedIn

• VK

• BBM

• League of Legends

List of functionality Choosing a picture

• upload a picture from phone’s library?

• take a picture directly with the app?

• taking a picture from an external camera?

• possibility of recording the ambient sound?

• pick up a project edit that was started before Which format do you want to be able to use and uploaded? Format of the picture that can be uploaded? (JPG, PNG, TIF...). Maximum size? Storage: once you’re done with the edit, can you store it (so that the user can get back to it later on)? How many editing projects do you want to store? Do you want to build a photo library ? Do you want to share it? Make it public? Target audience?

Editing the picture (the editing tools should be featured as a carousel at the bottom of the screen for the user to scroll through)

45



Once user has selected a photo, editing tools are revealed:

• Filters

• Exposure

• Sharpen

• Saturation

• Contrast

• Hue

• Straighten

• Crop / Resize

• Grain

• Blur Do you want to add some editing tools? If so: What else would you like to do with the FotoInMotion app:

• Sound

• Altitude

• Air density and information

• Temperature

• Automatic data collect

• Data about the author – bio? Autoportait? Heart pulse (each effect should have a scale to increase or decrease the intensity)

Authorship What tool do you need to create visual content? What is the most important point while you create visual content?

• Shooting

• Producing

• Editing

• Post-producing

• Storage?

• Dissemination

• Keywording

• Captioning

46



• Certification of the author? Liability? Credibility?

Context What do you think is important to know while looking at visual content?

• © - Authorship

• Title

• Captions

• Keyword

• Location

• What’s before

• What’s after

• Additional content

• Environment content of the shot? Such as altitude, gps, temperature etc.

• Automatically adding, existing similar content

Annex 3: Sample scenarios from photojournalism industry

Scenario 1: Nina Berman Context: In order to pursue a photographic investigation: Acknowledgment of Danger, photographer Nina Berman will look at toxic legacy and continued environmental impact of US military activities on the American landscape from native lands to national forests, from major rivers to local water wells. She will examine how life continues or is absent from these sites, how people mark them, memorialize them, and try to reclaim or erase them. She will investigate accountability or lack thereof by the DOD and assisting agencies, including the EPA, DOE, NCI, NIH, USFS, and USFWS. She will consider the changes in types of contamination and harm over time according to particular military campaigns and weapons systems advancements. She will report on past abuses and reveal new patterns of military impacts and approaches to remediation such as the DOD’s bombs to birds transformation of former military bases. This is an ambitious reporting project that would be possible by using a web and mobile video-editing tool designed to transform single photographs into high-quality, low-cost

47



videos. Nina Berman will use various forms of photography: Images will open into more investigative, data-driven analysis as in this recent collaboration between World Press Photo and the Centre for Innovation in The Hague. Preproduction The first step in the project development would be a research of existing material as historical images, short videos, mapping and data visualizations drawn from investigative reporting. Together with drone and aerial photography it will show landscape changes, border lines of demarcation. The photographer will use a tool that performs Google Image search based on keyword, geolocation, recognized people and objects. The photographer is saving the results of the research in the tool’s storage capability. It is easily accessible on the every step of the further production. Production The following step is the production of the work. In the field photojournalist captures HDR still images and videos as well as ambient audio. In the case of this project the interviews with subject(s) are a crucial part. The sound is recorded either from device microphone, external device connected to the mobile or synchronize external recorder to image (based on waveform analysis). At certain sites, photojournalist will use motion sensors and 360 audio recordings to document sound pollution. All materials will be further contextualized through primary texts and narrative reporting. After producing this material, photojournalist executes standard post-production on image: cropping, dimensions, color ratios, filters, et al Photojournalist accesses metadata/ambient audio/interview audio that is matched with selected image to begin to produce video (can be performed on phone on location, or subsequently via web on computer). The tool provides automatic transcript of captured voiceover and sound to be displayed as subtitles. Photojournalist adds own audio/text - photojournalist selects effects suggested by tool to add parallex, vignetting, zoom, pans, et al on particular objects/areas of image. The platform generates automatically keywords. At this point photojournalist access the archive material collected during the research and combines it with the material originally produced.

https://thebiggerpicture.online/

https://thebiggerpicture.online/

48



To give an environmental context, the tool collects data as: geolocalisation, altitude, air, temperature. There is a possibility to upload additional information – as toxic contamination in this case, that comes from external sources (research made in this particular location). All this data collected can create an immersive experience, that gives the 360 environment around the image. Which means it’s not only creating a final product (like a video) but an experiences that stimulate viewer’s senses—they draw them in, transport them to another place, and keep them in the moment. Immersion enhances everyday experiences, making them more realistic, engaging, and satisfying, on all devices. Therefore ideally the viewer can zoom in on certain photos or video and access the metadata with all the external information. Through the tool can see all the archive images from the same location and topic. Can see the changes in the location and impact on the communities (collecting newspapers articles, social media posts that discussed the topic etc.). Can hear the interviews and ambient audio collected by the photojournalist. Can access academic papers that are accessible in the open source database. These final locations will be fully realized stories, opening up into a final map of the US showing the full scale of the problem through data points marking the thousands of sites across the country. The tool will be pursuing a simple visual aesthetic, pairing primary source documents with images, beautiful data visualizations and interactive mapping The tool will give also an opportunity to export a video that introduce the project (teaser) and can be easily shared through different channels (email, website, social media etc).

Scenario 2: ARKO DATTO Context The Ganga - Brahmaputra - Meghna Delta, comprising Bangladesh and West Bengal (India) is the world's largest delta. It empties into the Bay of Bengal and is also home to the Sunderbans. Due to human induced climate change, three-fourths of the Delta risk destruction from anthropogenic stress factors. Rising sea levels and swelling of rivers have led to the submerging of many Sunderban islands while several more risk disappearance. The increase in salinity levels from inundations and storm surges threatens the health of the mangroves, soil and crop quality, the availability of freshwater fish species, depriving families of their main protein source while also adversely affecting livelihoods Preproduction

49



This is an ongoing project. The photojournalist had produced already a body of work (stills and video) as well as collected some google maps images that show the influence of the rising sea levels. The tool allows to access the existing material and use it in the further part of the project as the photojournalist will come back to some locations to document the ongoing change in the environment Production Production of the new material on the location – both stills and video as well as collecting ambient audio. The sound is recorded either from device microphone, external device connected to the mobile or synchronize external recorder to image (based on waveform analysis). Post Production After producing this material, photojournalist executes standard post-production on image: cropping, dimensions, color ratios, filters, et al Photojournalist accesses metadata/ambient audio/interview audio that is matched with selected image to begin to produce video (can be performed on phone on location, or subsequently via web on computer). The tool provides automatic transcript of captured voiceover and sound to be displayed as subtitles. Photojournalist adds own audio/text - photojournalist selects effects suggested by tool to add parallex, vignetting, zoom, pans, et al on particular objects/areas of image. The tool generates automatically keywords. At this point photojournalist access the archive material produced in the past. Photojournalist adds 3D effects to show the transformation of the landscape. Photojournalist exports the video and shares through different channels (email, website, social media etc).

Annex 4. Samples of object recognition topology of the Festival use case A B C D E F 1 TYPE OF

EVENT PHOTOGRAPHER

TYPES OF IMAGE

LOCATION PUBLISHING FORMAT

WISHLIST

2 1. GALAS

50



3 Opening Ceremony

2 professionals

Various - closeups of speakers, establishing shots and closeups of the show and audience

Concert Hall Social media, newsletters, homepage, press

Applies to all categories: should be suitable for print, web and social media

4 Closing Ceremony

3 professionals

Various - closeups of speakers, award winners, establishing and closeups of the show and audience


Resolution: 300px per cm, longest edge 2500 px (2000px for social media), size 10x15, 1-4mb

5 Red Carpet 1 professional + press photographers

Portraits of dressed up, smiling guests

Concert Hall (indoor photos)

Social media, newsletters, homepage, press

6 Rehearsals 1 professional

Cool behind the scenes photos of the stage, performers etc


7 2. SCREENINGS

8 Premieres professionals / volunteers

Various- guests arriving, portraits, crew shots, milieu + audience

Cinemas, photo wall

Social media, newsletters, homepage, press

51



9 Q&As professionals / volunteers

Wide shots, closeups of the guests and q&a moderator, audience and the hall (avoid empty seats if possible)

Cinemas, screening halls

Social media, newsletters, homepage

10

3. PORTRAITS Closeups, studio background

11

(Filmmakers, Juries, Indusrty Professionals, Guests)

1 professional

Smiling (if possible), eyes open

pop-up studio at the hotel

Social media, homepage,

12

4. SPECIAL EVENTS

13

Parties 1 professional

milieu photos of joyful dancing/talking guests (not visibly drunk) + portraits + closeups of details

Party venues, indoor

Home page, social media, events marketing

14

Receptions 1 professional

portraits + milieu photos of talking people (not visibly drunk)

Restaurants, hotels, bars

Newsletters, homepage

15

CONFERENCES:

16

Industry workshops

1 professional + volunteers

portraits of speakers + milieu photos (avoid empty seats in photos when possible)

Conference halls (hotel)

Newsletters, homepage, social media

17

Press conferences

1 professional

portraits of speakers + milieu photos

Press Centre Press, homepage, social media

18

5. INFORMATIO

52



NAL 19

Milieu 1 professional + volunteers

festival venues (cinemas,hotels,info centres etc), pöff brandings, audience. various shots

Festival venues, indoor/outdoor shots (cinemas, hotels, party venues, press centre, information centres, pöff video studio, concert hall, conference halls, special locations etc)

Social media, homepage, press

20

For Sponsors Volunteers branded objects; branded venues - closeups + audience around

Festival venues, indoor/outdoor shots (cinemas, hotels, party venues, press centre, information centres, pöff video studio, concert hall, special locations etc)

Reports, Sponsor's channels

53



21

Festival Merch

1 professional or volunteer

closeups, well lit, studio background

Pop-up store, preferably studio

Social media, festival catalogue, homepage, newsletter

Date post:	08-Oct-2020
Category:	Documents
Upload:	others
View:	0 times
Download:	0 times

DELIVERABLE · 2019. 11. 26. · Project Acronym: FotoInMotion Grant Agreement number: 780612...

Documents