Broadcast Technology No.62, Autumn 2015● C NHK STRL

Overview of NHK STRL The role of NHK Science and Technology Research Laboratories (STRL) is to help build a richer broad-

casting culture from a research and development viewpoint, both as Japan’s only research organization dedicated to broadcasting technology, and as part of Japan’s public broadcaster. To this end, NHK STRL is conducting a wide range of R&D, from basic technologies to practical applications, on next-generation broadcast media, universal broadcasting services, advanced program production technology, and devices and materials for use in broadcast-ing. We are using these technologies to enrich programming and are actively working on standardization, which is essential for successful implementation of new services.

R e s e a r c h A c t i v i t i e s

Research into services using the complementaryfeatures of broadcasting and communicationsWith the growth of broadband and the increasing speed and capacity of wireless infrastructure, we are working in development of enhanced broadcasting services using telecommunications.HybridcastWe are researching and developing a platform called Hybridcast that features new ways for viewers to enjoy TV. Hybridcast realizes new service, which combines broadcast that can send information to a large number of people at once and broadband that can interactively and individually send information. Hybridcast will be able to provide services with synchronization of broadcast and broadband, linkage with terminals such as tablets, and social media.

8K Super Hi-VisionWe are researching a next-generation TV system called 8K Super Hi-Vision (8K) that conveys a sense of presence and reality to scenes in a very lifelike way. An 8K system combines an extremely high resolution 33-megapixel images (7,680×4,320) with three-dimensional sound provided by a 22.2 multichannel sound system. At NHK, we are researching and developing not only 8K cameras, production equipment, and transmission and display devices, but also video/audio coding devices, error correction methods, and modulation schemes to enable 8K to be delivered to the home by satellite or terrestrial broadcasting.

Technology for the use of “big data for broadcast-ing”Hybridcast provides diverse information and services relating to TV broadcasts over the Internet. It provides services that give viewers in-depth information during TV programs and lets them have fun sharing information with their acquaintances. We are researching and developing database utilization techniques and service models that use program-related information and large-scale data sources, such as social networking services (SNS), as “big data for broadcasting”.

Automatic metadata generation technologyWe are researching and developing a “Video Bank” that facilitates comprehensive searches and flexible usage of video assets for video production. It brings together a mechanism that collects useful meta-data when video assets are first acquired and a technique that automatically generates metadata by analyzing the stored footage.

Imaging technologyWe are researching and developing various 8K cameras, including a high-sensitivity camera that can operate even at the low brightness levels inside a theater, a com-pact cube-shaped single-chip 8K camera with head weighing just 2 kg, and three-chip 8K imaging equipment that uses 8K image sensors compatible with a high frame rate of 120 fps. We are also researching stacked organic imaging devices with the aim of producing cameras that are both smaller and higher in picture quality.

Display technologyWe are researching and developing liquid crystal and plasma displays that can show extremely high resolution imagery (approximately 33 megapixels). We are also conducting research aimed at making projec-tors that are compatible with the color gamut of 8K and lightweight flexible sheet-type displays that can be rolled up and carried around.

Compact cube-shaped single-chip 8K camera

Sound technologyWe are working on the development and standardiza-tion of a 22.2 multichannel sound system (upper layer with nine channels, middle layer with ten channels, lower layer with three channels, and two low frequency effects channels), and we are researching transmission and playback technologies that can be used in the home.

Transmission technologyTo deliver 8K signals to the home, we are studying satel-lite broadcasting in the 12-GHz and 21-GHz bands, as well as terrestrial broadcasting and cable distribution. We are also researching and developing technologies such as wavelength division multiplexing for the deliv-ery of video contributions to the studio by cable and uncompressed wireless transmission in the 120-GHz band.

Recording technologyTo make a single-chip 8K camera with a built-in record-ing device, we are developing a parallel solid-state memory, and for archiving purposes, we are research-ing holographic recording technologies characterized by high-density multiplexed recording and the ability to record and play back in “data page” units of around 1 Mbit.

Hybridcast service example

Compression and coding techniquesWe are researching efficient compression methods based on the HEVC (High Efficiency Video Coding), video compression standard and we are developing coding techniques for the efficient delivery of 8K signals to households, including a new coding method called im-age restoration video coding that makes use of super-resolution techniques.

22

Broadcast Technology No.62, Autumn 2015 ● C NHK STRL

About us

O R G A N I Z A T I O N

NHK Science & Technology Research Laboratories

Planning & Coordination DivisionResearch planning/management, public relations, international /domestic liaison, external collaborations, etc.Patents DivisionPatent applications and administration, technology transfers, etc.Integrated Broadcast-Broadband Systems Research DivisionHybridcast, security, production and utilization of metadata, content recommendation, etc.Advanced Transmission Systems Research DivisionSatellite/terrestrial transmission technology, millimeter-wave and optical 8K contribution technology, multiplexing technology, IP transmission technology, etc.Advanced Television Systems Research Division8K program production equipment, video coding for efficient transmission, highly realistic sound systems, etc.

Human Interface Research DivisionSpeech recognition, advanced language processing such as simple Japanese and sign language CG creation, transmission of tactile/haptic information, etc.Three-Dimensional Image Research DivisionSpatial 3D video system technology (integral 3D etc.), 3D display device technology, cognitive science and technology, etc.Advanced Functional Devices Research DivisionUltrahigh-resolution and ultrasensitive imaging devices, high-capacity fast-write technology, sheet-type display technology, etc.General Affairs DivisionPersonnel, labor coordination, accounting, building management, etc.

Three-dimensional television for playing back spatial imagesAs the next step in television after 8K, we are researching and developing three-dimensional television for playing back spatial images capable of displaying natural 3D images that can be viewed without special glasses. We are researching technology for capturing and displaying integral 3D images with high quality, as well as devices aimed at producing 3D displays by means of holography.

Integral 3D televisionWe are researching and developing integral 3D television technology that can capture and display images from various viewpoints by using a miniature lens array. The technology can display natural 3D images that can be viewed without special glasses and accommodate changes in the viewer’s position not only horizontally but also vertically. A three-dimensional television for playing back spatial images has to handle a huge amount of information in order to reproduce depth details, and we are researching ways of increasing the number of pixels in the capture and display devices.

Generating 3D content from multi-viewpoint videoWe are using integral video technologies to capture integral 3D images of subjects that are difficult to capture with con-ventional optical methods, such as subjects that are far away or large. For this, we are developing a technology whereby multiple cameras are used to capture 3D information about the subject, which is then transformed into an integral 3D image.

Ultra-high-resolution spatial optical conversion elementWe are researching an electro-holographic display as a means of 3D television capable of playing back spatial images. To display 3D images with a wide field of view, it is necessary to use a high-resolution spatial light modula-tor (SLM) consisting of pixels with higher resolution than has so far been achieved. We have devised a spin transfer switching SLM (spin SLM) device with a pixel pitch of less than 1 μm and are working on its development.

An image displayed on a miniature lens array, as seen

from various viewpoints

Human-friendly Broadcasting ServicesWe are researching human-friendly broadcasting techniques to ensure that programs can be enjoyed by everyone, including people with disabilities, elderly persons, and children.

Computer graphics-based sign-language translation technologyWe are researching automatic translation of Japanese into sign language so that weather reports can be conveyed by sign language even during emergencies when no sign-language interpreter is available. This technology synthesizes Computer graphics-based sign lan-guage by using a dictionary database containing 20,000 Japanese terms paired with 3D motion data for the corresponding sign-language gestures, which is produced with the TVML (TV Program Making Language).

A real-time closed-captioning system based on speech recognitionWe are researching speech recognition for making subtitles in live broadcasts in order to offer an expanded range of subtitled program for the elderly and people with hearing disabilities.

Tactile/haptic presentation of broadcast-ing dataAs aids for people with visual disabilities, we are researching tactile and haptic means to convey information that may be difficult to deliver in words, such as two-dimensional information (pictures etc.) and three-dimensional informa-tion (sculptures etc.).

Example of Computer graphics-based sign-language translation

23