©2013 FUJITSU SEMICONDUCTOR LIMITED Printed in JapanAD04-00052-1E May 2013Edited: Sales Promotion Department
Graphics SoC MB86R20 SeriesIdeally Suitable for Integrated HMI Systems and 360° Wraparound View Systems with Recognition Functions
FUJITSU SEMICONDUCTOR LIMITED
For further information please contact:
North and South AmericaFUJITSU SEMICONDUCTOR AMERICA, INC.1250 E. Arques Avenue, M/S 333Sunnyvale, CA 94085-5401, U.S.A.Tel: +1-408-737-5600 Fax: +1-408-737-5999http://us.fujitsu.com/micro/
EuropeFUJITSU SEMICONDUCTOR EUROPE GmbHPittlerstrasse 47, 63225 Langen, GermanyTel: +49-6103-690-0 Fax: +49-6103-690-122http://emea.fujitsu.com/semiconductor/
KoreaFUJITSU SEMICONDUCTOR KOREA LTD.902 Kosmo Tower Building, 1002 Daechi-Dong,Gangnam-Gu, Seoul 135-280, Republic of KoreaTel: +82-2-3484-7100 Fax: +82-2-3484-7111http://kr.fujitsu.com/fsk/
Asia PacificFUJITSU SEMICONDUCTOR ASIA PTE. LTD.151 Lorong Chuan, #05-08 New Tech Park 556741 SingaporeTel: +65-6281-0770 Fax: +65-6281-0220http://sg.fujitsu.com/semiconductor/
FUJITSU SEMICONDUCTOR SHANGHAI CO., LTD.30F, Kerry Parkside, 1155 Fang Dian Road, Pudong District, Shanghai 201204, ChinaTel: +86-21-6146-3688 Fax: +86-21-6146-3660http://cn.fujitsu.com/fss/
FUJITSU SEMICONDUCTOR PACIFIC ASIA LTD.2/F, Green 18 Building, Hong Kong Science Park,Shatin, N.T., Hong KongTel: +852-2736-3232 Fax: +852-2314-4207http://cn.fujitsu.com/fsp/
All Rights Reserved.FUJITSU SEMICONDUCTOR LIMITED, its subsidiaries and affiliates (collectively, "FUJITSU SEMICONDUCTOR") reserves the right to make changes to the information contained in this document without notice. Please contact your FUJITSU SEMICONDUCTOR sales representatives before order of FUJITSU SEMICONDUCTOR device.Information contained in this document, such as descriptions of function and application circuit examples is presented solely for reference to examples of operations and uses of FUJITSU SEMICONDUCTOR device. FUJITSU SEMICONDUCTOR disclaims any and all warranties of any kind, whether express or implied, related to such information, including, without limitation, quality, accuracy, performance, proper operation of the device or non-infringement. If you develop equipment or product incorporating the FUJITSU SEMICONDUCTOR device based on such information, you must assume any responsibility or liability arising out of or in connection with such information or any use thereof. FUJITSU SEMICONDUCTOR assumes no responsibility or liability for any damages whatsoever arising out of or in connection with such information or any use thereof.Nothing contained in this document shall be construed as granting or conferring any right under any patents, copyrights, or any other intellectual property rights of FUJITSU SEMICONDUCTOR or any third party by license or otherwise, express or implied. FUJITSU SEMICONDUCTOR assumes no responsibility or liability for any infringement of any intellectual property rights or other rights of third parties resulting from or in connection with the information contained herein or use thereof.The products described in this document are designed, developed and manufactured as contemplated for general use including without limitation, ordinary industrial use, general office use, personal use, and household use, but are not designed, developed and manufactured as contemplated (1) for use accompanying fatal risks or dangers that, unless extremely high levels of safety is secured, could lead directly to death, personal injury, severe physical damage or other loss (including, without limitation, use in nuclear facility, aircraft flight control system, air traffic control system, mass transport control system, medical life support system and military application), or (2) for use requiring extremely high level of reliability (including, without limitation, submersible repeater and artificial satellite). FUJITSU SEMICONDUCTOR shall not be liable for you and/or any third party for any claims or damages arising out of or in connection with above-mentioned uses of the products.Any semiconductor devices fail or malfunction with some probability. You are responsible for providing adequate designs and safeguards against injury, damage or loss from such failures or malfunctions, by incorporating safety design measures into your facility, equipments and products such as redundancy, fire protection, and prevention of overcurrent levels and other abnormal operating conditions.The products and technical information described in this document are subject to the Foreign Exchange and Foreign Trade Control Law of Japan, and may be subject to export or import laws or regulations in U.S. or other countries. You are responsible for ensuring compliance with such laws and regulations relating to export or re-export of the products and technical information described herein. All company names, brand names and trademarks herein are property of their respective owners.
FUJITSU SEMICONDUCTOR LIMITEDNomura Fudosan Shin-yokohama Bldg. 10-23, Shin-yokohama 2-Chome,Kohoku-ku Yokohama Kanagawa 222-0033, JapanTel: +81-45-415-5858http://jp.fujitsu.com/fsl/en/
Third-Generation Graphics SoC has high performance CPU/GPU, 6 video inputs, and 3 display output functions
MB86R20 SeriesIn addition to high graphics rendering performance,
these devices come with exhaustive software tools which make them ideally suitable for
the development of integrated HMI systems and 360°
wraparound view systems with recognition functions.
IntroductionIn order to increase the environmental friendliness, safety, Relief,
and comfort of automobiles, there is an increasing need for
“Integrated HMI (Human – Machine Interface) Systems” that are
windows of information linking together people, automobiles,
and the world, and the need is also increasing for “360°
Wraparound View Systems with Recognition Functions” that warn
without fail about dangers surrounding the vehicle in a
three-dimensional manner.
The “MB86R20 series” third-generation graphics SoC, compared
to the second-generation graphics SoC of the “MB86R10 series”,
has its CPU and GPU performances increased by 2 times and 5
times, respectively, and also has 6 video inputs and 3 display
output functions all available at the same time. Further, systems
with one-stop procurement of all necessary items and with lesser
number of man-hours can be developed because the necessary
software is also provided along with the chips.
MB86R20 Series
In order to experience driving that is environment-friendly, safe,
relieved, and also comfortable, the amount of information linking
people, automobiles, and the outside increases dramatically.
Now-a-days, such information spans various aspects such as battery
information of electric vehicles, vehicle fault diagnosis information,
image information from cameras, warning information, navigation
information, smart-phone-linked information, and cloud-linked
information, and so on.
Until now individual display control was being made of such
information using the center display, cluster display, head-up display,
etc. (Figure 1). However, in order to transfer information in real time
and in an easy-to-understand manner between the driver and the
vehicle, it is necessary to aggregate all such information in one
location and to carry out centralized control of how the information is
portrayed to match with the driving situation. This is done by an
integrated HMI system, and this trend is considered to accelerate as
the harmony among people, automobiles, and the environment
increases.
The MB86R20 series has a high-performance CPU/GPU, 6 video inputs,
and 3 display output functions available all at the same time,
aggregates video information from various sources such as a
system of cameras, head unit, etc., and carries out appropriate
display control of the center display, cluster display, head-up
display, etc. to suit the driving situation (Figure 2).
In addition, in an integrated HMI system, each display section is
modularized and platformed, which not only greatly reduces the
component count but also makes it easy to extend the product to
other vehicle types.
In a 360° wraparound view system, the entire surroundings of the
vehicle can be checked clearly and also from any viewpoint by
3-D processing of the images from four cameras installed at the
front, rear, left, and right of the vehicle. Systems using the
MB86R10 series devices, which are second-generation SoC, have
already been introduced in the market and are starting to spread
worldwide (Figure 3).
Tendency of Integrated HMI
Towards Further Safety and Relief (360° wraparound view system with recognition function)
Figure 1 Display control until now (Individual type)
Figure 3 360° wraparound view system using MB86R10 series
FRONT
Front,rear,left, and right camera images
3-D setting of the surrounding area
3-D processing of camera images
Free viewpoint image completed
BACK
RIGHTLEFT MB86R10series
FRONT
BACK
RIGHTLEFT
Figure 2 Display control by MB86R20 series (integrated HMI)
SPI360° wraparound
view 3-D monitoring system
IntegratedHMI
APIX, LVDS
Head unit
Smart-phone
MCU
Head-up display
LED
LEDRSDS RSDS
RSDS
Cluster display
MB88F330LED
Center display
MB88F330
CAN
MB86R20
USB/MHL/WiFi/BT
MB88F330
MB86R20
SPI
APIX, LVDS
MCU
Driver
LED
Sensor
Mirror
Mirror LEDRSDS RSDS
RSDS
Driver
MB88F330
Driver
LED
Sensor
MB88F330
CAN
MB86R20
Cloud
USB/MHL/WiFi/BT
MB88F330
MB86R20
FUJITSU
LED
LEDRGB
RGBSPISPI
T-con
T-con
Center display Cluster display Head-up display
CAN
360° wraparoundview 3-D
monitoring system
Head unit
MB86R20
LED
RGB
SPI
T-con
MCUMCU
MCU
MB86R20
MB86R20
MB86R20
USB/
MH
L/W
iFi/B
T
Driver
Sensor
LED
Sensor LEDRGB
RGBSPISPI
T-con
Driver
T-con
CAN
Frame buffer
Frame buffer
Driver
MB86R20
LED
Sensor
Mirror
RGB
SPI
T-con Frame buffer
MCUMCU
MCU
MB86R20
MB86R20
MB86R20
Internet
USB/
MH
L/W
iFi/B
T
FUJITSUFUJITSU
FUJITSU
MB86R20 Series(The block diagram is shown in Figure 6.)
Figure 4 The MB86R10 series is also compatible with mega-pixel cameras Figure 5 360° wraparound view monitor image with recognition function using the MB86R20 series
MB86R20 Series
Figure 6 Block diagram Figure 7 Example of processing in four rendering layers (possible up to 8 layers)
Display
Graphics board
MB86R12
DeserializerLVDS
DeserializerLVDS
DeserializerLVDS
DeserializerLVDS
Outputs the image
Image processing
MB86R12
1280 x 800 mega-pixeldigital cameras
Frontcamera Connector Deserializer
LVDS
Leftcamera Connector Deserializer
LVDS
Rightcamera Connector
Connector
Deserializer
Memory
LVDS
Rearcamera Connector Deserializer
LVDS
Right camera
Rear camera
Capturedimage
3-Dprojection grid
3-Dcar model
UARTUSART
Gen. PurposeBus 16bit
ARM® Neon™ SIMD ARM® Neon™ SIMD
ARM® Cortex™ -A9
533MHz
ARM® Cortex™ -A9
533MHz
L1-Cache 32/32 KB
L1-Cache 32/32 KB
Internal SRAM
L2 -Cache 512KB
PWR MgmtWatchdog
DDR3/3L 800/106616/32/64-bit (2 x32)
16chDMA
I²C
PWM
I²S
HS-SPISPI
Video Capture
Video Capture
Video Capture
Video Capture
Video Capture
Video Capture
Ethernet MACIEEE1588 CAN
ext. IRQ
USB 2.0
SD/MMC
GPIO
POWERVR™SGX543
3D Engine
OpenGL ES, VG, CL
Iris Core2D Engine
DitheringGamma
SIG Unit
Display CtrlRGB, LVDS
Display CtrlRGB
Display CtrlRGB
MediaLB®
ADC
Dual ARM® Cortex™-A92x 533MHz (automotive) ARM® Neon™ SIMD Engine
Display Controller 2x up to 1920x720p,1x up to 1920x1080p
POWERVR™ SGX5433D Engine 6,4GFLOPS, 1GPix/s,35MPoly @ 200MHzOpenGL® ES, OpenVG™, OpenCL™
Fujitsu proprietary 2D Engine
Video Capture 6 x 1920x1080
DDR3/3L-1066 x16, x32, x64
Standard I/O I²C, I²S, UART, SPI, FPD-Link
Network CAN, Ethernet
Proc
esso
rGr
aphi
csVi
deo
Mem
ory
Períp
hera
ls
Visible application
Layer 1
*Example of four layers
Layer 2
Layer 3
Layer 4
Connector
In the FutureSystem-level Software Tools
* ARM is the registered trademark of ARM Limited in the EU and other countries.
* Cortex-A9 is trademark of ARM Limited in the EU and other countries.
Figure 10 Organizational chart of the CGI Studio Figure 11 Software configuration diagram
Figure 8 Rendering the needles of cluster display and the image of the vehicle Figure 9 Rendering the needles of cluster display and the captured image
2-D engine 2-D engine3-D engine
Video capture
2-D engine 2-D engine
Debugging and compiling environment(E.g. Visual Studio / Eclipse)
MicrosoftWindows
Host development environment(PC) Target platform
Developmen environment forHMI designers
Development environment for embeddedsoftware developers
Software platform
Host constituent element
2DG/OpenGLES 2.0
2DG/OpenGLES 2.0
Green HillsSoftware
eSOLLinux …
3D Modeling tool(3s Max, Cinema 4D)
CPU / GPU
MCU / GPU MB86R20
Host Simulation
Rendering
GUI component
Candera
CGI Constituent element
CAN / MOST…
…
GUIapplication
Real Time OS
CanderaScene Composer
Geometry, Textures, Material, Animation
CGIConstituent
element
DesignImport
Visualize
Application
Sample program
360° wraparound viewlibrary
OS
printed circuit board with MB86R20
Middleware
OS/drivers
Hardware HardwareProvidedby Fujitsu
Semiconductors
Peripheral function drivers Drivers Customer’senvironment
GDC driver Filesystem
360° wraparound viewauthoring tools
SoC’s of the MB86R10 series, the CPU performance has been
increased to about 2 times, and the GPU performance has been
increased to about 5 times. In addition, at the same time, our
company’s excellent 2-D engine realizing warping-on-the-fly, etc.
has been installed. Because these operate independently, a
much higher performance has been obtained.
Multiple video inputs and strengthening of display outputsThis series is compatible with 6 full high-density video inputs and
3 video outputs. High resolution camera images can be input
implying that high resolution contents can be input, and outputs
can be made to several high resolution displays.
Rendering performance exceeding the specificationsIn addition to simultaneously operating 2-D engine, 3-D engine, and
video capture, by having eight rendering layers, optimum image
processing can be done on different rendering layers to suit the
application or the contents. For example, by 2-D/3-D processing of the
rendering of the needle in the cluster display and of the rendering of
the vehicle in different layers, a rendering performance is obtained
that is higher than the specifications (Figures 7 to Figure 9).
The MB86R10 series can accept not only analog cameras but also
mega-pixel digital cameras, whereby the surroundings of the vehicle
can be portrayed as very clear images (Figure 4). Along with the
proliferation of this system, the demand is not only for the ability to
visually verify the surroundings of the vehicle but also fornew
functions that reduce items overlooked by the driver.
The third-generation SoC of the MB86R20 series has much higher
performance CPU/GPU, and it has been possible to realize both
checking of the surroundings from any viewpoint and reduction of
oversight by the driver due to object recognition (Figure 5). In
addition, since 6 camera images can be handled at the same time,
the concerned scene can be enlarged and the degree of freedom of
portraying the 3-D image has been increased.
Strengthening CPU and GPUTwo ARM® CortexTM-A9 are used as the CPU. POWERVRTM SGX543 is
used as the 3-D engine, and compared to the second-generation
Automotive gradeThe high reliability has been realized meeting the demands in
automobile and other fields.
For integrated HMI systems, the authoring tool “CGI Studio” is
provided so that the contents design can be done by the
designer and the engineers by cooperative design (Figure 10).
Using this tool, not only the performance of the MB86R20 series
can be brought out to the maximum extent, but also because of
cooperative design by the designer and the engineer, the
contents visualized by the designer can be reproduced instantly
on the MB86R20, and reworks in the middle of merchandizing
get reduced.
For the 360° wraparound view system with recognition function,
in addition to the conventional set of software tools for 360°
wraparound view system (Figure 11), software products will be
provided successively for realizing recognition functions.
Development of 360° wraparound view system with recognition
functions can be made easily using these system-level software
products.
In the process of people, automobiles, and the environment
becoming more harmonized and automobiles becoming the natural
means of mobility in the day-to-day lives of people, there will be
increasing demand for the window of information linking people,
automobiles, and the world, that is, the “integrated HMI system”,
and the “360° wraparound view system with recognition function”
supporting safety and relief. Our company will continue to provide
LSI products towards the realization of a “human-centric” society in
which people are at the center