Visual Design AnalyticsTakuro Karamatsu / Tadafumi Kawaguchi / Yuto Shinahara / Seiichi Uchida (Kyushu University)
In this presentation, we introduce our recent results on visual design analytics. We employed several
state-of-the-art technologies based on deep neural networks for deriving those results. The results on a
large visual design dataset proved various trends visual designs qualitatively and quantitatively.
1
[1, 2]
[3, 4]
1
[3, 4]
1:
2
Amazon.com1
206,686
1
32
[5] Adobe 2
1,132 6
2
3
1https://www.amazon.com/2https://www.adobe.com/
8: CAE : , 4 CAE
. 3 ,
. , 4 .
.
, CAE
.
n n = 5
0.7 ,
.
,
2 .
, 256 × 256
,
, 1
. ,
,
. ,
,
, .
JSPS JP17H00921
.
[1] -
76(2), 183-187,
2006.
[2]
https://wwwap.hi.u-
tokyo.ac.jp/ships/shipscontroller
[3] ,
2016
19-24 2016.
[4] , , ,
Vol.50, No.4, 1444-1455, 2009.
[5] Cheng-Lin Liu, In-Jung Kim, J.H. Kim,
“High Accuracy Handwritten Chinese Char-
acter Recognition by Improved Feature
Matching Method”, ICDAR, 1033–1037,
1997.
[6] Chairath Sirirattanapol, Yusuke Matsui,
Shin’ichi Satoh et al. “Deep Image Retrieval
Applied on Kotenseki Ancient Japanese Lit-
erature”, IEEE International Workshop on
MLCSA, 2017.
[7] Seiichi Uchida, Yuji Egashira, Kota Sato,
“Exploring the World of Fonts for Discover-
ing the Most Standard Fonts and the Missing
Fonts”, ICDAR, 441-445, 2015.
[8]
2004 5 1
[9]
1985 3 30
The Computers and the Humanities Symposium. Dec. 2018 「人文科学とコンピュータシンポジウム」2018 年 12 月
©2018 Information Processing Society of Japan
－ 262 － － 263 －
2:
1:
Arts & Photography(6446) Biographies & Memoirs(4247)
Business & Money(9934) Calendars(2636)
Children’s Books(13548) Christian Books & Bibles(9119)
Comics & Graphic Novels(3024) Computers & Technology(7954)
Cookbooks, Food & Wine(8770) Crafts, Hobbies & Home(9881)
Education & Teaching(1659) Engineering & Transportation(2661)
Gay & Lesbian(1325) Health, Fitness & Dieting(11794)
History(6789) Humor & Entertainment(6852)
Law(7295) Literature & Fiction(7561)
Medical Books(12058) Mystery, Thriller & Suspense(1989)
Parenting & Relationships(2496) Politics & Social Sciences(3388)
Reference(3252) Religion & Spirituality(7539)
Romance(4289) Science & Math(9239)
Science Fiction & Fantasy(3787) Self-Help(2692)
Sports & Outdoors(5903) Teen & Young Adult(7465)
Test Preparation(2896) Travel(18198)
3.1
[6]
EAST
EAST Fully Convolutional Networks FCN
EAST
ICDAR 2013 ICDAR 20153
3http://rrc.cvc.uab.es/?com=introduction
EAST
3
3.2
3.1
3
[7]
Convolutional
Recurrent Neural Network CRNN
CRNN
4
HSV
HSV
The Computers and the Humanities Symposium. Dec. 2018 「人文科学とコンピュータシンポジウム」2018 年 12 月
©2018 Information Processing Society of Japan
－ 264 －
3: EAST
0 360
0 100
30
4.1
3
[8]
4.2
10 36
2
2
[9]
2(a) (“Busi-
ness & Money” “Education & Teaching”)
2(b)
(“Christian Books & Bibles” “Religion & Spir-
ituality”)
2(c) (“Com-
puters & Technology” “Engineering & Trans-
portation”)
“Sports & Outdoors”
2(d) (“Gay &
Lesbian” “Parenting & Relationships”)
“Arts & Photography” “Children’s
Books” “Crafts, Hobbies & Home” “Humor
& Entertainment” “Literature & Fiction”
“Reference” “Teen & Young Adult”
4.3
4.2
MDS
4
“Computers & Technology”
2:
1:
Arts & Photography(6446) Biographies & Memoirs(4247)
Business & Money(9934) Calendars(2636)
Children’s Books(13548) Christian Books & Bibles(9119)
Comics & Graphic Novels(3024) Computers & Technology(7954)
Cookbooks, Food & Wine(8770) Crafts, Hobbies & Home(9881)
Education & Teaching(1659) Engineering & Transportation(2661)
Gay & Lesbian(1325) Health, Fitness & Dieting(11794)
History(6789) Humor & Entertainment(6852)
Law(7295) Literature & Fiction(7561)
Medical Books(12058) Mystery, Thriller & Suspense(1989)
Parenting & Relationships(2496) Politics & Social Sciences(3388)
Reference(3252) Religion & Spirituality(7539)
Romance(4289) Science & Math(9239)
Science Fiction & Fantasy(3787) Self-Help(2692)
Sports & Outdoors(5903) Teen & Young Adult(7465)
Test Preparation(2896) Travel(18198)
3.1
[6]
EAST
EAST Fully Convolutional Networks FCN
EAST
ICDAR 2013 ICDAR 20153
3http://rrc.cvc.uab.es/?com=introduction
EAST
3
3.2
3.1
3
[7]
Convolutional
Recurrent Neural Network CRNN
CRNN
4
HSV
HSV
The Computers and the Humanities Symposium. Dec. 2018 「人文科学とコンピュータシンポジウム」2018 年 12 月
©2018 Information Processing Society of Japan
－ 264 － － 265 －
2:
“Engineering & Transportation”
“Christian Books & Bibles” “Religion &
Spirituality”
5
[5] (1)Serif
(2)Sans Serif (3)Hybrid (4)Script (5)Historical
Script (6)Fancy 6
5.1
3 1
1.
2.
3.
1
[8]
3.2
2
“A” 2
“A”
[10]
c (c ∈ C =
{Serif, Sans Serif, Hybrid, Script, Historical Script,
Fancy}) dc(dc ≥ 0)
dc =1
K
K∑i=1
dc,i (5.1.1)
dc,i c
i K
dc
c pc
pc =1/dc∑
c′∈C 1/dc′(5.1.2)
K = 1 dc = 0 pc = 1
0
K 3 K = 1
K = 3, 5, 10
K
3
(a) 1
(5.1.2)
1
(b) 1
(a) 1
(c) 1
(b) 1
The Computers and the Humanities Symposium. Dec. 2018 「人文科学とコンピュータシンポジウム」2018 年 12 月
©2018 Information Processing Society of Japan
－ 266 －
4:
1
5.2
2
3
[11,12]
3(a) (“Busi-
ness & Money” “Computers & Technology”)
Sans Serif
Sans Serif
3(b) (“Chris-
tian Books & Bibles” “Literature & Fiction”)
Serif Historical Script
Serif
Historical Script 10
3(c) (“Mys-
tery, Thriller & Suspense” “Science Fiction &
Fantasy”) Fancy
Fancy 5
Fancy
3(d) (c)
(“Children’s Books” “Comics &
Graphic Novels”) Fancy Script
Script
“Arts & Photography” “Calendars”
“Cookbooks, Food & Wine” “Health, Fitness &
Dieting” “Law” “Politics & Social Sciences”
“Reference” “Science & Math”
5.3
5.2
MDS
4
2:
“Engineering & Transportation”
“Christian Books & Bibles” “Religion &
Spirituality”
5
[5] (1)Serif
(2)Sans Serif (3)Hybrid (4)Script (5)Historical
Script (6)Fancy 6
5.1
3 1
1.
2.
3.
1
[8]
3.2
2
“A” 2
“A”
[10]
c (c ∈ C =
{Serif, Sans Serif, Hybrid, Script, Historical Script,
Fancy}) dc(dc ≥ 0)
dc =1
K
K∑i=1
dc,i (5.1.1)
dc,i c
i K
dc
c pc
pc =1/dc∑
c′∈C 1/dc′(5.1.2)
K = 1 dc = 0 pc = 1
0
K 3 K = 1
K = 3, 5, 10
K
3
(a) 1
(5.1.2)
1
(b) 1
(a) 1
(c) 1
(b) 1
The Computers and the Humanities Symposium. Dec. 2018 「人文科学とコンピュータシンポジウム」2018 年 12 月
©2018 Information Processing Society of Japan
－ 266 － － 267 －
3:
“Christian Books
& Bibles” “Religion & Spirituality”
“Education & Teaching” “Medical
Books” “Science & Math”
6
[1]
, Vol.17 No.64 pp.2-6 1997
[2]
Vol.58 No.9 pp.548-557 1985
[3] Mukai, S.: Analysis of Common Cognition
of Impression among Japanese Fonts and Tea
Beverage Packaging, KEER, No.100, pp.1509-
1519 (2014).
[4] Velasco, C., Woods, A.T., Hyndman, S.
and Spence, C.: The Taste of Typeface, i-
Perception, Vol.6, No.4, pp.1-10 (2015).
[5] ABC
2013
[6] Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou,
S., He, W. and Liang, J.: EAST: An Efficient
and Accurate Scene Text Detector, CVPR,
pp.2642-2651 (2017).
[7] Shi, B., Bai, X. and Yao, C.: An End-to-End
Trainable Neural Network for Image-Based
Sequence Recognition and Its Application
to Scene Text Recognition, IEEE TPAMI,
Vol.39, No.11, pp.2298-2304 (2017).
[8] Otsu, N.: A threshold selection method from
gray-level histograms, IEEE Transactions on
Systems, Man, and Cybernetics, Vol.9, No.1,
pp.62-66 (1979).
[9] Color Psychology: The Psychology of Colors
and Their Meanings (online), available
from <https://www.colorpsychology.org/>
(accessed 2018-10-18).
[10] Uchida, S., Egashira, Y. and Sato, K.: Ex-
ploring the World of Fonts for Discovering the
Most Standard Fonts and the Missing Fonts,
ICDAR, pp.441-445 (2015).
[11] Peate, S.: Finding your ”type”: Font psy-
chology and typography inspiration in logo
design (online), Fabrik Brands, available from
<http://fabrikbrands.com/font-psychology-
and-typography-inspiration-in-logo-design/>
(accessed 2018-10-18).
[12] Gendelman, V.: Font Psychology:
How Typefaces Hack Our Brains (on-
line), CompanyFolders, available from
<https://www.companyfolders.com/blog/font-
psychology-how-typefaces-hack-our-brains>
(accessed 2018-10-18).
The Computers and the Humanities Symposium. Dec. 2018 「人文科学とコンピュータシンポジウム」2018 年 12 月
©2018 Information Processing Society of Japan
－ 268 －
