+ All Categories
Home > Documents > IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic...

IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic...

Date post: 10-Oct-2019
Category:
Upload: others
View: 3 times
Download: 0 times
Share this document with a friend
12
REPORTER “THE WINDOW ON IMAGING” IS&T imaging.org Electronic Imaging Symposium 2014 BEST STUDENT PAPER AWARDS Digital Photography X Stereo vision based depth of field rendering on a mobile device Qiaosong Wang, Zhan Yu, Christopher Rasmussen, and Jingyi Yu, University of Delaware (USA) Abstract: The Depth of Field (DoF) effect is a useful tool in pho- tography and cinematography because of its aesthetic values. However, capturing and displaying dynamic DoF effect was un- til recently a quality unique to expensive and bulky movie cam- eras. In this paper, we propose a computational approach to gen- erate realistic DoF effectsfor mobile devices such as tablets. We first calibrate the rear-facing stereo cameras and rectify stereo image pairs through FCam API, then generate a low-res dispari- ty map using graph cuts stereo matching and subsequently up- sample it via joint bilateral upsampling. Next we generate a syn- thetic light field by warping the raw colorimage to nearby viewpoints according to corresponding values in the upsampled high resolution disparity map.Finally, we render dynamic DoF effect on the tablet screen with light field rendering. The user can easily capture and generate desired DoF effects with arbitrary aperture sizes or focal depths using the tablet only with no addi- tional hardware or software required. The system has been test- ed in a variety of environments with satisfactory results. Document Recognition and Retrieval XXI Scalable ranked retrieval using document images Rajiv Jain, Douglas W. Oard, and David Doermann, University of Maryland (USA) Abstract: Despite the explosion of text on the Internet, hard copy documents that have been scanned as images still play a sig- nificant role for some tasks. The best method to perform ranked retrieval on a large corpus of document images, however, re- mains an open research question. The most common approach has been to perform text retrieval using terms generated by opti- cal character recognition. This paper, by contrast, examines whether a scalable segmentation-free image retrieval algorithm, which matches sub-images containing text or graphical objects, can provide additional benefit in satisfying a user’s information needs on a large, real world dataset. Results on 7 million scanned pages from the CDIP v1.0 test collection show that content based image retrieval finds a substantial number of documents that text retrieval misses, and that when used as a basis for relevance feed- back can yield improvements in retrieval effectiveness. papers continue on page 10 To view the full papers of these abstracts for no fee go to www.imaging.org/ist/publications/reporter/index.cfm * These papers were presented within the conference noted at the IS&T/SPIE Electronic Imaging Symposium, held Feb. 2--6, 2014, in San Francisco, CA. INSIDE THIS ISSUE Highlighted Abstracts: EI Best Student Papers ...1 Electronic Imaging 2014 ............... 2 Standards Update..................... 6 Vol. 29, No. 2 April - June 2014 Left: Professor Alan Bovik received his IS&T Honorary Membership award at EI. Honorary Member- ship is the highest award bestowed by the Society. A past EI plenary speaker, Dr. Bovik directs the Laboratory for Image and Video Engineering at The University of Texas at Austin. Right: Symposium Co-Chair Sheila Hemami pres- ents the 2014 Electronic Imaging Scientist of the Year award to Professor Charles A. Bouman of Purdue University. This year Prof. Bouman gave a plena- ry address titled “Integrated Imaging: Creating Images from the Tight Integration of Algorithms, Computation and Sensors.” Photo: Mojgan Rabbani. Photo courtesy of Al Bovik website. Boumann and Bovik Honored at EI
Transcript
Page 1: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

REPORTER“THE WINDOW ON IMAGING”

IS&T

imaging.org

Electronic Imaging Symposium 2014BEST STUDENT PAPER AWARDS

Digital Photography XStereo vision based depth of field rendering on a mobile deviceQiaosong Wang, Zhan Yu, Christopher Rasmussen, and Jingyi Yu,University of Delaware (USA)

Abstract: The Depth of Field (DoF) effect is a useful tool in pho-tography and cinematography because of its aesthetic values.However, capturing and displaying dynamic DoF effect was un-til recently a quality unique to expensive and bulky movie cam-eras. In this paper, we propose a computational approach to gen-erate realistic DoF effectsfor mobile devices such as tablets. Wefirst calibrate the rear-facing stereo cameras and rectify stereoimage pairs through FCam API, then generate a low-res dispari-ty map using graph cuts stereo matching and subsequently up-sample it via joint bilateral upsampling. Next we generate a syn-thetic light field by warping the raw colorimage to nearbyviewpoints according to corresponding values in the upsampledhigh resolution disparity map.Finally, we render dynamic DoFeffect on the tablet screen with light field rendering. The user caneasily capture and generate desired DoF effects with arbitraryaperture sizes or focal depths using the tablet only with no addi-tional hardware or software required. The system has been test-ed in a variety of environments with satisfactory results.

Document Recognition and Retrieval XXIScalable ranked retrieval using document imagesRajiv Jain, Douglas W. Oard, and David Doermann, University ofMaryland (USA)

Abstract: Despite the explosion of text on the Internet, hardcopy documents that have been scanned as images still play a sig-nificant role for some tasks. The best method to perform rankedretrieval on a large corpus of document images, however, re-mains an open research question. The most common approachhas been to perform text retrieval using terms generated by opti-cal character recognition. This paper, by contrast, examineswhether a scalable segmentation-free image retrieval algorithm,

which matches sub-images containing text or graphical objects,can provide additional benefit in satisfying a user’s informationneeds on a large, real world dataset. Results on 7 million scannedpages from the CDIP v1.0 test collection show that content basedimage retrieval finds a substantial number of documents that textretrieval misses, and that when used as a basis for relevance feed-back can yield improvements in retrieval effectiveness.

papers continue on page 10

To view the full papers of these abstracts for no fee go towww.imaging.org/ist/publications/reporter/index.cfm

* These papers were presented within the conference noted at the IS&T/SPIE ElectronicImaging Symposium, held Feb. 2--6, 2014, in San Francisco, CA.

INSIDE THIS ISSUEHighlighted Abstracts: EI Best Student Papers . . . 1Electronic Imaging 2014 . . . . . . . . . . . . . . . 2Standards Update. . . . . . . . . . . . . . . . . . . . . 6

Vol. 29, No. 2 April - June 2014

Left: Professor Alan Bovik receivedhis IS&T Honorary Membershipaward at EI. Honorary Member-ship is the highest award bestowed by the Society. A past EI plenary speaker,Dr. Bovik directs the Laboratory for Image and Video Engineering at TheUniversity of Texas at Austin. Right: Symposium Co-Chair Sheila Hemami pres-ents the 2014 Electronic Imaging Scientist of the Year award to ProfessorCharles A. Bouman of Purdue University. This year Prof. Bouman gave a plena-ry address titled “Integrated Imaging: Creating Images from the Tight Integrationof Algorithms, Computation and Sensors.”

Phot

o:M

ojga

nRa

bban

i.

Phot

oco

urte

syof

AlB

ovik

web

site

.

Boumann and Bovik Honored at EI

Page 2: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

IS&T/SPIE held the 26th annualElectronic Imaging (EI) Symposium,February 2-6, 2014, for the first time in

the heart of San Francisco. The symposiumattracted close to 1,000 participants, a di-verse and multi-disciplinary community ofscientists and engineers from all around theworld, representing academia, industry,and government labs. This year, the num-ber of non-US participants surpassed thenumber of attendees from the US.

The Symposium Steering Committeemembers were Symposium Chair SergioGoma (Qualcomm, Inc.), Symposium Co-chair Sheila Hemami (NortheasternUniversity), Short Course Chair Choon-Woo Kim (Inha University), Short CourseCo-chair Majid Rabbani (Eastman KodakCo.), Past SymposiumChair Gaurav Sharma(University of Rochester), TechnicalAdvisor Andrew J. Woods (CurtinUniversity), IS&T Executive DirectorSuzanne Grinnan, and SPIE Event Man-ager Rob Whitner.

The EI Symposium is the premiermeeting event in the field of ElectronicImaging, addressing human vision re-search, computational imaging, imagequality, and technologies such as 3D dis-play, multimedia, and mobile devices andapplications. In 2014, the Symposium fea-tured 524 oral presentations, 127 posterpresentations, and 14 short courses. As in

2013, the Symposium encompassed sevenmain technology clusters, each of whichcomprised a number of technical confer-ences, for a total of 22 conferences. Theseven technology clusters were: (i) 3D im-aging, Interaction, and Metrology, (ii) Vi-sualization, Perception, and Color, (iii)Image Processing, (iv) Image Capture, (v)Computer Vision, (vi) Media Processingand Communication, and (vii) MobileImaging.

The Stereoscopic Displays and Appli-cations (SD&A) conference, which cele-brated its 25th anniversary this year, regis-tered by far the largest number of acceptedoral papers among the EI conferences. It

also held its popular3D theater (a per-sonal favorite),which showcased awide variety of 3Dcontent that hadbeen produced andexhibited aroundthe world. The the-atre session wasshown in high-qual-ity, polarized 3D ona large screen with3D glasses providedon site. Andrew

Woods from Curtin University, who haschaired the SD&A conference since 2003and traditionally runs the 3D theatre, wasabsent this year due to last minute cir-cumstances. However, to the attendees’pleasant surprise, he was remotely beamedin to run this year’s event. The SD&A con-ference also included as a new event a“Magical Mystery 3D” bus tour of SiliconValley 3D companies.

The Human Vision and ElectronicImaging (HVEI) conference, which hadcelebrated its 25th anniversary last year,was second in the number of accepted oralpapers and continues to be one of the cen-terpieces of EI with its own dedicatedgroup of authors and participants. Theconference brings in art, psychology, andsocial sciences research to advance under-standing of how the human visual systeminterprets information. Aided by generouscontributions from several sponsors whoprovided drinks and snacks, HVEI heldspecial interactive discussion sessions atthe end of each day. These sessions wereattended by the authors of the papers pre-sented in that day, and provided a relaxedand informal venue for the conferenceparticipants to examine each topic inmore depth in an interactive and informalsetting. The discussion sessions were well

IS&T Reporter2

www.imaging.orgVol. 29 No. 2 April – June 2014

3D THEATER, CYBER SECURITY, VISUALIZATION, AND MORE . . .By Mojgan Rabbani, Xerox Corporation

Various visual display devices were a highlight of the Demonstration Session.

Phot

o:M

ojga

nRa

bban

n.

A word cloud made from the titles of oral and poster presentations at the2014 EI Symposium, by Mojgan Rabbani.

Page 3: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

3

Vol. 29 No. 2 April – June 2014www.imaging.org

attended (I attended all of them) and, inmy opinion, added a lot of perspective tothe research topics presented earlier. Thelast day’s session was followed by a muse-um visit to the Exploratorium; a hands-onmuseum of science, art, and humanperception.

A unique illustration from HVEI thatcaptured my imagination was the series ofword clouds that Bernice Rogowitz andThrasyvoulos Pappas had created to ex-plore the history of HVEI throughout thepast 26 years. This inspired me to build aword cloud from all the titles from thisyear’s EI Symposium. Clearly, the wordimage takes center stage, followed by allthe usual suspects. It is interesting howvideo andmobile have grown; surveillanceis elbowing itself in, etc. I let you have funsurfing the cloud, and exploring your areaof interest within it.

Plenary and Keynote SpeakersAside from personal technical interests, Ifound the two Symposium plenary talksscheduled for Tuesday and Wednesdaymornings, along with the Symposium-wide keynotes given in conjunction withindividual conferences throughout theweek, among the most informative eventsof the EI Symposium.

In the time-honored tradition of theEI Symposium, two engaging plenaryspeakers were scheduled for Tuesday andWednesday mornings, with presentationsthat expanded the areas of traditional im-aging and image processing. Jack Gallant’sfascinating talk entitled “Using fMRI ToReverse Engineer the Human Visual Sys-tem,” contained some of the most stimu-lating slides and animations of the visualcortex that I had seen on this topic. He ex-plained how his group at Berkeley uses a

data-driven system identificationapproach to accomplish this task.For those wishing to learn more,the link to The Gallant lab @ UC Berkeleyis http://gallantlab.org.

Charles Bouman (also the recipient ofthe 2014 EI Scientist of the year award)presented “Integrated Imaging: CreatingImages from the Tight Integration of Al-gorithms, Computation and Sensors.” In-tegrated Imaging aims at blending noveland often counter-intuitive sensor designwith algorithms that exploit the availabilityof enormous quantities of data and com-putation. Bouman presented examples ofthe state-of-the-art integrated imagingsystems tackled by his group at PurdueUniversity based on computed tomogra-phy (CT), transmission electron mi-croscopy (TEM),synchrotron beamimaging, opticalsensing, and scan-ning electron mi-croscopy (SEM).

In addition tothe Symposiumplenary talks, manyconferences heldtheir own keynotepresentations (seelist on page 4).These provided anexcellent opportu-nity to learn aboutthe recent advancesin a popular topicwithout being anexpert in the field.

Symposium participants enjoying the 3D theatre, while SD&A Conference ChairAndrew Woods makes a virtual appearance from Australia. 2014 marked the25th Stereoscopic Displays and Applications Conference. Members of the com-mittee were presented with certificates acknowledging this milestone.

The DIGIMARC team demonstrating their invisibledigital watermarking that achieved a newGuinness world record.

Right: Charles A. Bouman (Purdue University) presenting theWednesday plenary, “Integrated Imaging: Creating Imagesfrom the Tight Integration of Algorithms, Computation, andSensors.” Below: Jack Gallant (University of California atBerkeley) presenting the Tuesday morning plenary, “UsingfMRI to Reverse Engineer the Human Visual System.”

EI2014Attendees*: 926Oral Papers: 524Interactive Papers: 127Short Courses: 14Exhibitors: 10Dates: February 2-6, 2014Location: San Francisco, California*includes Short Course only and guests

Society for Imaging Science and Technology

Phot

os:M

ogja

nRa

bann

i.Ph

oto:

Rob

Whi

tner

.

Page 4: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

IS&T Reporter4

www.imaging.orgVol. 29 No. 2 April – June 2014

I attended two inform-ative HVEI conferencekeynotes: “Perceiving, meas-uring, and modeling 3Dmaterial appearance,” byChris Tyler (Kettlewell EyeResearch Institute), and“The science of social inter-actions on the web,” by EdChi (Google). I also attend-ed two of the three keynotesin the Media Watermarking, Security, andForensics conference and really enjoyedthe presentation by Hani Farid (Dart-mouth College), “Photo forensics fromshadows and shading.”

On a side note, I also found the three15-minute demo sessions offered by theMedia Watermarking, Security, andForensics conference quite interesting.One of them addressed an application ofrobust invisible digital watermarking thatembedded the UPC symbol of a productin the entire packaging area, thus relievingthe cashier from having to find and direct-ly scan the UPC symbol and thereby sig-nificantly speeding up the check outprocess. The demo showed a video of howDigimarc, using this technology, achieveda new Guinness world record for thefastest time to scan and bag 50 items in 48seconds as compared to the previousrecord of 75 seconds (http://vimeo.com/84078592).

Short CoursesTechnical short courses have always beenone the strongest components of the EIconference and are an efficient way ofcoming up to speed in a certain technolo-gy area. Registration at the conference is

not required for taking a short course and25 attendees took advantage of this oppor-tunity. Course attendees can receive CEUsto fulfill continuing education require-ments.

EI 2014 featured 14 short courses thatspanned a broad range of fundamentaland current topics in electronic imaging.Short course registrations were strong andslightly surpassed 2013 in terms of num-ber of registrations per conference at-tendee despite the fact that fewer courseswere offered in 2014. A few popular pastcourses not offered in 2013 were back onstage. Among them were the “Joint Designof Optics and Image Processing for Imag-ing Systems,” by David Stork, “PerceptualMetrics for Image and Video Quality in aBroader Context: From Perceptual Trans-

The Interactive Paper and DemonstrationSession allows for networking on a vari-ety of levels. This year’s event was com-plemented by an Industry Exhibit.

Phot

os:M

ogja

nRa

bban

i.

EI 2014 Conference Keynotes

• HVEI: “The science of social interactionson the web,” Ed. H. Chi, Google (USA)

• HVEI: “Seven challenges for image qualityresearch,” Damon M. Chandler,Oklahoma State University (USA)

• HVEI: “Images shared in social media:a window into human sentiment andemotion,” Shih-Fu Chang, ColumbiaUniversity (USA)

• HVEI: “Digital coloring books,” PatrickHanrahan, Stanford University (USA)

• HVEI: “Perceiving, measuring, and model-ing 3D material appearance,”Christopher W. Tyler, Smith-Kettlewell EyeResearch Institute (USA)

• Image Quality and System PerformanceXI: ““Perceptual tools for quality-awarevideo networks,” Alan C. Bovik, TheUniversity of Texas at Austin (USA)

• Media Watermarking, Security, andForensics 2014: “Photo forensics fromshadows and shading,” Hany Farid,Dartmouth College (USA)

• Media Watermarking, Security, andForensics 2014: “Digital wallet andmobile payment,” Sunil K. Jain, IntelCorporation (USA)

• Media Watermarking, Security, andForensics 2013: “Piracy conversion: therole of content protection and forensics,”Richard Atkinson, Adobe Systems Inc. (USA)

• SD&A:“Compressive displays: combin-ing optical fabrication, computationalprocessing, and perceptual tricks tobuild the displays of the future,” GordonWetzstein, MIT Media Lab (USA)

• SD&A:“Preservation and exhibition ofhistorical 3D movies, Jeff Joseph,”World 3D Film Expo (USA)

• Visual Information Processing andCommunication V: “HSA overview andhow it impacts image processing,”Philip Rogers, AMD (USA)

• Visualization and Data Analysis: “Whatmakes cybersecurity visualizations differ-ent from other types of visualization,Pak Chung Wong,” Pacific NorthwestNational Laboratory (USA)

• Visualization and Data Analysis: “Just-in-time visual analytics and discovery,”Eser Kandogan, IBM Almaden ResearchCenter (USA)

Page 5: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

5Society for Imaging Science and Technology

Vol. 29 No. 2 April – June 2014www.imaging.org

parency to Structural Equivalence,” byPappas and Hemami, and “Perception,Cognition, and Next Generation Imag-ing,” by Rogowitz. Also, Battiato’s coursewas offered with a new focus entitled “Im-age and Video Forensics: Recent Trendsand Challenges.”

Other Conference HighlightsHands-on DemonstrationsThe symposium demonstration session isan attractive, hands-on showcase of hard-ware, software, display, and researchproducts, all related to the topics coveredby EI. It has traditionally showcased thelargest and most diverse collection ofstereoscopic research and products in onelocation—and this year was no exception.

Interactive PresentationsThe Interactive Paper Sessions were alsooffered for 80 minutes on Tuesday andWednesday. The authors were available toanswer questions and engage in in-depthdiscussions about their research.

Industry ExhibitThis year, the EI Symposium launched anannual industry exhibit focused on mobileimaging and its applications. This eventprovided a unique opportunity to meetcompany representatives working in thisand other related EI spaces and to becomefamiliar with their products and serviceswhile meeting prospective employers.

JEI Paper PresentationsFor the second year, the 2014 Symposiumfeatured a number of presentations by au-thors whose papers appeared in the Jour-nal of Electronic Imaging (JEI). These pa-pers were prominently highlighted in theEI program by the “JEI logo” and were in-tegrated into the appropriate topical con-ference programs throughout the sympo-sium. As a courtesy to conferenceattendees, re-prints of these papers wereincluded within the conference proceed-ings. “The approach is designed to benefitboth the JEI paper authors and the EI au-dience,” commented JEI Editor GauravSharma, who helped formulate this ap-proach. “The authors get to share and

highlight their work before theEI audience; EI attendees get tohear a firsthand account of thework and to ask questions. Thisapproach also serves an impor-tant need for some members ofour EI community who would prefer tohave their work be directly featured in arigorously-reviewed journal.”

Networking Into the NightFinally, the all-conference reception,which provides a relaxing venue for meet-ing colleagues and expanding one’s pro-fessional network, was held as a beverageand dessert event on Wednesday evening.

Conference Award PresentationsTraditionally, the Symposium and Societyawards are presented before the plenarysessions on Tuesday and Wednesdaymornings. IS&T presented some of its2013 awards on Tuesday, including Hon-orary Membership—the highest award ofthe Society—to Alan Bovik (The Universi-ty of Texas at Austin) for his impact inshaping the direction and advancement ofthe field of perceptual image processing.2013 IS&T Fellows recognized at EI wereSos Agaian, Francisco Imai, and GauravSharma. Senior Member was given toRicardo Motta and Thrasyvoulos Pappas,and Service Awards to John Merritt andRobert Stevenson.

Wednesday morning marked therecognition of the Symposium awards.The most noteworthy is the ElectronicImaging Scientist of the Year award,granted to a member of the greater elec-tronic imaing community who hasdemonstrated excellence and commandedrespect of his/her peers by making signifi-cant contributions to the field of electron-ic imaging via research, publication,and/or service. The 2014 Electronic Imag-ing Scientist of the Year Award waspresented by Symposium Co-chair Sheila

Hemami to Professor Charles A. Bouman(Purdue University).

Several conferences awarded theirbest paper and/or best student paperawards, the abstracts of which are foundbeginning on page 1. Full papers can bedownloaded from imaging.org.

San Francisco to Host EI 2015EI 2015 will be located in the Hilton SanFrancisco in Union Square Feb 8 th-12th,2015. The 2015 Symposium Chair is SheilaHemami (Northeastern University, USA)and the Symposium Co-chair is Choon-Woo Kim (Inha University). MajidRabbani (Eastman Kodak Co.) is the shortcourse chair. Similar to 2014, the EI Sym-posium will run concurrent with thePhotonics West Conference, held at theSan Francisco Moscone Center, only a fewblocks from the Hilton. EI attendees areable to attend the extensive and diverse setof Exhibits at Photonics West, benefitingfrom relevant short courses, and expand-ing their professional network. �

The HVEI conference ends each daywith an open discussion among all thedays speakers and participants. Valuedby many for the additional interactionand networking this activity brings, theformat remains a perennial favorite.

Phot

o:M

ogja

nRa

bban

i.

Electronic Imaging 2015CALL FOR PAPERSAbstract deadline: 28 July 2014

TECHNICAL AREAS:

• 3D Imaging, Interaction, Metrology

• Visualization, Perception, Color

• Image Capture

• Image Processing

• Mobile Imaging

• Computer Vision

• Media Processing & Communication

www.electronicimaging.org

Page 6: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

IS&T Reporter6

www.imaging.orgVol. 29 No. 2 April – June 2014

Imaging Standards News

This Imaging Standards News is focused on both US nationaland international standards applicable to photographic imag-ing, including analog, digital and print concerns. IS&T imag-

ing standards encompass the capture, communication, and dis-play of a photographer’s desired image content, the advancementand maintenance of analog photographic imaging technologies,and the preservation of physical imaging materials; all practicesessential to everyday enjoyment of photography and to our pho-tographic heritage.

ISO/TC 42: Working GroupsTC 42 and its contributing experts are conducting current proj-ects within the following working groups and joint workinggroups. In each of these areas, experts are welcome to contributethrough their corresponding national committees. For meetingdetails for the working groups listed below, please contact theSecretariat, [email protected].

Working Groups with current projects within TC 42— WG 3, Sensitometry, image measurement and viewing; next

meeting in Philadelphia, USA, Sept. 4-6, 2014, hosted by theIS&T NIP/Digital Fabrication Conference.

— WG 5, Physical properties and image permanence of photo-graphic materials; next meeting in Philadelphia, USA, Sept.4-6, 2014, hosted by the IS&T NIP/Digital FabricationConference.

— WG 18, Electronic still picture imaging; next meeting in SanDiego, CA, June 24-27, 2014, hosted by Qualcomm Inc.,then Sept. 22-24, 2014, in Cologne, Germany, hosted byImage Engineering GmbH & Co. KG.

Working Groups with current projects, joint with other ISOand IEC committees:— WG 8, Joint with TC 6, Photographic film and paper products

– Dimensions; next meeting in Philadelphia, USA, Sept. 4-6,2014, hosted by the IS&TNIP/Digital Fabrication Conference.

— JWG 20, Joint with IEC, Digital Still Cameras; next meetingin San Diego, CA, June 24-27, 2014, hosted by QualcommInc., then Sept. 22-24, 2014, in Cologne, Germany, hosted byImage Engineering GmbH & Co. KG.

— JWG 23, Joint with TC 130 and CIE, Extended colour encod-ings for digital image storage, manipulation and interchange;next meeting in San Diego, CA, June 24-27, 2014, hosted byQualcomm Inc., then Sept. 22-24, 2014, in Cologne,Germany, hosted by Image Engineering GmbH & Co. KG.

— WG 25, TC 42/WG 18 joint with TC 130, Use of XMP for

digital photography; next meeting in San Diego, CA, June 24-27, 2014, hosted by Qualcomm Inc., then Sept. 22-24, 2014,in Cologne, Germany, hosted by Image Engineering GmbH& Co. KG.

— JWG 26, Joint with TC 46/SC 11 and TC 171, Imaging systemcapability qualification for archival recording and approval;next meeting in June 2015, Tokyo, Japan, with ISO/TC 42.

News from current ISO/TC 42 ProjectsRecent progress in standards development is reported for the fol-lowing projects and action items:• ISO 18935:2005, Imaging materials – Colour images on paper

prints – Determination of indoor water resistance of printedcolour images, was confirmed by SR in June of last year. WG5/TG 3 is undertaking a revision to incorporate an edge pen-etration test, with other updates.

• ISO 18940-1, Specification for Indoor Stability of ReflectionColour Prints (Part 1: Consumer Home), is currently in PWIstage. PWD 2 has been circulated and efforts at the ISO/TC42/WG5 May 2014 London meeting will be focused on reach-ing fundamental agreement so that an NP ballot can be pre-pared. TheUS has proposed a round robin to evaluate choice oftarget, stress level to use (fixed load approach), and other as-pects not previously tested. Japan has proposed a three-level re-porting structure, with the first version of ISO 18940-1 to ad-dress Level 1, defining test methods, test conditions, and toallow reporting fundamental test results in graph form. Levels 2and 3 would then provide endpoint criteria, and translation toa rating system, respectively. The aforementioned fixed load ap-proach, an approach to testing that involves fixed exposures andreporting the degradation amount (rather than testing to anendpoint), is not supported by a large segment of the industry.On the other hand, determination of endpoint criteria suitablefor each use case has been a longstanding challenge.

• ISO 18930:2011, Imaging materials – Pictorial colour reflec-tion prints – Methods for evaluating image stability underoutdoor conditions, contains a four segment testing cycle in-tended to simulate the degrading effects of daylight, night,rain, and condensation. A new Technical Report in supportof this standard is planned from ISO/TC 42/WG5, to includepublication of the round-robin test results used to validatethe standard. The round-robin was conducted at nine world-wide outdoor locations, and included investigation of lab-to-lab and replicate reproducibility. A presentation of the Tech-nical Report material is planned for the IS&T 2014NIP/Digital Fabrication Conference.

• The NP ballots for ISO/NP 18948-1, Imaging materials —

The Standards Roundup: Imaging and Graphic Artsby Ann L. McCarthy, IS&T Standards Coordinator

Page 7: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

7Society for Imaging Science and Technology

Vol. 29 No. 2 April – June 2014www.imaging.org

Update on International Standards for Printed Electronics: IEC TC 119The IEC TC 119 Plenary meeting was held in Cambridge, UK,17th – 19th March 2014. It was followed by a one day meeting,on the 20th, on the topic of “Manufacturing for Printed Elec-tronics” which many of the delegates attended. This event wasco-sponsored by the IS&T.

Highlights from the Plenary meeting• Working Group 1 (Terminology) now has 18 members.

During the meeting, WG1 worked on the terminology thatwill become vocabulary standard IEC 62905. This impor-tant standard will collect and define the terms that are usedto communicate Printed Electronics concepts in TC 119documents.

• Working Group 2 (Materials) is the largest group withinTC 119 with 34 members. This working group is currentlydeveloping documents covering conductive inks and sub-strates for printed electronics, as part of a group of stan-

dards that will become IEC 62899. Additional topics areunder consideration that may well become official workitems in the near future.

• Working Group 3 (Equipment) has 24 members and is de-veloping documents to cover both impact and non-impactfabrication. The documents that will become the IEC62903 series of standards look at the dimensions of boththe features and the printing plates themselves. There isalso work underway documenting the evaluation of inkjethead jetting speed that will become IEC 62904.

• Working Group 4 (Printability) has 23members and is work-ing on the interesting and complex area of the measurementof patternwidth. This is an areawhere knowledge gained fromprinting standards and microdensitometry may prove useful.There are currently two ballots open for voting in National

Committees that are expected to lead to the formation of aQuality Assurance Working Group in the near future.

Photo books – Requirements for long-term permanence –Part1, and ISO/NP 18948-2, Imaging materials – Photo books –Requirements for long-term permanence – Part 2, have beenapproved with both projects being registered with WD docu-ments. These projects will be developed in ISO/TC 42/WG5and the Project Leader is Stuart Gordon (USA).

• TheNP ballot for ISO/NP 19567, Photography –Digital cameras– Low contrast fine detail measurements, has been approved.This project will be developed in ISO/TC 42/WG 18 with Co-Project Leaders D. Wueller (Germany) and S. Sakaue (Japan).The challenge in preserving fine image detail through digitalcamera image capture and imageprocessinghas increased as im-age sensor pixel area has decreased.While the decrease in signalto noise ratio has been compensated by noise reduction process-ing after image capture, low contrast fine detail in images can beconfounded with noise in such processing. This standard willspecify the measurement of digital camera reproduction (cap-ture and preservation) of low contrast fine detail, thereby pro-viding an assessment tool useful in comparing various systemsignal-to-noise and noise reduction processing outcomes.

IS&T IT2 Changing LeadershipWithin the US ISO/TC 42 community, Image Technology Com-mittee 2 (IT2) carries responsibility for traditional photographystandards. Philip Wychorski, Orion Standards LLC, has led thecommittee for a number of years. IS&T expresses deep apprecia-tion for the technical leadership and thoughtful standardsprocess oversight Wychorski has provided throughout histenure. In early 2014, Wychorski elected to resign his Chair posi-tion in IT2. As a result, on March 26, 2014, the IS&T SMB ap-pointed Jack Holm, formerly the Vice-Chair, as Chair of IT2.

Graphic Arts Standards News

Graphic Arts Standards News covers US national and interna-tional standards applicable to ISO Technical Committee 130(GraphicTechnology),whichdevelops international standards

for the graphic arts industry. This standards news is brought to youin collaboration with NPES, The Association for Suppliers of Print-ing, Publishing and Converting Technologies. NPES serves as theSecretariat for the US TAG to ISO TC 130 (Graphic Technology).The Secretariat for ISO/TC 130 is held byChina. The 29thmeeting ofISO/TC 130 will take place Nov. 14-20, 2014 in Beijing, China.

ISO/TC 130: Working GroupsTC 130 is organized into working groups with convener andassistant convener responsibilities assigned to national bodies.The US serves as the convener of four working groups. In each ofthese areas, experts are welcome to contribute through their cor-responding national committees. For details pertaining to TC130 Working Groups, please contact the ISO/TC 130 US TAGSecretariat at www.npes.org/programs/standardsworkroom/tc130theustag.aspx. Outside of the US, contact the TC 130 Secre-tariat through your national standards organization.

Joint CGATS/USTAG/IDEAlliance PPC ActivitiesWithin the US, positions and contributions for IS0/TC 130 arecoordinated through joint meetings of CGATS (Committee forGraphic Arts Technology Standards), the ISO/TC 130/US TAG,and the Print Properties & Colorimetrics (PPC) Committee, aworking group of the IDEAlliance.

CGATS received ANSI accreditation in 1989 and provides adirect linkage between the graphic arts industry in the U.S. andANSI standardization of specifications to support progress that in-

Page 8: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

IS&T Reporter8

www.imaging.orgVol. 29 No. 2 April – June 2014

dustry. CGATS topics cover the range of the graphic arts industry,including plates, digital data exchange, process control, and inkand color characterization for packaging. NPES (The Associationfor Suppliers of Printing, Publishing and Converting Technolo-gies) provides support and administration services for CGATS.

The ISO/TC 130/US TAG provides US contributions,through ANSI, for the development of ISO/TC 130 internationalstandards. The overlapping membership and close collaborationbetween ISO/TC 130/US TAG and CGATS enables careful coor-dination of US and international standards.

Participation in CGATS committees and in the ISO/TC130/US TAG is open to anyone having an interest. Membershipinformation is available at http://www.npes.org/programs/standardsworkroom/standardsupdate.aspx.

The Print Properties & Colorimetrics (PPC) Committee isresponsible for gathering information from industry and forevaluation of technologies and workflows for printing, proofing.This committee oversees proofing and digital press certificationprograms and the ongoing development of the G7 Specification.Its parent organization, IDEAlliance, is a global not-for-profitmembership organization that has worked to enhance the effi-ciency and operability of the end-to-end digital media supplychain since 1966. More information is available at www.idealliance.org/groups/committees/print-properties-and-colorimetrics-committee.

The next joint CGATS/USTAG/IDEAlliance PPCmeeting isin Rochester, NY, USA, Oct. 13th - 15th, 2014.

News from current ISO/TC 130 ProjectsFor your information the following ISO standard has been publishedrecently and is available for purchase from ISO, ANSI and other na-tional bodies. This standard can also be purchased from NPES.• ISO 15397:2014 (Ed. 1), Graphic technology – Communica-

tion of graphic paper properties, published 03 Feb 2014. Thisstandardization project was led by Luc M. Lanat (France).ISO 15397 seeks to improve communication between thegraphic papermaking and printing industries in support ofquality printing. To accomplish this, the standard defines thepaper properties, including several color properties, to becommunicated by paper manufacturers (by reference to theoriginal standard) for use with the relevant printing tech-nologies and workflows. ISO 15397 relies on paper standard-ization work from ISO/TC 6 (Paper, board, and pulps) andprescribes the applicability of those standards to rotogravure,cold-set web offset, heat-set web offset, sheet-fed offset, andflexographic printing processes, and to proofing substrates.

Recent progress in standards development is reported for thefollowing projects and action items:• The DIS ballot for ISO/DIS 12646 (Ed 3), Graphic technology

– Displays for colour proofing – Characteristics,was approvedwith no negative votes and a range of editorial comments.The project editor is preparing the resolution of comments.

• A proposed standard, ISO 16612-3, Use of PDF/X-4 for con-tent substitution, was discussed at the March 2014 meetingof ISO/TC 130/WG 2/TF 3. A group has worked to developthis proposal for live variable data printing in which thecomposition occurs during the printing process. Require-ments for merging and rendering at high speed will be in-cluded, and consideration is being given to including securi-ty printing concerns in an informative annex.

• From ISO/TC 130/WG 3, N 1558 Guidance on ConvertingCIELAB Tolerances for Graphic Reproduction, is providedfor information, authored by Danny Rich (USA), with col-laboration amongmembers of ISO/TC 130 and CIE Division1 Light and Color. This work is in response to an action itemto provide guidance for converting tolerances in CIELAB1976 to CIEDE2000.“The use of the CIELAB 1976 uniform colour spacefor setting and reporting product colour tolerances isbeing deprecated. Newer tolerance metrics, such ISOFDIS 11664-6, Colorimetry – Part 6: CIEDE2000Colour-difference formula, are based on more recentvisual observations of small and moderate size colourdifferences, the type of differences encountered in in-dustrially important coloured products.”

In summary, a CIEDE2000 tolerance should be about 0.67of the CIELAB tolerance in order to capture a similar visu-ally acceptable volume of colour space.

• ISO/TC 130/JWG 14, a joint project with ISO/IEC JTC 1/SC28 concerning Print Quality Measurement Methods, is de-veloping a series of standards, initially Technical Specifica-tions, to define measurement methods for visual image qual-ity attributes of printed matter. Three categories of attributeshave been assigned as: a) color, tone, and surface finish, b)uniformity, and c) detail rendition. Inclusion of ISO/TC 42,particularly WG 5 image permanence, is being consideredwith Jürgen Jung (Belgium), convenor of ISO/TC 42/WG 5.Phil Green (UK) is developing a recommendation pertainingto computing and analyzing color gamut based on work inCIE TC1-53. A range of topics are in discussion pursuant tothe goal of a comprehensive print quality assessmentstandard.

• ISO/TC 130/WG 3 has initiated a study group to investigateincorporating spot color requirements into TC 130 stan-dards (including in the areas of WG 3/TF 3, WG 13, WG 4,and WG 2). ISO 5, ISO 12646, ISO 13655, ISO 14861 andISO 15076 are among those identified to be affected in addi-tion to the standards dealing directly with printing processcontrol. Note that ISO 13655, Graphic technology – Spectralmeasurement and colorimetric computation for graphic artsimages, is currently under revision to incorporate additionpackage printing requirements.

• In ISO/TC 130/WG 13 (Printing Conformity AssessmentRequirements), the WD of 16761-1, Graphic Technology –Printing workflows Definition, Requirements and testing con-

Page 9: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

9Society for Imaging Science and Technology

Vol. 29 No. 2 April – June 2014www.imaging.org

ditions – Commercial printing, has been circulated and theWG plans to initiate the NWI and CD ballot in May 2014.This standard will address all commercial printing processeswith and without spot colors that do not blend with processinks. The introduction clause of the standard provides a use-ful visual of a reference universal printing workflow.

American National Standards NewsThe US government is one of the largest users of standards with-in the US and as in other countries government participation inand support of standards development activities are of the ut-most importance. Early in 2014, a Federal Register Notice was is-sued by the US Office of Management and Budget (OMB) de-scribing and requesting comments on Proposed Revisions toOMB Circular No. A-119 which addresses a number of topics as-sociated with standards and conformance, including: standardsdevelopment organization (SDO) processes, intellectual proper-ty, and conformity assessment.

For SDOs, the proposed revisions introduce a new categoryof US Standards called Voluntary Non-Consensus Standards(VNCSs). While continuing preference for voluntary consensusstandards (VCSs) over government-unique standards (GUs), theproposed revisions state that VNCSs may be used in certain cir-cumstances. The proposed revisions further impact SDOprocesses, defining openness to mean that interested parties areprovided “meaningful opportunities to participate at all stages ofstandards development,” changing the definition of “due

process” to include “full access to the views and objections of oth-er participants,” and adding “may be defined” in the definition ofconsensus.

ANSI staff has drafted a contribution to the OMB based onthe input it received from ANSI members with support for the“multiple-path approach” to standardization, e.g., American Na-tional Standards developed by an ANSI-accredited SDO, volun-tary consensus standards developed by an SDO or consortium,and voluntary non-consensus standards developed by a consor-tium. In addition, the ANSI contribution seeks clarification on anumber of specific and rather fundamental points raised by theProposed Revisions. We can anticipate that as the OMB respondsto ANSI and other contributions and then finalizes the Revision,the ANSI Essential Requirements will be revised. ANSI news onthis topic is available at: www.ansi.org/news_publications/news_story.aspx?menuid=7&articleid=3944.

For questions about the activities of TC 42, for suggestions for (or input to)future updates, or standards questions in general, please contact the IS&TStandards Coordinator at [email protected].

IS&T REPORTERExecutive Editor: Peter Burns

Managing Editor: Donna SmithTechnical Editor: Ann McCarthy

The IS&T Reporter is published quarterly by the Society for Imaging Sci-ence and Technology (IS&T). Articles and letters to the editor do not nec-essarily constitute endorsement or reflect the opinions of the editors orIS&T. Advertising and copy are subject to acceptance by the editor.

IS&T is an international organization dedicated to keeping constituentsaware of the latest scientific and technological developments in the broadfield of imaging through conferences, journals, and other activities.

IS&T focuses on all aspects of imaging, with particular emphasis on dig-ital printing, electronic imaging, image perception, photo fulfillment,color imaging, image preservation, digital fabrication, and the physicsand chemistry of imaging processes. For more information, visit imag-ing.org. IS&T publishes the Journal of Imaging Science & Technologyand Journal of Electronic Imaging (with SPIE).

Please send inquiries to: [email protected]©2014 Society for

Imaging Science and Technology.All rights reserved.

ISSN 2327-4395 printISSN 2327-4409 online

IS&T Honors and Awards celebrate the

achievements and service of members of the imaging

community. We encourage you to nominate col-

leagues for these prestigeous tributes. To do so, visit

www.imaging.org/ ist/ Membership/ honors.cfm.Announcing 2015 UN International Year of Light

A resolution declaring 2015 the International Year of Lightwas passed in the United Nations General Assembly in De-cember 2013. The resolution was energized by the realizationamong scientists and technologists working in the fields of pho-tonics and light sciences that while their work underlies somuch of the fundamental technology of the 21st century,layperson understanding and appreciation of these endeavorshas not permeated world cultures. The UN resolution was co-sponsored by 35 countries and will inspire educational, phil-anthropic, and social activities through a number of local, na-tional and international industry and standards organizationsaround the world. The International Year of Light will celebratethe science of light, light-based technologies, light in nature,and the influence of light on human cultures.

The European Physical Society (www.eps.org/?page=event_iyol) and The Optical Society (www.osa.org/en-us/about_osa/international_year_of_light/) have postedinformation for 2015 IYL activities. The CIE Board of Admin-istration supports this endeavor and invites CIE members totake part and contribute to this challenge, working withintheir national committees.

Page 10: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

IS&T Reporter10

www.imaging.orgVol. 29 No. 2 April – June 2014

papers continued from page 1

Image Quality and Systems PerformanceA computational texture masking model for natural images based onadjacent visual channel inhibitionYucheng Liu and Jan P. Allebach, Purdue University (USA)

Abstract: Masking is a perceptual effect in which contents of theimage reduce the ability of the observer to see the target signalshidden in the image. Characterization of masking effects plays animportant role in modern image quality assessment (IQA) algo-rithms. In this work, we attribute the reduced sensitivity to the in-hibition imposed by adjacent visual channels. In our model, eachvisual channel is excited by the contrast difference between thereference and distorted image in the corresponding channel andsuppressed by the activities of the mask in adjacent channels. Themodel parameters are fitted to the results of a psychophysical ex-periment conducted with a set of different natural texture masks.Cross-validation is performed to demonstrate the model's per-formance in predicting the target detection threshold. The resultsof this work could be applied to improve the performance of cur-rent HVS-based IQA algorithms.

Image Sensors and Imaging Systems 2014Pixel structure with 10 nsec fully charge transfer time for the 20M frameper second burst CMOS image sensorK. Miyauchi,1 T. Takeda,1 K. Hanzawa,1 Y. Tochigi,1 S. Sakai,1

R. Kuroda,1 H. Tominaga,2 R. Hirose,2 K. Takubo,2 Y. Kondo,2 and S.Sugawa1; 1Tohoku University and 2SHIMADZU Corporation (Japan)

Abstract: In this paper, we demonstrate the technologies relatedto the pixel structure achieving the fully charge transfer time ofless than 10 nsec for the 20M frame per second burst CMOS im-age sensor. In this image sensor, the size of the photodiode (PD)is 30.0 µmH x 21.3 µmV in the 32.0 µmH x 32.0 µmV pixel. In thepixel, the floating diffusion (FD) and the transfer-gate-electrode(TG) are placed at the bottom center of the PD. The n-layer forthe PD consists of the semicircular regions centered on the FDand the sector-shaped portions extending from the edges of thesemicircular regions. To generate an electric field greater thanthe average of 400 V/cm toward the FD direction in the entire PDregion, the n-layer width of the sector-shaped portions becomesnarrower from the proximal-end to the distal-end. By using thePD structure, which includes the above mentioned n-layer shapeand the PD dopant profile with the condition of three timesn-type dopant implantation, we achieved to collect 96 % of thecharges generated in the PD at the FD within 10 nsec. An ultra-high speed CMOS image sensor with the abovementioned pixelstructure has been fabricated. Through the experiments, we con-firmed three key characteristics as follows; the image lag was be-low the measurement limit, the electron transit time in the PDwas less than 10 nsec, and the entire PD region had equivalentsensitivity.

BEST PAPER AWARDSDigital Photography XThe color of water: Using underwater photography to estimate water qualityJohn Breneman IV, Henryk Blasinski, and Joyce Farrell, Stanford University(USA)

Abstract: We describe a model for underwater illumination thatis based on how light is absorbed and scattered by water, phyto-plankton and other organic and inorganic matter in the water. Totest the model, we built a color rig using a commercial point-and-shoot camera in an underwater housing and a calibrated colortarget. We used the measured spectral reflectance of the calibra-tion color target and the measured spectral sensitivity of the cam-era to estimate the spectral power of the illuminant at the surfaceof the water. We then used this information, along with spectralbasis functions describing light absorbance by water, phyto-plankton, non-algal particles (NAP) and colored dissolved or-ganic matter (CDOM), to estimate the spectral power of the illu-minant and the amount of scattered light at each depth. Ourresults lead to insights about color correction, as well as the lim-itations of consumer digital cameras for monitoring water quality.

Image Processing: Machine Vision Applications VIIDepth and all-in-focus images obtained by multi-line-scan light-fieldapproachSvorad Stolc,1,2 Reinhold Huber-Mörk,1 Branislav Holländer,1 and DanielSoukup1; 1AIT Austrian Institute of Technology GmbH (Austria) and2Institute of Measurement Science, Slovak Academy of Sciences (Slovakia)

Abstract:We present a light-field multi-line-scan image acquisi-tion and processing system intended for the 2.5/3-D inspectionof fine surface structures, such as small parts, security print, etc.in an industrial environment. The system consists of an area-scancamera, that allows for a small number of sensor lines to be ex-tracted at high frame rates, and a mechanism for transporting theinspected object at a constant speed. During the acquisition,theobject is moved orthogonally to the camera’s optical axis as wellas the orientation of the sensor lines. In each time step, a prede-fined subset of lines is read out from the sensor and stored. Af-terward, by collecting all corresponding lines acquired over time,a 3-D light field is generated, which consists of multiple views ofthe object observed from different viewing angles while trans-ported w.r.t. the acquisition device. This structure allows for theconstruction of so-called epipolar plane images (EPIs) and sub-sequent EPI-based analysis in order to achieve twomain goals: (i)the reliable estimation of a dense depth model and (ii) the con-struction of an all-in-focus intensity image. Beside specifics ofour hardware setup, we also provide a detailed description of al-gorithmic solutions for the mentioned tasks. Two alternativemethods for EPI-based analysis are compared based on artificialand real-world data.

Page 11: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

11Society for Imaging Science and Technology

Vol. 29 No. 2 April – June 2014www.imaging.org

Image Sensors and Imaging Systems 2014Smart imaging for power-efficient extraction of Viola-Jones localdescriptorsJ. Fernández-Berni,1 R. Carmona-Galán,1 R. del Río,1 Juan A. Leñero-Bardallo,1 M. Suárez-Cambre,2 and A. Rodríguez-Vázquez1; 1Universidadde Sevilla and 2University of Santiago de Compostela (Spain)

Abstract: In computer vision, local descriptors permit to sum-marize relevant visual cues through feature vectors. These vectorsconstitute inputs for trained classifiers which in turn enable dier-ent high-level vision tasks. While local descriptors certainly alle-viate the computation load of subsequent processing stages bypreventing them from handling raw images, they still have to dealwith individual pixels. Feature vector extraction can thus becomea major limitation for conventional embedded vision hardware.In this paper, we present a power-efficient sensing processing ar-ray conceived to provide the computation of integral images atdifferent scales. These images are intermediate representationsthat speed up feature extraction. In particular, the mixed-signalarray operation is tailored for extraction of Haar-like features.These features feed the cascade of classifiers at the core of theViola-Jones framework. The processing lattice has been designedfor the standard UMC 0.18µm 1P6M CMOS process. In additionto integral image computation, the array can be reprogrammedto deliver other early vision tasks: concurrent rectangular areasum, block-wise HDR imaging, Gaussian pyramids and imagepre-warping for subsequent reduced kernel filtering.

Visualization and Data Analysis 2014 (multiple awards)Visual abstraction of complex motion patternsHalldór Janetzko, Dominik Jäckle, Oliver Deussen, and Daniel A. Keim,University of Konstanz (Germany)

Abstract: Today’s tracking devices allow high spatial and tempo-ral resolutions and due to their decreasing size also an ever in-creasing number of application scenarios. However, understand-ing motion over time is quite difficult as soon as the resultingtrajectories are getting complex. Simply plotting the data may ob-scure important patterns since trajectories over long time periodsoften include many revisits of the same place which creates a highdegree of over-plotting. Furthermore, important details are oftenhidden due to a combination of large-scale transitions with localand small-scale movement patterns. We present a visualizationand abstraction technique for such complex motion data. By an-alyzing the motion patterns and displaying them with visual ab-straction techniques a synergy of aggregation and simplificationis reached. The capabilities of the method are shown in real-world applications for tracked animals and discussed with ex-perts from biology. Our proposed abstraction techniques reducevisual clutter and help analysts to understand the movement pat-terns that are hidden in raw spatiotemporal data.

Relating interesting quantitative time series patterns with text events andtext featuresFranz Wanner, Tobias Schreck, Wolfgang Jentner, Lyubka Sharalieva,and Daniel A. Keim, University of Konstanz (Germany)

Abstract: In many application areas, the key to successful dataanalysis is the integrated analysis of heterogeneous data. One ex-ample is the financial domain, where time-dependent and highlyfrequent quantitative data (e.g., trading volume and price infor-mation) and textual data (e.g., economic and political news re-ports) need to be considered jointly. Data analysis tools need tosupport an integrated analysis, which allows studying the rela-tionships between textual news documents and quantitativeproperties of the stock market price series. In this paper, we de-scribe a work ow and tool that allows a exible formation of hy-potheses about text features and their combinations, which re ectquantitative phenomena observed in stock data. To support suchan analysis, we combine the analysis steps of frequent quantita-tive and text-oriented data using an existing a-priori method.First, based on heuristics we extract interesting intervals and pat-terns in large time series data. The visual analysis supports theanalyst in exploring parameter combinations and their results.The identified time series patterns are then input for the secondanalysis step, in which all identified intervals of interest are ana-lyzed for frequent patterns co-occurring with financial news. Ana-priori method supports the discovery of such sequential tem-poral patterns. Then, various text features like the degree of sen-tence nesting, noun phrase complexity, the vocabulary richness,etc. are extracted from the news to obtain meta patterns. Metap-atterns are defined by a specifi combination of text featureswhich significantly differ from the text features of the remainingnews data. Our approach combines a portfolio of visualizationand analysis techniques, including time-, cluster- and sequencevisualization and analysis functionality. We provide two casestudies, showing the effectiveness of our combined quantitativeand textual analysis work ow. The work flow can also be general-ized to other application domains such as data analysis of smartgrids, cyber physical systems or the security of critical infrastruc-ture, where the data consists of a combination of quantitative andtextual time series data.

Visualization of off-screen data on tablets using context-providing bargraphs and scatter plotsPeter S. Games and Alark Joshi, Boise State University (USA)

Abstract: Visualizing data on tablets is challenging due to therelatively small screen size and limited user interaction capabili-ties. Standard data visualization apps provide support for pinch-and-zoom and scrolling operations, but do not provide contextfor data that is off-screen. When exploring data on tablets, theuser must be able to focus on a region of interest and quickly findinteresting patterns in the data. We present visualization tech-

Page 12: IS&T Reporter Volume 29, Number 2 - imaging.org · IS&T/SPIE held the 26th annual Electronic Imaging (EI) Symposium, February2-6,2014,forthefirsttimein theheartofSanFrancisco.Thesymposium

niques that facilitate seamless interaction with the region of in-terest on a tablet using context-providing bar graphs and scatterplots. Through aggregation, fisheye-style, and overview+detailrepresentations, we provide context to the users as they explore aregion of interest. We evaluated the ecacy of our techniques withthe standard, interactive bar graph and scatter plot applicationson a tablet, and found that one of our bargraph visualizations -Fisheye-style Focus+Context visualization (BG2) resulted in thefewest errors, least frustration and took the least amount of time.Similarly, one of our scatter plot visualizations - User DrivenOverview+Detail (SP3) -resulted in the fewest errors, least frus-tration and took the least amount of time. Overall, users pre-ferred the context-providing techniques over traditional bargraphs and scatter plots, that include pinch-and-zoom and fling-based scrolling capabilities.

User-driven sampling strategies in image exploitationNeal Harvey and Reid Porter, Los Alamos National Laboratory (USA)

Abstract: Visual analytics and interactive machine learning bothtry to leverage the complementary strengths of humans and ma-chines to solve complex data exploitation tasks. These fields over-lap most significantly when training is involved: the visualizationor machine learning tool improves over time by exploiting ob-servations of the human-computer interaction. This paper focus-es on one aspect of the human-computer interaction that we calluser-driven sampling strategies. Unlike relevance feedback andactive learning sampling strategies, where the computer selectswhich data to label at each iteration, we investigate situationswhere the user selects which data is to be labeled at each iteration.User-driven sampling strategies can emerge in many visual ana-lytics applications but they have not been fully developed in ma-chine learning. User-driven sampling strategies suggest new the-oretical and practical research questions for both visualizationscience and machine learning. In this paper we identify andquantify the potential benefits of these strategies in a practicalimage analysis application. We find user-driven sampling strate-gies can sometimes provide significant performance gains bysteering tools towards local minima that have lower error thantools trained with all of the data. In preliminary experiments wefind these performance gains are particularly pronounced whenthe user is experienced with the tool and application domain.

Configurable IP-space maps for large-scale, multi-source network datavisual analysis and correlationScott Miserendino, Corey Maynard, and William Freeman, NorthropGrumman Corporation (USA)

Abstract: The need to scale visualization of cyber (IP-space) datasets and analytic results as well as to support a variety of datasources and missions have proved challenging requirements forthe development of a cyber common operating picture. Typicalmethods of visualizing IP-space data require unreliable domainconversions such as IP geolocation, network topology that is dif-ficult to discover, or data sets that can only display one at a time.In this work, we introduce a generalized version of hierarchicalnetwork maps called configurable IP-space maps that can simul-taneously visualize multiple layers of IP-based data at globalscale. IP-space maps allow users to interactively explore the cyberdomain from multiple perspectives. A web-based implementa-tion of the concept is described, highlighting a novel repurposingof existing geospatial mapping tools for the cyber domain. Bene-fits of the configurable IP-space map concept to cyber data setanalysis using spatial statistics are discussed. IP-space map struc-ture is found to have a strong effect on data clustering behavior,hinting at the ability to automatically determine concentrationsof network events within an organizational hierarchy. �

IS&T Reporter12

www.imaging.orgVol. 29 No. 2 April – June 2014

September 7 - 11, 2014; Philadelphia, PennsylvaniaNIP30/Digital Fabrication 2014 General Chair: Branka Lozo

November 3 - 7, 2014; Boston, Massachusetts22nd Color and Imaging Conference (CIC22) and2nd International Congress of the International Academy of DigitalPathology (IADP) General Chairs: Jennifer Gille and YukakuYagi

January 4 - 5, 2015; Las Vegas, NevadaTechnologies for Digital Photo FulfillmentSymposium Chair: Joseph LaBarca

February 8 - 12, 2015; San Francisco, CaliforniaElectronic Imaging 2015 Symposium Chairs: Sheila Hemamiand Choon-Woo Kim

May 2015; Los Angeles, CAArchiving 2015 General Chair: David Walls

UPCOMING IS&T EVENTS

Learn more at www.imaging.org/ist/conferences/.A complete list of imaging-related meetings is atwww.imaging.org/ist/conferences/events.cfm

Abstract Submission Deadline: July 27, 2014

Accepted papers due: November 10

www.imaging.org/ist/conferences/tdpf

International Symposiumon Technologies forDigital Photo Ful�llment

January 4-5, 2015Bally’s Hotel

Las Vegas, Nevada


Recommended