Post on 26-Aug-2014
description
transcript
Ramesh Raskar, MIT Media Lab
After X, what is neXt
How to Invent?
Ramesh Raskar, MIT Media Lab
Raskar, Camera Culture, MIT Media Lab
Camera Culture
Ramesh Raskar
Camera CultureMIT Media Lab http://raskar.info
http://cameraculture.info
Ramesh RaskarAssociate Professor
Ramesh Raskar, MIT Media Lab
Xd
X++
X X+Y
X
X
neXt
Ramesh Raskar, MIT Media Lab
Ramesh Raskar, MIT Media Lab
Simple Exercise .. Simple Exercise .. • Image CompressionImage Compression
– Save Bandwidth and storageSave Bandwidth and storage
What is neXt
Ramesh Raskar, MIT Media Lab
Strategy #1: XStrategy #1: Xdd
• Extend it to next (or some other) dimensionExtend it to next (or some other) dimension
Ramesh Raskar, MIT Media Lab
X = X = • Idea you just heardIdea you just heard• ConceptConcept• PatentPatent• New ProductNew Product• Product featureProduct feature• DesignDesign• ArtArt• AlgorithmAlgorithm
Ramesh Raskar, MIT Media Lab
Strategy #1: XStrategy #1: Xdd
• Extend it to next dimension (or some other) dimensionExtend it to next dimension (or some other) dimension– Flickr to YoutubeFlickr to Youtube
– Wikipedia to .. ?Wikipedia to .. ?
• Generalize the concept Generalize the concept (common in patent applications)(common in patent applications)
• Text, Audio (Speech), Image, Video .. Whats next ?Text, Audio (Speech), Image, Video .. Whats next ?– CD ..CD ..
• Images to infrared, sound, ultrasound to EM spectrumImages to infrared, sound, ultrasound to EM spectrum• Macro scale to microscaleMacro scale to microscale
• Airbag for car to airbag for .. ?Airbag for car to airbag for .. ?
Ramesh Raskar, MIT Media Lab
Strategy #2: X+YStrategy #2: X+Y• Fusion of the dissimilarFusion of the dissimilar
– More dissimilar, more spectacular the outputMore dissimilar, more spectacular the output
• ExampleExample– Scientific imaging + PhotographyScientific imaging + Photography
• Coded apertureCoded aperture• TomographyTomography
Ramesh Raskar, MIT Media Lab
Prototype cameraPrototype camera
4000 4000 × 4000 pixels ÷ 292 × 292 lenses = 14 × 14 pixels per lens× 4000 pixels ÷ 292 × 292 lenses = 14 × 14 pixels per lens
Contax medium format camera Kodak 16-megapixel sensor
Adaptive Optics microlens array 125μ square-sided microlenses
Ramesh Raskar, MIT Media Lab
Example of digital refocusingExample of digital refocusing
Ramesh Raskar, MIT Media Lab
Imaging in Sciences: Imaging in Sciences: Computer TomographyComputer Tomography
• http://info.med.yale.edu/intmed/cardio/imaging/techniques/http://info.med.yale.edu/intmed/cardio/imaging/techniques/ct_imaging/ct_imaging/
Self Evaluation of Eye
Ramesh Raskar, MIT Media Lab
Strategy #3: X Strategy #3: X Do exactly the oppositeDo exactly the opposite
Ramesh Raskar, MIT Media Lab
Strategy #3: X Strategy #3: X Do exactly the oppositeDo exactly the opposite
• Processing, Memory, BandwidthProcessing, Memory, Bandwidth– In Computing world, in any era, one of this is a bottleneckIn Computing world, in any era, one of this is a bottleneck– But overtime, they change. You can often take an older idea and do But overtime, they change. You can often take an older idea and do
exactly the opposite.exactly the opposite.– E.g. bandwidth is now considered virtually limitlessE.g. bandwidth is now considered virtually limitless
• Business Process Reengineering (BPR) Business Process Reengineering (BPR) – Michael Hammer, James Champy, 1990sMichael Hammer, James Champy, 1990s
• In imaging:In imaging:– SLR: Faster mirror flip or no mirror flipSLR: Faster mirror flip or no mirror flip
• Companies spent years improving mirror flip speedCompanies spent years improving mirror flip speed• Why not just remove it?Why not just remove it?
• More computationMore computation• Less lightLess light
Ramesh Raskar, MIT Media Lab
Fosbury FlipFosbury Flip
http://en.wikipedia.org/wiki/File:Bundesarchiv_Bild_183-S0305-0030,_Rolf_Beilschmidt.jpg
http://en.wikipedia.org/wiki/Dick_Fosbury
Straddle Method for High Jump
Fosbury Method
Replacement of landing surfaces with foam rubber
1968 Olympics: 2.24m
Ramesh Raskar, MIT Media Lab
• Toll Free callsToll Free calls• Reverse AuctionReverse Auction
Power ofthe
Processor
Power of
theNetwork
Powerof
People
1985 1995 2005 2015
Powershifts
Frank Moss, MIT Media Lab
Coded Aperture CameraCoded Aperture Camera
The aperture of a 100 mm lens is modified
Rest of the camera is unmodifiedInsert a coded mask with chosen binary pattern
Captured Blurred Photo
Refocused on Person
Coded-Aperture ImagingCoded-Aperture Imaging
• Lens-free imaging!Lens-free imaging!• Pinhole-camera Pinhole-camera
sharpness,sharpness,without massive light without massive light loss.loss.
• No ray bending (OK for No ray bending (OK for X-ray, gamma ray, etc.)X-ray, gamma ray, etc.)
• Two elementsTwo elements– Code Mask: binary Code Mask: binary
(opaque/transparent)(opaque/transparent)– Sensor gridSensor grid
• Mask autocorrelation is Mask autocorrelation is delta function (impulse)delta function (impulse)
• Similar to MotionSensor ?Similar to MotionSensor ?
Less is MoreLess is MoreBlocking Light == More InformationBlocking Light == More Information
Coding in Time Coding in Time Coding in SpaceCoding in Space
Larval Trematode WormLarval Trematode Worm
Xd
X++
X X+Y
X
X
neXt
Ramesh Raskar, MIT Media Lab
Ramesh Raskar, MIT Media Lab
Strategy #4: X Strategy #4: X • Given a Hammer ..Given a Hammer ..
– Find all the nailsFind all the nails– Sometimes even screws and boltsSometimes even screws and bolts
Ramesh Raskar, MIT Media Lab
Strategy #4: X Strategy #4: X • Given a Hammer ..Given a Hammer ..
– Find all the nailsFind all the nails– Sometimes even screws and boltsSometimes even screws and bolts
• Given a cool solution/technique/Opportunity Given a cool solution/technique/Opportunity – Find other problemsFind other problems– (Where to find them?)(Where to find them?)
• ExamplesExamples– Peltier effect: Peltier effect:
• Create a jacket that keeps you warm or coldCreate a jacket that keeps you warm or cold– Mobile phone opportunityMobile phone opportunity
Ramesh Raskar, MIT Media Lab
Strategy #5: X Strategy #5: X • Given a nail, Given a nail,
– Find all hammersFind all hammers– Sometimes even screwdrivers and pliers may Sometimes even screwdrivers and pliers may
workwork• Given a problem, Given a problem,
– Find other solutionsFind other solutions– (Where to find them?)(Where to find them?)
• ExamplesExamples– App store (Apple) .. Open platform for all devicesApp store (Apple) .. Open platform for all devices– ....
Ramesh Raskar, MIT Media Lab
Strategy #5: X Strategy #5: X • Given a problem, find other solutionsGiven a problem, find other solutions
• High Dynamic Range Tone MappingHigh Dynamic Range Tone Mapping– Started with Jack Tumblin’s LCISStarted with Jack Tumblin’s LCIS– Gradient domainGradient domain– Bilateral filterBilateral filter– Filter banks etc .. Filter banks etc .. – About 6 years of heavy machineryAbout 6 years of heavy machinery– Btw, the topic is done to death but continues to enthuseBtw, the topic is done to death but continues to enthuse
Ramesh Raskar, MIT Media Lab
Strategy #6: X++Strategy #6: X++• Pick your adjective ..Pick your adjective ..• Making it faster, better, cheaperMaking it faster, better, cheaper
neXt = adjective + XneXt = adjective + X
Ramesh Raskar, MIT Media Lab
X++ : Add your favorite adjectiveX++ : Add your favorite adjective• Context aware, Context aware, • AdaptiveAdaptive• (temporally) Coherent, (temporally) Coherent, • Hierarchical, Hierarchical, • ProgressiveProgressive• EfficientEfficient• ParallelizedParallelized• DistributedDistributed• Good example: Image or video compression schemesGood example: Image or video compression schemes
• Personalized/CustomizedPersonalized/Customized• DemocratizedDemocratized
Ramesh Raskar, MIT Media Lab
X++ : Add your favorite adjectiveX++ : Add your favorite adjective• Good example: Image or video compression schemesGood example: Image or video compression schemes• But X++ is a signBut X++ is a sign
– The field is maturing in terms of research but booming in business The field is maturing in terms of research but booming in business impactimpact
• KaizenKaizen– Small incremental changesSmall incremental changes– Japanese Management styles (6sigma, Kanban)Japanese Management styles (6sigma, Kanban)– Mainly to save money/time/resources. Not everyone can do it. GM, Mainly to save money/time/resources. Not everyone can do it. GM,
0.84 suggestions per employee vs Toyota 18. GM accepted 23%, 0.84 suggestions per employee vs Toyota 18. GM accepted 23%, Toyota 90%Toyota 90%
Ramesh Raskar, MIT Media Lab
Hexagon Corners for Different StagesHexagon Corners for Different Stages
[Bruce Tuckman, 1965][Bruce Tuckman, 1965]
• FormingForming• StormingStorming• NormingNorming• PerformingPerforming• AdjourningAdjourning
Ramesh Raskar, MIT Media Lab
Other TechniquesOther Techniques• IdeationIdeation
– Including idea mgmnt softwareIncluding idea mgmnt software– Mind-mapping Mind-mapping
• BrainstormingBrainstorming– RandomizationRandomization– Follow-on triggersFollow-on triggers
• Problem SolvingProblem Solving– (Have I done everything)(Have I done everything)
– How to solve it (1945)How to solve it (1945)• Mathematician Mathematician George PólyaGeorge Pólya• Convert to a known problemConvert to a known problem
‘Reducing’ a problem
Analogy
Generalization
Induction
Variation of the Problem
Auxiliary Problem
Pattern Matching (related problem solved before)
Specialization
Decomposing and Recombining
Working backward
Draw a Figure
Auxiliary Elements
Ramesh Raskar, MIT Media Lab
Other TechniquesOther Techniques• Problem SolvingProblem Solving
• TRIZ 40TRIZ 40– Mechanical engineering problems, e.g. how to increase volume w/o extra weightMechanical engineering problems, e.g. how to increase volume w/o extra weight– Overcome constraints by using transform of existing solutionsOvercome constraints by using transform of existing solutions– TRIZ matrix: database of known solutions to overcome constraintsTRIZ matrix: database of known solutions to overcome constraints
• Advanced Systematic Inventive Thinking (ASIT)Advanced Systematic Inventive Thinking (ASIT)– Unification: Multiplication: Division: Breaking Symmetry: Object RemovalUnification: Multiplication: Division: Breaking Symmetry: Object Removal– How to make incremental changes to solve an engineering problemHow to make incremental changes to solve an engineering problem
•
http://www.triz40.com/
Ramesh Raskar, MIT Media Lab
Where to find the ‘X’Where to find the ‘X’• Annual Awards (best product, researchers)Annual Awards (best product, researchers)
• Talks abstract (no need to attend)Talks abstract (no need to attend)• Network and talk to peopleNetwork and talk to people• Avoid small-talk .. Ask ‘what is the latest X’Avoid small-talk .. Ask ‘what is the latest X’
• PatentsPatents• Table of ContentsTable of Contents• Index pagesIndex pages
Ramesh Raskar, MIT Media Lab
PitfallsPitfalls• These six ways are only a start These six ways are only a start • They are a good mental exercise and will They are a good mental exercise and will
allow you to train as a researcherallow you to train as a researcher• Great for projectsGreat for projects• But But
– Maynot produce radically new ideasMaynot produce radically new ideas– Sometimes a danger of being labeled incrementalSometimes a danger of being labeled incremental– Could be into ‘public domain ideas’Could be into ‘public domain ideas’
Ramesh Raskar, MIT Media Lab
What are Bad ideas to pursueWhat are Bad ideas to pursue• X then Y (then Z)X then Y (then Z)
– X+Y is great with true X+Y is great with true fusionfusion, fusion of dissimilar is best, fusion of dissimilar is best– But avoid a ‘But avoid a ‘pipelinepipeline’ systems, where the output of one is ’ systems, where the output of one is
THEN channeled into the input of the next stage, and non THEN channeled into the input of the next stage, and non of the components are novel (idea is easy to scoop)of the components are novel (idea is easy to scoop)
http://www.flickr.com/photos/rsilfver/178134761/
Ramesh Raskar, MIT Media Lab
What are Bad ideas to pursueWhat are Bad ideas to pursue• X then Y (then Z)X then Y (then Z)
– X+Y is great with true fusion, fusion of dissimilar is bestX+Y is great with true fusion, fusion of dissimilar is best– But avoid a ‘pipeline’ systems, where the output of one is But avoid a ‘pipeline’ systems, where the output of one is
THEN channeled into the input of the next stage, and non THEN channeled into the input of the next stage, and non of the components are novel (idea is easy to scoop)of the components are novel (idea is easy to scoop)
• Follow the hype (too much competition) Follow the hype (too much competition) • Do because it can be done Do because it can be done
– (Why do we climb a mountain? because it is there! )(Why do we climb a mountain? because it is there! )– But only the first one gets a credit. But only the first one gets a credit. – May make you strong, and give you a sense of May make you strong, and give you a sense of
achievement but not a research project.achievement but not a research project.
Ramesh Raskar, MIT Media Lab
There is more .. There is more ..
• How to decide if the idea is worth pursuingHow to decide if the idea is worth pursuing– My personal triangle of criteriaMy personal triangle of criteria– Intersection of interests, skills, demandIntersection of interests, skills, demand
– Maybe another talk .. Maybe another talk ..
Ramesh Raskar, MIT Media Lab
AcknowledgementsAcknowledgements
• Members of Camera Culture, MIT groupMembers of Camera Culture, MIT group
• Vitor PamplonaVitor Pamplona• Kari Pulli, NokiaKari Pulli, Nokia• Asmita JoshiAsmita Joshi• Rupesh Nasre, IIScRupesh Nasre, IISc• Mark Bolas, USCMark Bolas, USC• Rajiv Narayan, Broad Institute, MITRajiv Narayan, Broad Institute, MIT• Joost Bonsen, MITJoost Bonsen, MIT
Ramesh Raskar, MIT Media Lab
Xd
X++
X X+Y
X
X
neXt
Ramesh Raskar, MIT Media Lab