Andrew Carnegie - 1900
“My heart is in the work,” Andrew Carnegie
Multi-disciplinary
basic science
Fielded problems
Hard work / Team work
13,961STUDENTS
57% U.S. Citizens
43% International
68% U.S. Citizens
32% International1,382
FACULTY
131 RESEARCH CENTERS
• National Robotics Engineering Center (NREC)
• Wilton E. Scott Institute for Energy Innovation
• Integrated Innovation Institute
• Center for the Neural Basis of Cognition (CNBC)*
• LearnLab*
* CNBC and LearnLab are joint programs with the University of Pittsburgh
#1 GRADUATE SCHOOL
FOR COMPUTER
SCIENCE (tied)
U.S. News & World Report, 2018
#1 GRADUATE SCHOOL
FOR ARTIFICIAL
INTELLIGENCE
U.S. News & World Report, 2018
#1 INFORMATION
& TECHNOLOGY
MANAGEMENT
U.S. News & World Report, 2017
#2 QUANTITATIVE
ANALYSIS
U.S. News & World Report, 2018
* Figures from Academic Year 2017-18
Carnegie Mellon facts and figures
#1 STARTUPS
PER RESEARCH
DOLLARAssociation of University
Technology Managers, 2008-12
Leaders in Robotics Research
• human interact models
• Shared autonomy
• Expressiveness
• Safety, interaction
Human
• Motion planning
• Action
sequencing
• Decision making
Autonomy
Learning
• Data analytics
• Perception
• Robot Learning
• Scene understanding
• 3D reconstruction
AR/VR
• People analysis
• Sensing
Perception
• Robot design
• Control
• Motion Planning
• Estimation / Filtering
Action
• Bridges, tunnels
• Buildings
• Power grid
• Roads
Infrastructure
• Nuclear
• Agriculture
• Defense
• Search & rescue
Field Robotics
• Automotive
• Aerospace
• Electronics
• Distribution Centers
Manufacturing
• Smart street lights
• Smart head lights
• Emergency
• Self-driving cars
Transportation
• Minimally invasive surgery
• Data analytics
• Low-cost imaging
• Assistive tools
Medicine
• Brain-machine
• Prostheses
• Biomechanics
• Elderly assistance
Assistive
• Reverse illumination
• Vision and graphics
combination
Graphics
AppliedBasic
Robotics Institute Leadership
#1 GRADUATE SCHOOL
FOR COMPUTER
SCIENCE (tied)
U.S. News & World Report, 2018
#1 STARTUPS
PER RESEARCH
DOLLARAssociation of University
Technology Managers, 2008-12
#1 GRADUATE SCHOOL
FOR ARTIFICIAL
INTELLIGENCE
U.S. News & World Report, 2018
#1 INFORMATION
& TECHNOLOGY
MANAGEMENT
U.S. News & World Report, 2017
#2 QUANTITATIVE
ANALYSIS
U.S. News & World Report, 2018
“Carnegie Mellon is a great example of what it means to move forward," the President said. “….[Carnegie Mellon is] a global research university. ….your professors and your students have created more than 300 companies and 9,000 jobs…” President Obama
CMU RI is why the self driving car industry exists. – Michael Wagner
We have been the world largest and strongest vision group. – Takeo Kanade
Most number of research groups
Highest number of educational
offerings
Most number of fielded systems
Highest Number of Engleberger
Awards
Largest aggregate support from IIS
in last 5 yrs
Highest # of NRIs
(incl NRI large)
Expeditions / ERCs / RCTAs
20% of CMU Revenue
Best papers galore
Over 2500 grad apps
High Research Budget
Bio-inspired design
Predictive Maintenance
Computational Photoscatterography
wall
camera
what depth
our camera
sees
what a regular
camera sees
hidden
object
Understanding people
Interacting with people
Are robots a good?
• 322 BC – Aristotle, a Greek philosopher, wrote “If every tool, when ordered, or even of its own accord, could do the work that befits it... then there would be no need either of apprentices for the master workers or of slaves for the lords.”
ROBOTS?
robot: (noun) …
Insert image here
What is a robot?
There is no widely accepted definition of
what a robot is.
UL 1740: under revision –V3: Automatically controlled, reprogrammable multipurpose machine, programmable in several degrees of freedom, which can be either fixed in placeor mobile – V4 (proposed): ISO 8373:2012 definition
Leaders in Robotics Education
• First PhD program
• Sense-plan-act
• Read / Write skills
• Many leaders
• Many classes
PhD Program
• MS in Robotics
• MS in Computer Vision
• MS in Rob Sys & Dev
Masters
Program
• Additional Major
• Minor
• Masters Degree
• Robotic Club
• Many classes
Undergraduate
• Undergrad summer
• International
• Recruiting tool
• Many successes
RI Summer Scholars
• Founded 2010, All girls
• Give girls the skills that will
last far beyond their high-
school years
• Many programs
Girls of Steel
• Use the motivational effects
of robotics for STEM
• 16,000 schools nationwide
• 1M per day use CMRA
Robotics Academy
PracticalCreative
Robotics MinorRequirements Choose amongOverview/Introductory Course 16-311 Introduction to RoboticsControls 18-370 Fundamentals of Control,
24-451 Feedback Control Systems16-299 Introduction to Feedback Control Systems
Kinematics 16-384 Robot Kinematics and Dynamics24-355 Kinematics and Dynamics of Mechanisms (not offered regularly)
Two electives Long list, see a subset belowAn upper-level RI courseUp to one independent study
· 10-601: Machine Learning· 11-344: Machine Learning in Practice· 15-491: CMRoboBits: · 15-494: Cognitive Robotics · 15-385: Computer Vision· 15-462: Computer Graphics · 15-862: Computational Photography· 16-362 / 16-862: Introduction to Mobile Robot Programming
· 16-421: Vision Sensors· 16-861: Mobile Robot Design · 16-865: Advanced Mobile Robot Development · 18-342: Fundamentals of Embedded Systems *· 18-348: Embedded System Engineering *· 18-349: Embedded Real-Time Systems *· 18-578: Mechatronic Design· 24-491 / 24-492: Departmental Research Honors· 24-673: Special Topics in Soft Robots - Mechanics, Design, and Modeling
24-675: Micro/Nano Robotics · 48-787: Architectural Robotics · 85-370: Perception· 85-382: Consciousness and Cognition· 85-395: Applications of Cognitive Science· 85-412: Cognitive Modeling· 85-419: Introduction to Parallel
Distributed Processing· 85-420: Perception and Perceptual
Development
Requirements (10 classes) Choose among
Overview/Introductory
Course
16-311 Introduction to Robotics
Controls 18-370 Fundamentals of Control,
24-451 Feedback Control Systems
16-299 Introduction to Feedback Control Systems
Kinematics 16-384 Robot Kinematics and Dynamics
24-355 Kinematics and Dynamics of Mechanisms (not offered regularly)
Machine Perception 15-385: Computer Vision
16-421: Vision Sensors
85-370: Perception
Cognition and Reasoning 10-601: Undergraduate Machine Learning
15-381: Artificial Intelligence
15-494: Cognitive Robotics
Upper-level RI planning course with instructor permission
“Hands-on Course” 15-491: CMRobotBits: Creating Intelligent Robots
16-362: Mobile Robot Programming Lab
18-578: Mechatronics
Upper-level RI project course like 16-861 or 16-865
Independent study with instructor permission
Two Electives See list with minor or any upper level RI course. Any of these can be independent study but only
one independent study is allowed. A student can also take additional courses from the core;
e.g., a student who takes 15-385 as a core can take 16-421 as an elective
Systems Engineering 16-450: Systems Engineering
Capstone Course 16-474: Robotics Capstone
The Categories Are…..
Build Program Debug
ActPlanSense
Computer Science
Electrical Engineering
Mechanical Engineering
Topics
Automation without
computersVision Neural Nets Controls
Machine Learning
Path PlanningSensor-based
PlanningMobile base
design
Kinematics –Forward and
Inverse
Non-holonomic Constrains
Insert your own here
Introduction to Robotics
Lots of homework
First HW assignment handed out today
Second HW assignment handed out tomorrow
Work responsibly
Time consuming design experience
If you cannot make a demo, must demo before due date
Lots of work assigned around Carnival times
Another design experience
No superbowl/Stanley Cup/etc excuses
Programming
Exams
Start Early Mentality
High Workload
Attendance not mandatory, punctuality is, texting is forbidden
No late HW assignments accepted, your printer or dog eating your HW is not an excuse…
Demos star early; your responsibility to make it work (memory stick, etc)
Absence from a demo receives a zero
If you turn in all your assignments, the lowest lab and homework are dropped, except HW 0, HW 1,
Lab 1, HW 2, Lab 2, Lab 7, and Lab 10, which cannot be dropped.
Exams: 8.5 x 11 sheet of paper, both sides, in your hand
Cannot take this class if it overlaps with another
Miscommunications must be cleared up before demo day
Three strikes on mess
•Strike 1: you lose your ability to drop the lowest HW score
•Strike 2: your team gets 0’s
•Strike 3: you are out of the class
Some Strict Rules
Robotics Education Laboratory (REL) – NSH 3206
• This is a shared space• Check the calendar outside the REL. Cognitive Robotics uses this room on
Fridays from 3:00-4:20 and some Mondays and Wednesdays. We cannot go in the REL when their class is in session.
• Do not use the cognitive robotics computers or desk space.
• Respect the materials• Food left in the REL will result in a strike.
• LEGO components modified or broken will result in a strike.
• 25+ more LEGO components or trash on the floor or damage to Cognitive Robotics materials will result in 1 strike for every student in the class.
• You will get ID card access to the REL and the hallway outside the REL later this week.
Tuesdays
• Tuesdays are a must
Meet the TAs