Speech Recognition Robot

transcript

Lab BookBeti Lula John

Problem and Mission

Civilization’s Great Steps Forward:1) Fire2) The Wheel3) The Printing Press4) The Steam Engine5) The Transistor6) Google7) ???

www.build-it-yourself.com

Problem and Mission

Robots Will Rule!!!

However to make this next great leap forward, we need to make the interface between humans and machines more natural.

Project Plan

Goal:Design, build and present a speech recognition robot that is worthy of media attention.

1) It must work.2) It must be engaging.

Deliverables:1) Power Point Lab book2) Working robot3) Presentation

Project Plan

Tasks:1) Research2) Identify problem3) Specify solution functionality4) Build5) Test and modify6) Manage and document7) Market and present

Teamwork

Assign specific tasks to focused specialists:

Marketing Engineering Programming-Market Demand - Technologies - Technologies- Competition - Inputs / Outputs - Inputs / Outputs- Sales Pitch - Specifications - Specifications- Project Mgm’t - Build - Program- Present - Test & Refine - Test & Refine

Performance

Name 1 Name 2 Name 3Attendance 5 3 2Professionalism 5 3 2Teamwork 4 1 1Initiative 3 1 1Results 5 3 2Total 22 11 8

Attendance - Are you present?Professionalism - Are you respectful of your lab and your teammates?Teamwork - Did you help your teammates or participate in discussions? Initiative - Did you do something more than was expected?Results - Did you get a result?

Yes = 1 No = 0

Project Management – 4 Phases

1) Discovery Research applications Research technology

2) Design Specify a talking robot

3) Development Build a talking robot

4) Deployment Document project Present project

Speech Recognition Applications

Document useful applications of speech recognition robots.

1) Aviation2) Healthcare3) Administration4) Personal computers5) Production6) ???

Robots … What are they good for?

Document what robots do better than humans.

Document what humans do better than robots.

Problem and Mission

Document a problem that could be solved by a speech recognition robot.

Document the mission. (What must our speech recognition robot do to solve the problem?)

Problem Solving Techniques

1) Identify the problem and focus.2) Build on the ideas of others.3) Break the solution into simple parts.4) Work with teammates.5) Document.

Measures of Success

1) Does it work 9 times out of 10?2) Is it unique?3) Will it attract media attention?

Program Primitives

1) Series vs. Parallel2) Iteration3) Conditional4) Variables5) Messaging

Strategies for recognizing speech

What are 3 attributes of speech that can be detected and interpreted?

Program Flow Chart to Detect Syllables

Wait forsyllable

2nd syllabledetected

Display2 syllables

Display1 syllable

Wait forsyllable

Volumelow?

Volumehigh

Program Flow Chart to Detect Syllables

Marketing:1) Develop an elevator pitch for your robot. Research what an elevator pitch is.2) Design a one page advertisement for your robot.3) Design signs that explain how your robot works.4) Build expressive eyes, mouth, arms, and body.5) Write and record the script you want your robot to lead (man - machine interaction)

Engineering:1) Build the structure.2) Build a gear train that drives two shafts.3) Build a mechanism that makes eyes, mouth and arms move.

Programming:1) Write a program to execute the script or man - machine interaction.

Document everything in your lab books.

Robot / Human Script

When visitor is detected, say:Greetings! My name is ...

Welcome to Colegio Las Hayas.

While you are waiting, would you like to ...

Please answer, "Si" or "Huh, Huh" to my question.

If "Si" then say:

If "Huh, Huh" then say:

Structure and components

Engineering:This structure is good for mounting motion modules and sensors at different levels.

The vertical shaft could make arms move left and right.

Robot Structure:Click on ‘Build-It-Blocks’Select ‘Presenting Ideas’Select ‘LEGO Tall Structure

Gear Train:Click on ‘Build-It-Blocks’Select ‘Spin, Rotate, Twirl’Select ‘Power Top Gear Train Mini”

Engineering:The ‘Open ‘n Close’ module can drive many parts to move.

Robot Structure:Click on ‘Build-It-Blocks’Select ‘Shake, Dance, Flap’Select ‘Open ‘n Close’

Engineering:The arms and the mouth move.

Robots Made from Premium Quality Junk

SpeechRecognitionProgram

Programming team:

Robot Promo

Marketing team:

What can you say and show that will makecustomers want to buy your robot?

1) Write and perform a song that your robot will sing.2) Write and design an advertisement.3) Design a Web page or a Facebook page for your robot.

References

Example of project web site http://www.build-it-yourself.com/support/support-workshops/wkshp-archive/wkshp-glts-2002/index.

Introduction to talking robots at Tokyo Universityhttp://www.youtube.com/watch?v=Li4w9DPPNYI&NR=1&feature=fvwp

Demo of MIT Kismet language vs expressionhttp://www.youtube.com/watch?v=dKZczUDGp_I

Demo of how engaging a talking robot can be.http://www.youtube.com/watch?v=HuqL74C6KI8&feature=related

Project Summary

What you should know:• The problem and mission• 3 deliverables• 3 measures of success• 4 project management phases• 3 reasons for modular construction• 5 problem solving techniques• 5 program primitives• Effective use of Power Point, Google, Excel and

collaboration tools

Reference Slides Follow

Presentation Outline

Project Presentation

1) Introduce team members and explain the parts of the project that were most interesting to you.2) State the problem and mission (PPT Lab Book)3) Describe the 4 phases of project planning and who did what. (PPT Lab Book) - Discovery - Design - Development - Deployment4) Present your research (PPT Lab Book)5) Present your robot.6) Grade your work on 5 measures of performance.

Questions

1) Why is modular construction valuable?2) Why is teamwork important?3) What do humans do well and what to robots do well?4) What are 5 computer programming structures?5) Describe how your program works?

Teamwork

The importance of teamwork in solving complex problems.

How many people are on the World of Warcraft team?

How many people to develop an animated feature film?

Teamwork

How many people are on the World of Warcraft team? 60 developers / 400 employees when launched in 2001. 5000 employees in 2009.

How many people to develop an animated feature film? 75 artists using hand made frames. 27 animators made Toy Story using computer tools.

Teamwork

How many people worked for NASA when we landed on the moon?

Teamwork

How many people worked for NASA when we landed on the moon?36,000 NASA employees when man landed on the moon

Can’t read from a distance. Image does not relate to content

Speech Recognition RobotLab BookBetiLula John

Average, boring, not engaging

Direct, engaging

Speech Recognition Robot

Documents