Professor: Marek A. Perkowski, Electrical and Computer Engineering.

ROBOT LEARNING, VISION AND PERCEPTION

This class is the same as Intelligent Robotics 2. Just this new title reflects better what is our concentration in the class. We cover also topics not directly related to vision and perception.
We start with easy and very practical methods for early robot vision. We present basic Machine Learning methods used in robotics. Class covers also Neural Nets, Deep Learning and search. Next, more advanced methods of Machine Learning and Robot Vision are covered, that can possibly lead to thesis, for instance advanced topics such as Fast Fourier Transforms and Radon Transforms. All these theories are used in practical robot vision projects. The last part of the class is robot navigation and localization, but this may be not finished this term and will continue to the next term.

Goal of the class.


Students should learn elementary, medium and some advanced topics in robot vision and perception to be used in software, hardware and integration/robotic projects. Students shoul continue learning about robot design and some Machine Learning aspects of robotics. See the syllabus.
Official Syllabus.
This is the second class in robotics but can be taken with no prerequisities in case that the students knows programming. Students should get practical understanding how robot vision and navigation algorithms are used in robot systems. They should also learn fundaments of probabilistic.

Where is this knowledge useful?

Previous students who have done projects found this class useful to find industrial positions in the following areas: embedded systems, robot vision, flexible automation systems with vision, medical image processing, hardware design of image processors, bank image processing, general software design, industrial board-level design, design automation, industrial robotics.

Software.

Software used in class depends on every year projects. This quarter the projects will use Matlab, Python, OpenCV, Visual Basic and C/C++.

Grading.

Grading is based in 85% on project. Project is splitted to three "homeworks". The remaining 15% are based on quizzes, class attendance and presentations. Class attendance is expected and checked. This time I already allocated students to project teams. In most cases they follow the Fall projects.

SLIDES AND INFORMATION FOR CLASS.

  1. PROJECTS RELATED MATERIALS

  2. PROJECTS FINAL.docx
  3. 1. Funny Robot Communicator Monster.docx This is a prototype paper to be implemented in secveral projects of this class and completed. Students have to present this to me and others, so I will be sure that everything is clear and everybody understands the project.
  4. 2. Robot Theatre.docx This is a prototype paper to be implemented in secveral projects of this class and completed. Students have to present this to me and others, so I will be sure that everything is clear and everybody understands the project. Similar to the above paper.
  5. Team 7 Frankenstein Monster.docx Old report that will be enhanced.
  6. Dancing_Hexapod_Final_Report (2).docx For the teams working on Monster and Copernicus.
  7. quantum robots for teenagers.pdf For the teams working on Monster and Copernicus.
  8. theoretical advances AIS.pdf This is a paper for the Team A of Mohammed.
  9. 85.-Leo_Deng-Extended_Abstract.pdf For all teams, example of a paper written by a high school student, good quality.

  10. PROGRAMMING RELATED MATERIALS

  11. GOOD_AI in PROLOG, LISP, JAVA - Luger_0136070477_1.pdf Great source of codes and ideas.
  12. GOOD_Russel=Norvig=Artificial Intelligence A Modern Approach (3rd Edition).pdf Famous textbook, many ideas.

  13. CLASS OVERVIEW

  14. 2017_0002_Overview of vision.ppt No details. What are the problems and ideas in vision.

  15. MATLAB RELATED MATERIALS
  16. This material is auxiliary for students who want to improve their knowledge of Matlab.
  17. writing fast Matlab code tutorial.pdf
  18. 2017_0010_Matlab_tutorial 1.ppt
  19. 2017_0011_Matlab_tutorial 2.ppt
  20. 2017_0012_other files in Matlab.pptx
  21. 2017_0017_Matlab for vision.pptx
  22. external interfaces to Matlab tutorial.pdf
  23. Math review for Matlab users.pdf
  24. Matlab programming_tips.pdf
  25. matlab_programming_tutorial.pdf

  26. MORPHOLOGICAL METHODS
  27. Class material. Some will be skipped, use it only if project related.
  28. 2017_0022_intro binary morphological-dilation_erosion.ppt
  29. 2017_0027_big example.ppt
  30. 2017_0028_hit and miss - thinning - thickening.ppt
  31. 2017_0029_Thinning - advanced.ppt
  32. 2017_0034_morphology mathematics Theory.ppt
  33. 2017_0035_MATLAB MORPHOLOGICAL FILTERING.ppt
  34. 2017_0054_Advanced Morphology.ppt
  35. 2017_0122_grey scale morphological (1).pptx

  36. MACHINE LEARNING
  37. Decision-trees.ppt this is example of one ML method but with discussion of general methods, useful for projects even if you will use only Decision Trees.
  38. Occam Razor vs Vapnik in ML with Kmaps.pptx Here we show how to explain ML concepts using Kmaps.
  39. logic synthesis approach to ML.ppt Here avarious ML ideas are explained and illustrated with simple examples. SOP algorithms. This can be used in advanced projects and MS/PHD theses.
  40. brief survey of ML.ppt Survery of all ML methods, just to give you hints about more advanced software that you may used in projects.
  41. Intro Decomposition.ppt Introduction to Ashenhurst-Curtis Decomposition and similar methods.
  42. Column Multiplicity - Coloring and Decomposition.ppt
  43. AC decomposition-for-ML -advanced.ppt
  44. review of probability.pptx These are mandatory slides about probabillity and its use in several ML methods.
  45. probability exercises.ppt
  46. naive Bayes classifier.ppt
  47. naive Bayes 2.ppt Additional Reading.
  48. basic Probability and Bayes - Criticism.pptx Additional Reading.
  49. QUIZZ theoretical
  50. QUIZZ software

AUXILIARY SLIDES AND INFORMATION.

MORPHOLOGICAL ALGEBRA AND IMAGE PROCESSING

  1. 2015_0003_Introduction_to_Morphological_Operators.ppt The most basic introduction to morphological image processing.
  2. 0002. Mathematics of Binary Morphology. ppt
  3. 0002_A. Binary Morphology and Use in Robotic Path Planning. ppt
  4. 0003.A. Big Example of morpology and measurements on image. ppt

LOW LEVEL IMAGE PROCESSING

  1. 0004. Introduction to edge detection feature extraction. ppt
  2. 0005. Labeling and sequential algorithms. Robot Soccer. ppt
  3. 0006. Quad Trees and Octtrees. ppt
  4. 0007. Partitioning and Thresholding. ppt

SHAPES, COLORS AND HISTOGRAMS

  1. 0008. Shape Representation1. ppt
  2. 0009. Image Processing for Melanoma Cancer. ppt
  3. 0010. Histogramming socccer vision. ppt
  4. 0011. Matlab Image Processing. ppt
  5. 0012. Introduction to color image processing. ppt
  6. 0014. Matlab Image Examples with color processing. ppt
  7. 0015. Matlab hit and miss binary. ppt

EDGES and CONVOLUTION.

  1. 0020. Edge Detection Algorithm by Canny. pptx
  2. 0021. Edge Detection with Sobel Algorithm. ppt
  3. 0022. Edge Enhancement. ppt
  4. 0024. Convolution low pass filtering. ppt

FUNDAMENTS OF SPECTRAL METHODS

  1. 1001. B. Introduction to Fourier Transform, 1D continuous. pptx
  2. 1001. C. Sampling and frequencies. ppt
  3. 1002. A. Continuous Fourier Transform Notations and theorems. pptx
  4. 1002. B. Sampling Fourier Transform. ppt
  5. 1003. B. Shift Invariant Linear Systems. ppt
  6. 1004. A. Orthogonal, Separable and Fourier Mathematics. ppt

SPECTRAL TRANSFORMS FOR IMAGES.

  1. 1006. 2D spectral transforms. Examples. ppt
  2. 1007. Combination of Classifiers for Indoor Room Recognition. pptx
  3. 1008. Introduction to Generalized Hough Transform.ppt
  4. 1009 Generalized Hough Transform. 1. ppt
  5. 1009. A. Generalized Hough Transform 2. ppt
  6. 1010. Radon Transform. Easy principles. ppt
  7. 1011. Medical Imaging - acquisition and Radon Transform. ppt
  8. 1012. Biometry and terrorists. pdf

PROBABILISTIC ROBOTICS AND BAYES CLASSIFIERS

  1. 2014_0010_basic Probability and Bayes.pptx
  2. 2014_0011_probability exercises.ppt
  3. 2014_0021_Sensing planning prob BN HMM.ppt
  4. 2014_0095_Example of Bayes Classifier.ppt
  5. 2014_0096_more on Bayes classifiers.ppt
  6. 2014_0097_basic Probability and Bayes - Criticism.pptx
  7. 2014_0098.Decision-trees.ppt
  8. 2014_0100. trees-diagrams.ppt

MOBILE ROBOTS, KALMAN FILTERS AND SLAM

  1. 2014_0124_Stochastic Dynamic Models.pptx
  2. 2014_0181_Localization Mobile Robot Example - Vertical lines.ppt
  3. 2014_0181_Robot Learning and Optimization.pptx
  4. 2014_0182_intro localization and mapping.pptx
  5. 2014_0183_Uncertainty Representation. Feature extraction.pptx
  6. 2014_0187_intro to robot mapping.pptx
  7. 2014_0188_Bayes filters for mobile robots.pptx
  8. 2014_0210_Example-state-estimation-robots.ppt
  9. 2014_0211_using perception in localization and mapping.pptx
  10. 2014_0212_intro Kalman.pptx
  11. 2014_0213_EKF SLAM.pptx
  12. 2014_0214_UKF.pptx

BAYES NETWORKS and PARTICLE FILTERS.

  1. 2014_0287_Bayes Networks.ppt
  2. 2014_0288_MonteCarlo-GA.pptx
  3. 2014_0880_Monte-Carlo_Particle filters - Intro.ppt
  4. 2014_0908_Particle filters - Resampling.ppt
  5. 2014_9102_Particle filters - examples 1.ppt
  6. 2014_9103_Particle Filters - Example 2.pptx
  7. 2014_9180_stochastic robotic control.pptx
  8. 2014_9993_Dynamic Window Approach.pptx
  9. 2014_9993_Occupancy grid maps.pptx

ROBOT THEATRE AT PSU

Individual reading, not covered in class.
  1. Text of the play "Quantum Consciousness" for our robot theatre. We are realizing Act1 of this play in Winter quarter.
  2. Text of research paper about robot theatre, written by Marek Perkowski and Dorota Zukowska. Some futuristic ideas of robot theatre. We will realize some of them during this and next quarters.
  3. Text of PhD dissertation proposal of Mathias Sunardi. Do not share it outside the class. This is a theory behind artistic emotional robot motions and behaviors.
  4. Intervewiew with Marek Perkowski for the international magazine about puppet art. State of the art of robot theatre from my perspective. Other interesting papers about robot theatres in Poland. Every paper is in both Polish and English language.
  5. 2015_0047_Some Plays of Portland CyberTheatre.pptx
  6. 2015_0050_Towards Future Robot Theatres.ppt

HISTORY AND TYPES OF ROBOT THEATRES WORLDWIDE

  1. 2015_0003_Robot Theatre Design for absolute beginners.pptx
  2. 2015_0015_Theoreticians of robot theatre.pdf
  3. 2015_0016_Robotic Pageants.pdf
  4. 2015_0017_Commercial Robot Puppets.pdf
  5. 2015_0020_Early Ideas on Oregon Cyber Theatre.pdf
  6. 2015_0030_Humanoid Robots 1.pdf
  7. 2015_0032_Humanoid Robots 2.pdf
  8. 2015_0033_Walking robots and their design.pdf
  9. 2015_0034_MCECS-BOT.pptx
  10. 2015_0037_History of robot theatre until 2002.pptx
  11. 2015_0038_History of robot theatre 2 and our robot theatre = TWO.ppt
  12. 2015_0039_Animatronic Theatre = Perception = Motion = THREE.pptx
  13. 2015_0040_The complete theatre as a single robot.ppt
  14. 2015_0041_Theatre of emotional robots = FOUR.pptx

QUANTUM ROBOTS

  1. 2015_0042_Quantum Robot = CSP = Quantum Emotional.ppt
  2. 2015_0043_Arushi Quantum Fuzzy Robot - ismvl2008-7.ppt
  3. 2015_0044_Robot C complete example - robot_head_1.pdf
  4. 2015_0045_Example of programming a quantum robot.pptx
  5. 2015_0046_Event Expressions for motion and behavior.pptx

EXAMPLES OF SIMPLE CODES

  1. 2015_1006_C codes - morphological.pptx
  2. 2015_1007_C codes - Canny Operator.pptx
  3. 2015_1009_Line following - Braitenberg, robot examples.ppt
  4. 2015_1010_Simple programming in ROBOTC - Joystick.ppt

SCHROEDINGER CAT DOCUMENTATION

  1. Final Report
  2. Final report about Schreoedinger cat in PDF. It was old Einstien.

ARMS FOR HUMANOID ROBOTS

  1. Humanoid Robot example.pptx Here are the examples of how to describe kinematics for your robot. FOR HOMEWORK 1.
  2. Examples of Humanoid Robot arms-hands-ex.pptx Just to enthuse your imagination.
  3. About Levers. Screws. Wedges. Principle of MA.ppt High-School stuff to be refreshed. If you work on robot design this quarter: think how you can use this knowledge practically on your robot.
  4. Power, Torque and robot Arms.ppt Helps to design a good robot arm of small cost.
  5. Pulleys.ppt">

CEILING CAMERAS FOR ROBOT THEATRE

  1. Preliminary project assignments for this quarter. Will be updated.
  2. 2015_0001_Vision for Curie and soccer.ppt The explanation of some vision projects for this quarter.
  3. 2015_0004_Homework 1 for Class.ppt Morphological processing, edge detection and other simple algorithms for ceiling and front cameras for robot theatre