{"id":458,"date":"2020-09-06T12:45:13","date_gmt":"2020-09-06T12:45:13","guid":{"rendered":"https:\/\/aaidm.buas.nl\/?page_id=458"},"modified":"2020-09-06T16:10:26","modified_gmt":"2020-09-06T16:10:26","slug":"ai1-preparation-for-week-5-back-propagation","status":"publish","type":"page","link":"https:\/\/aaidm.buas.nl\/?page_id=458","title":{"rendered":"AI1- Preparation for Week 5 – Back-propagation"},"content":{"rendered":"\n
\n
Author:<\/td>Francesco Lelli<\/a><\/td><\/tr>
Learning Line:<\/td>Back-propagation<\/td><\/tr>
Course:<\/td>AI1: Introduction to Neural Network <\/td><\/tr>
Week:<\/td>5<\/td><\/tr>
Competencies:<\/td>1- Understand and be able to use neural network dynamics and factors that influence their performance
\u00ad2- Implement a basic pattern recognition<\/td><\/tr>
BoKS:<\/td>3aS2 The student knows how to apply the right statistical & mathematical tools for specific AI-contexts<\/td><\/tr>
Learning Goals:<\/td>Understand Back-propagation<\/td><\/tr><\/tbody><\/table><\/figure>\n<\/div><\/div>\n\n\n\n

Artificial neural networks<\/strong> (ANN<\/strong>) or simply \u201cneural networks\u201d are computing systems inspired by \u201cclassical biological\u201d neural networks that are in animal brains. Typically an ANN \u201clearn\u201d to perform tasks by considering examples, without being programmed with task-specific rules. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Example of Neural Network<\/strong><\/h3>\n\n\n\n

Image recognition is a classical example where neural networks are used; in particular they learn to identify images that contain dogs by analyzing example images that have been manually categorized (labelled) as \u201cdog\u201d or \u201cno dog\u201d. Once the system \u201clearn\u201d the difference it can be used for identifying dogs in other images. <\/p>\n\n\n\n

An ANN does not use conceptual reasoning, for example is not capable to devise that \u201call dogs have 4 legs\u201d, or \u201ca dog must have a nose\u201d etc. Instead, they hide the features of a dog into their data structure and they \u201cinternally learn these characteristics\u201d from the examples that are used for training them.\u00a0<\/p>\n\n\n\n

Practical applications are more complex that the classical example mentioned in these videos. Nevertheless, learning how to recognize hand-written digits is always a good place to start. In other words you can consider this example as the \u201chello world\u201d example for learning the basics of Neural Networks. <\/p>\n\n\n\n

In this lecture and practical assignment we will introduce back-propagation.<\/p>\n\n\n\n

In machine learning, backpropagation is a widely used algorithm in training feedforward neural networks for supervised learning. Generalizations of backpropagation exist for other artificial neural networks, and for functions generally \u2013 a class of algorithms referred to generically as “backpropagation”.\u00a0<\/p>\n\n\n\n

\n