{"id":459,"date":"2020-09-06T12:45:25","date_gmt":"2020-09-06T12:45:25","guid":{"rendered":"https:\/\/aaidm.buas.nl\/?page_id=459"},"modified":"2020-09-06T16:11:02","modified_gmt":"2020-09-06T16:11:02","slug":"ai1-preparation-for-week-6-more-on-back-propagation","status":"publish","type":"page","link":"https:\/\/aaidm.buas.nl\/?page_id=459","title":{"rendered":"AI1- Preparation for Week 6 More on Back-Propagation"},"content":{"rendered":"\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow\">\n<figure class=\"wp-block-table is-style-regular\"><table><tbody><tr><td>Author:<\/td><td><a href=\"https:\/\/francescolelli.info\/\" target=\"_blank\" rel=\"noreferrer noopener\">Francesco Lelli<\/a><\/td><\/tr><tr><td>Learning Line:<\/td><td>More on Back-propagation <\/td><\/tr><tr><td>Course:<\/td><td>AI1: Introduction to Neural Networks <\/td><\/tr><tr><td>Week:<\/td><td>6<\/td><\/tr><tr><td>Competencies:<\/td><td>1- Understand and be able to use neural network dynamics and factors that influence their performance<br>\u00ad2- Implement a basic pattern recognition<\/td><\/tr><tr><td>BoKS:<\/td><td>\u2022 3aS5 The student is able to develop a functional design for data driven applications.<br>\u2022 3aS2 The student knows how to apply the right statistical &amp; mathematical tools for specific AI-contexts<\/td><\/tr><tr><td>Learning Goals:<\/td><td>Understanding Back-propagation and practical use cases of Neural Network<\/td><\/tr><\/tbody><\/table><\/figure>\n<\/div><\/div>\n\n\n\n<p><strong>Artificial neural networks<\/strong>&nbsp;(<strong>ANN<\/strong>) or simply \u201cneural networks\u201d are computing systems inspired by \u201cclassical biological\u201d neural networks that are in animal brains.&nbsp;Typically&nbsp;an ANN \u201clearn\u201d to perform tasks by considering examples, without being programmed with task-specific rules.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"672\" height=\"440\" src=\"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/image002.jpg\" alt=\"\" class=\"wp-image-71\" srcset=\"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/image002.jpg 672w, https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/image002-300x196.jpg 300w\" sizes=\"auto, (max-width: 672px) 100vw, 672px\" \/><\/figure>\n\n\n\n<p>Image recognition is a&nbsp;classical&nbsp;example where neural networks are used; in particular they learn to identify images that contain dogs by analyzing example images that have been manually categorized (labelled) as \u201cdog\u201d or \u201cno dog\u201d. Once the system \u201clearn\u201d the difference it can be used for identifying dogs in other images.&nbsp;<\/p>\n\n\n\n<p>An ANN does not use conceptual reasoning, for example is not capable to devise that \u201call dogs have 4 legs\u201d, or \u201ca dog must have a nose\u201d etc. Instead, they hide the features of a dog into their data structure and they \u201cinternally learn these characteristics\u201d from the examples that are used for training them.\u00a0<\/p>\n\n\n\n<p>Practical applications are more complex that the classical example mentioned in these videos. Nevertheless, learning how to recognize hand-written digits is always a good place to start. In other\u00a0words\u00a0you can consider this example as the \u201chello world\u201d example for learning the basics of Neural Networks.\u00a0<\/p>\n\n\n\n<p>In the past lecture we introduce back-propagation. During this week detail how back propagation works as well as we continue work to the assignment in order to produce our patter recognition. \u00a0<\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Backpropagation calculus | Chapter 4, Deep learning\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/tIeHLnjs5U8?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Assignment and progresses<\/strong><\/h3>\n\n\n\n<p>The code mentioned in the videos is also available at this link:<\/p>\n\n\n\n<p><a href=\"https:\/\/github.com\/mnielsen\/neural-networks-and-deep-learning\">https:\/\/github.com\/mnielsen\/neural-networks-and-deep-learning<\/a><\/p>\n\n\n\n<p>In the case you would like to replicate the example you can access the database of hand-written digits at this link:&nbsp;<\/p>\n\n\n\n<p><a href=\"http:\/\/yann.lecun.com\/exdb\/mnist\/\">http:\/\/yann.lecun.com\/exdb\/mnist\/<\/a><\/p>\n\n\n\n<p>And, in the case you would like to learn about Artificial Neural Networks in details I would recommend this open book:&nbsp;<\/p>\n\n\n\n<p><a href=\"http:\/\/neuralnetworksanddeeplearning.com\/\">http:\/\/neuralnetworksanddeeplearning.com\/<\/a><\/p>\n\n\n\n<p>This is week 6 of AI1: Introduction to Neural Networks, link to the all material of the course: <\/p>\n\n\n\n<ul class=\"wp-block-list\"><li><a href=\"http:\/\/AI1: Introduction to Artificial Intelligence\" target=\"_blank\" rel=\"noreferrer noopener\">AI1: Introduction to Neural Networks<\/a><\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Author: Francesco Lelli Learning Line: More on Back-propagation Course: AI1: Introduction to Neural Networks Week: 6 Competencies: 1- Understand and be able to use neural network dynamics and factors that influence their performance\u00ad2- Implement a basic pattern recognition BoKS: \u2022 3aS5 The student is able to develop a functional design for data driven applications.\u2022 3aS2 [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"parent":87,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-459","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v24.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>AI1- Preparation for Week 6 More on Back-Propagation - Applied Artificial Intelligence and Data Management<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/aaidm.buas.nl\/?page_id=459\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AI1- Preparation for Week 6 More on Back-Propagation - Applied Artificial Intelligence and Data Management\" \/>\n<meta property=\"og:description\" content=\"Author: Francesco Lelli Learning Line: More on Back-propagation Course: AI1: Introduction to Neural Networks Week: 6 Competencies: 1- Understand and be able to use neural network dynamics and factors that influence their performance\u00ad2- Implement a basic pattern recognition BoKS: \u2022 3aS5 The student is able to develop a functional design for data driven applications.\u2022 3aS2 [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/aaidm.buas.nl\/?page_id=459\" \/>\n<meta property=\"og:site_name\" content=\"Applied Artificial Intelligence and Data Management\" \/>\n<meta property=\"article:modified_time\" content=\"2020-09-06T16:11:02+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/image002.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/aaidm.buas.nl\/?page_id=459\",\"url\":\"https:\/\/aaidm.buas.nl\/?page_id=459\",\"name\":\"AI1- Preparation for Week 6 More on Back-Propagation - Applied Artificial Intelligence and Data Management\",\"isPartOf\":{\"@id\":\"https:\/\/aaidm.buas.nl\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/aaidm.buas.nl\/?page_id=459#primaryimage\"},\"image\":{\"@id\":\"https:\/\/aaidm.buas.nl\/?page_id=459#primaryimage\"},\"thumbnailUrl\":\"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/image002.jpg\",\"datePublished\":\"2020-09-06T12:45:25+00:00\",\"dateModified\":\"2020-09-06T16:11:02+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/aaidm.buas.nl\/?page_id=459#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/aaidm.buas.nl\/?page_id=459\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/aaidm.buas.nl\/?page_id=459#primaryimage\",\"url\":\"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/image002.jpg\",\"contentUrl\":\"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/image002.jpg\",\"width\":672,\"height\":440},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/aaidm.buas.nl\/?page_id=459#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/aaidm.buas.nl\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Year 1\",\"item\":\"https:\/\/aaidm.buas.nl\/?page_id=80\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Year 1 &#8211; Block B\",\"item\":\"https:\/\/aaidm.buas.nl\/?page_id=84\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"AI1: Introduction to Neural Networks\",\"item\":\"https:\/\/aaidm.buas.nl\/?page_id=87\"},{\"@type\":\"ListItem\",\"position\":5,\"name\":\"AI1- Preparation for Week 6 More on Back-Propagation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/aaidm.buas.nl\/#website\",\"url\":\"https:\/\/aaidm.buas.nl\/\",\"name\":\"Applied Artificial Intelligence and Data Management\",\"description\":\"Course Information\",\"publisher\":{\"@id\":\"https:\/\/aaidm.buas.nl\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/aaidm.buas.nl\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/aaidm.buas.nl\/#organization\",\"name\":\"Applied Artificial Intelligence and Data Management\",\"url\":\"https:\/\/aaidm.buas.nl\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/aaidm.buas.nl\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/buas-logo.png\",\"contentUrl\":\"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/buas-logo.png\",\"width\":382,\"height\":132,\"caption\":\"Applied Artificial Intelligence and Data Management\"},\"image\":{\"@id\":\"https:\/\/aaidm.buas.nl\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"AI1- Preparation for Week 6 More on Back-Propagation - Applied Artificial Intelligence and Data Management","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/aaidm.buas.nl\/?page_id=459","og_locale":"en_US","og_type":"article","og_title":"AI1- Preparation for Week 6 More on Back-Propagation - Applied Artificial Intelligence and Data Management","og_description":"Author: Francesco Lelli Learning Line: More on Back-propagation Course: AI1: Introduction to Neural Networks Week: 6 Competencies: 1- Understand and be able to use neural network dynamics and factors that influence their performance\u00ad2- Implement a basic pattern recognition BoKS: \u2022 3aS5 The student is able to develop a functional design for data driven applications.\u2022 3aS2 [&hellip;]","og_url":"https:\/\/aaidm.buas.nl\/?page_id=459","og_site_name":"Applied Artificial Intelligence and Data Management","article_modified_time":"2020-09-06T16:11:02+00:00","og_image":[{"url":"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/image002.jpg","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/aaidm.buas.nl\/?page_id=459","url":"https:\/\/aaidm.buas.nl\/?page_id=459","name":"AI1- Preparation for Week 6 More on Back-Propagation - Applied Artificial Intelligence and Data Management","isPartOf":{"@id":"https:\/\/aaidm.buas.nl\/#website"},"primaryImageOfPage":{"@id":"https:\/\/aaidm.buas.nl\/?page_id=459#primaryimage"},"image":{"@id":"https:\/\/aaidm.buas.nl\/?page_id=459#primaryimage"},"thumbnailUrl":"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/image002.jpg","datePublished":"2020-09-06T12:45:25+00:00","dateModified":"2020-09-06T16:11:02+00:00","breadcrumb":{"@id":"https:\/\/aaidm.buas.nl\/?page_id=459#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/aaidm.buas.nl\/?page_id=459"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/aaidm.buas.nl\/?page_id=459#primaryimage","url":"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/image002.jpg","contentUrl":"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/image002.jpg","width":672,"height":440},{"@type":"BreadcrumbList","@id":"https:\/\/aaidm.buas.nl\/?page_id=459#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/aaidm.buas.nl\/"},{"@type":"ListItem","position":2,"name":"Year 1","item":"https:\/\/aaidm.buas.nl\/?page_id=80"},{"@type":"ListItem","position":3,"name":"Year 1 &#8211; Block B","item":"https:\/\/aaidm.buas.nl\/?page_id=84"},{"@type":"ListItem","position":4,"name":"AI1: Introduction to Neural Networks","item":"https:\/\/aaidm.buas.nl\/?page_id=87"},{"@type":"ListItem","position":5,"name":"AI1- Preparation for Week 6 More on Back-Propagation"}]},{"@type":"WebSite","@id":"https:\/\/aaidm.buas.nl\/#website","url":"https:\/\/aaidm.buas.nl\/","name":"Applied Artificial Intelligence and Data Management","description":"Course Information","publisher":{"@id":"https:\/\/aaidm.buas.nl\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/aaidm.buas.nl\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/aaidm.buas.nl\/#organization","name":"Applied Artificial Intelligence and Data Management","url":"https:\/\/aaidm.buas.nl\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/aaidm.buas.nl\/#\/schema\/logo\/image\/","url":"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/buas-logo.png","contentUrl":"https:\/\/aaidm.buas.nl\/wp-content\/uploads\/2020\/06\/buas-logo.png","width":382,"height":132,"caption":"Applied Artificial Intelligence and Data Management"},"image":{"@id":"https:\/\/aaidm.buas.nl\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/aaidm.buas.nl\/index.php?rest_route=\/wp\/v2\/pages\/459","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aaidm.buas.nl\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/aaidm.buas.nl\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/aaidm.buas.nl\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/aaidm.buas.nl\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=459"}],"version-history":[{"count":4,"href":"https:\/\/aaidm.buas.nl\/index.php?rest_route=\/wp\/v2\/pages\/459\/revisions"}],"predecessor-version":[{"id":505,"href":"https:\/\/aaidm.buas.nl\/index.php?rest_route=\/wp\/v2\/pages\/459\/revisions\/505"}],"up":[{"embeddable":true,"href":"https:\/\/aaidm.buas.nl\/index.php?rest_route=\/wp\/v2\/pages\/87"}],"wp:attachment":[{"href":"https:\/\/aaidm.buas.nl\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=459"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}