{"id":4419,"date":"2019-12-07T00:49:58","date_gmt":"2019-12-06T21:49:58","guid":{"rendered":"http:\/\/www.artificialbrain.xyz\/?p=4419"},"modified":"2021-08-03T15:46:01","modified_gmt":"2021-08-03T12:46:01","slug":"deep-learning-disentangled-representations-higher-level-cognition","status":"publish","type":"post","link":"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/","title":{"rendered":"From Deep Learning of Disentangled Representations to Higher-level Cognition"},"content":{"rendered":"<h2 style=\"text-align: left;\"><strong><span style=\"font-size: 12pt;\"><span style=\"font-size: 18pt;\"><em>One of the main challenges for artificial intelligence remains unsupervised learning, at which humans are much better than machines, and which we link to another challenge: bringing deep learning to higher-level cognition.<\/em><\/span><\/span><\/strong><\/h2>\n<p style=\"text-align: justify;\"><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/Yr1mOzC93xs\" width=\"760\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><span data-mce-type=\"bookmark\" style=\"display: inline-block; width: 0px; overflow: hidden; line-height: 0;\" class=\"mce_SELRES_start\">\ufeff<\/span><\/iframe><\/p>\n<blockquote>\n<p style=\"text-align: justify;\"><em><span style=\"font-size: 12pt;\">Yoshua Bengio from the University of Montreal is immediately recognizable as one of the key figures in the Deep Learning revolution that\u2019s taken place in the last five years. And so for those of you who think he\u2019s new to the field, just jumped in this century, he\u2019s been at it for more than 30 years. One of his earliest papers was something called data driven execution of multi-layer networks for automatic speech recognition, which was published in 1988.<\/span><\/em><\/p>\n<p style=\"text-align: justify;\"><em><span style=\"font-size: 12pt;\">And many of the important advances that we see today in speech, vision, text, and images, machine translation are directly attributable to Yoshua\u2019s work and that of his students.<\/span><\/em><\/p>\n<p style=\"text-align: justify;\"><em><span style=\"font-size: 12pt;\">And that work, that recognition is evident in many ways. If you start with something like citations, his work has been cited last year alone, more than 33,000 times. That\u2019s a career for dozens of people and just a one year sample of Yoshua\u2019s influence.<\/span><\/em><\/p>\n<p style=\"text-align: justify;\"><em><span style=\"font-size: 12pt;\">The other way in which his work is felt, is in the long stream of algorithmic innovations that he\u2019s had. Most recently, they come in the form of unsupervised learning, notably the work on generative adversarial networks, on attention models, such as gating that\u2019s been used for machine translation, but really opens up whole other doors to using a variety of other data structures.<\/span><\/em><\/p>\n<p style=\"text-align: justify;\"><em><span style=\"font-size: 12pt;\">And then perhaps the one that\u2019s a little more hidden, the form of influence it\u2019s a little more hidden, is his tremendous work in education and in supporting the community.<\/span><\/em><\/p>\n<p><em><strong><a class=\"yt-simple-endpoint style-scope yt-formatted-string\" href=\"https:\/\/www.youtube.com\/channel\/UCCb9_Kn8F_Opb3UCGm-lILQ\">Microsoft Research<\/a><\/strong><\/em><\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>One of the main challenges for artificial intelligence remains unsupervised learning, at which humans are much better than machines, and which we link to<\/p>\n","protected":false},"author":2,"featured_media":4420,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1476],"tags":[459,18,162],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.2.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>From Deep Learning of Disentangled Representations to Higher-level Cognition - New World : Artificial Intelligence<\/title>\n<meta name=\"description\" content=\"Yoshua Bengio from the University of Montreal is immediately recognizable as one of the key figures in the Deep Learning revolution.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"From Deep Learning of Disentangled Representations to Higher-level Cognition - New World : Artificial Intelligence\" \/>\n<meta property=\"og:description\" content=\"Yoshua Bengio from the University of Montreal is immediately recognizable as one of the key figures in the Deep Learning revolution.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/\" \/>\n<meta property=\"og:site_name\" content=\"New World : Artificial Intelligence\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/groups\/952169468169594\/\" \/>\n<meta property=\"article:published_time\" content=\"2019-12-06T21:49:58+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-08-03T12:46:01+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.newworldai.com\/wp-content\/uploads\/Yoshua-Bengio.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1368\" \/>\n\t<meta property=\"og:image:height\" content=\"770\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"mussem\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@NewWorldAI1\" \/>\n<meta name=\"twitter:site\" content=\"@NewWorldAI1\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"mussem\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/\",\"url\":\"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/\",\"name\":\"From Deep Learning of Disentangled Representations to Higher-level Cognition - New World : Artificial Intelligence\",\"isPartOf\":{\"@id\":\"https:\/\/www.newworldai.com\/#website\"},\"datePublished\":\"2019-12-06T21:49:58+00:00\",\"dateModified\":\"2021-08-03T12:46:01+00:00\",\"author\":{\"@id\":\"https:\/\/www.newworldai.com\/#\/schema\/person\/9d8dd21ba4efacdbf5a5a7700ac3ec1f\"},\"description\":\"Yoshua Bengio from the University of Montreal is immediately recognizable as one of the key figures in the Deep Learning revolution.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.newworldai.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"From Deep Learning of Disentangled Representations to Higher-level Cognition\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.newworldai.com\/#website\",\"url\":\"https:\/\/www.newworldai.com\/\",\"name\":\"New World : Artificial Intelligence\",\"description\":\"Artificial Intelligence, Deep Learning, Machine Learning, AI Lectures, AI Conferences, AI TED Talks, AI Movies, AI Books\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.newworldai.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.newworldai.com\/#\/schema\/person\/9d8dd21ba4efacdbf5a5a7700ac3ec1f\",\"name\":\"mussem\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.newworldai.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/b2359d117d746a042c3d719211039fe2?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/b2359d117d746a042c3d719211039fe2?s=96&d=mm&r=g\",\"caption\":\"mussem\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"From Deep Learning of Disentangled Representations to Higher-level Cognition - New World : Artificial Intelligence","description":"Yoshua Bengio from the University of Montreal is immediately recognizable as one of the key figures in the Deep Learning revolution.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/","og_locale":"en_US","og_type":"article","og_title":"From Deep Learning of Disentangled Representations to Higher-level Cognition - New World : Artificial Intelligence","og_description":"Yoshua Bengio from the University of Montreal is immediately recognizable as one of the key figures in the Deep Learning revolution.","og_url":"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/","og_site_name":"New World : Artificial Intelligence","article_publisher":"https:\/\/www.facebook.com\/groups\/952169468169594\/","article_published_time":"2019-12-06T21:49:58+00:00","article_modified_time":"2021-08-03T12:46:01+00:00","og_image":[{"width":1368,"height":770,"url":"https:\/\/www.newworldai.com\/wp-content\/uploads\/Yoshua-Bengio.jpg","type":"image\/jpeg"}],"author":"mussem","twitter_card":"summary_large_image","twitter_creator":"@NewWorldAI1","twitter_site":"@NewWorldAI1","twitter_misc":{"Written by":"mussem","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/","url":"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/","name":"From Deep Learning of Disentangled Representations to Higher-level Cognition - New World : Artificial Intelligence","isPartOf":{"@id":"https:\/\/www.newworldai.com\/#website"},"datePublished":"2019-12-06T21:49:58+00:00","dateModified":"2021-08-03T12:46:01+00:00","author":{"@id":"https:\/\/www.newworldai.com\/#\/schema\/person\/9d8dd21ba4efacdbf5a5a7700ac3ec1f"},"description":"Yoshua Bengio from the University of Montreal is immediately recognizable as one of the key figures in the Deep Learning revolution.","breadcrumb":{"@id":"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.newworldai.com\/deep-learning-disentangled-representations-higher-level-cognition\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.newworldai.com\/"},{"@type":"ListItem","position":2,"name":"From Deep Learning of Disentangled Representations to Higher-level Cognition"}]},{"@type":"WebSite","@id":"https:\/\/www.newworldai.com\/#website","url":"https:\/\/www.newworldai.com\/","name":"New World : Artificial Intelligence","description":"Artificial Intelligence, Deep Learning, Machine Learning, AI Lectures, AI Conferences, AI TED Talks, AI Movies, AI Books","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.newworldai.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.newworldai.com\/#\/schema\/person\/9d8dd21ba4efacdbf5a5a7700ac3ec1f","name":"mussem","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.newworldai.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/b2359d117d746a042c3d719211039fe2?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b2359d117d746a042c3d719211039fe2?s=96&d=mm&r=g","caption":"mussem"}}]}},"_links":{"self":[{"href":"https:\/\/www.newworldai.com\/wp-json\/wp\/v2\/posts\/4419"}],"collection":[{"href":"https:\/\/www.newworldai.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newworldai.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newworldai.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newworldai.com\/wp-json\/wp\/v2\/comments?post=4419"}],"version-history":[{"count":2,"href":"https:\/\/www.newworldai.com\/wp-json\/wp\/v2\/posts\/4419\/revisions"}],"predecessor-version":[{"id":4422,"href":"https:\/\/www.newworldai.com\/wp-json\/wp\/v2\/posts\/4419\/revisions\/4422"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newworldai.com\/wp-json\/wp\/v2\/media\/4420"}],"wp:attachment":[{"href":"https:\/\/www.newworldai.com\/wp-json\/wp\/v2\/media?parent=4419"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newworldai.com\/wp-json\/wp\/v2\/categories?post=4419"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newworldai.com\/wp-json\/wp\/v2\/tags?post=4419"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}