{"id":2860,"date":"2022-03-09T08:00:10","date_gmt":"2022-03-09T08:00:10","guid":{"rendered":"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/?p=2860"},"modified":"2022-03-09T08:55:45","modified_gmt":"2022-03-09T08:55:45","slug":"blog-secondment-esr8-nu","status":"publish","type":"post","link":"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/blog-secondment-esr8-nu\/","title":{"rendered":"ESR8 &#8211; Virtual Secondment at Northwestern University"},"content":{"rendered":"<p>[et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;3.22&#8243; global_colors_info=&#8221;{}&#8221;][et_pb_row _builder_version=&#8221;3.25&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;3.25&#8243; custom_padding=&#8221;|||&#8221; global_colors_info=&#8221;{}&#8221; custom_padding__hover=&#8221;|||&#8221;][et_pb_text _builder_version=&#8221;4.14.1&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221; global_colors_info=&#8221;{}&#8221;]<\/p>\n<blockquote><\/blockquote>\n<h2><\/h2>\n\n\t\t<div class='author-shortcodes'>\n\t\t\t<div class='author-inner'>\n\t\t\t\t<div class='author-image'>\n\t\t\t<img src='https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-content\/uploads\/2020\/09\/Arne-279087_60x60.png' alt='' \/>\n\t\t\t<div class='author-overlay'><\/div>\n\t\t<\/div> \n\t\t<div class='author-info'>\n\t\t\t<span data-contrast=\"auto\" xml:lang=\"EN-US\" lang=\"EN-US\" class=\"TextRun SCXW238651454 BCX0\"><span class=\"NormalTextRun SCXW238651454 BCX0\">The collaboration <\/span><span class=\"NormalTextRun SCXW238651454 BCX0\">between<\/span><span class=\"NormalTextRun SCXW238651454 BCX0\"> the Universidad de Granada and Northwestern University moves forward \u2013 the secondment of<\/span><span class=\"NormalTextRun SCXW238651454 BCX0\"> Arne Schmidt (ESR8) at the Northwestern University was a great opportunity to start new projects.<\/span><\/span><span class=\"EOP SCXW238651454 BCX0\" data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\">\u00a0<\/span>\n\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify;\"><span data-contrast=\"auto\">The pandemic certainly limits the possibilities for many researchers to have personal contacts\u2013 but at the same time offers new opportunities due to the rise of regular video calls, virtual secondments and far distance collaborations with online tools. One positive example is the successful collaboration of the research groups of\u00a0 the Universidad de Granada and Northwerstern University that recently led to our <\/span><a href=\"https:\/\/www.springerprofessional.de\/en\/combining-attention-based-multiple-instance-learning-and-gaussia\/19691806\"><span data-contrast=\"none\">conference presentation <\/span><\/a><span data-contrast=\"auto\">at the prestigious MICCAI conference.<\/span><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\">\u00a0<\/span><\/p>\n<p style=\"text-align: justify;\"><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\">\u00a0<\/span><\/p>\n<p style=\"text-align: justify;\"><span data-contrast=\"auto\">Now we got the opportunity to extend this collaboration with my virtual secondment from the 22.11.2021 until 21.12.2021. The expertise in medical images, probabilistic deep learning and computer aided diagnosis of the involved researchers is a strong basis to start new interesting projects together. As the shortage of labeled data is a common problem of many medical image domains, two research areas were of special interest to alleviate this burden: Multiple Instance Learning (MIL) and Active Learning (AL).<\/span><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\">\u00a0<\/span><\/p>\n<p style=\"text-align: justify;\"><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\">\u00a0<\/span><\/p>\n<p style=\"text-align: justify;\"><span data-contrast=\"auto\">The first technique, MIL, requires less annotations, because it groups instances into bags and only requires the bag labels for training. One focus of the secondment lied on hemorrhage detection with CT scans using probabilistic deep learning models in the MIL setting. In this case, the complete CT scan of a patient is treated as a bag while the slices form the instances. MIL applications can also be applied to problems of histopathology, where a Whole Slide Image (WSI) is commonly used as a bag while extracted smaller image patches serve as the instances. Due to the methodological similarity, the developed methods are of high relevance for the CLARIFY project. Based on the combination of Convolutional Neural Networks (CNNs) with Gaussian Processes (GPs), new methods should achieve a better performance for the most accurate diagnosis possible.<\/span><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\">\u00a0<\/span><\/p>\n<p style=\"text-align: justify;\"><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\">\u00a0<\/span><\/p>\n<p style=\"text-align: justify;\"><span data-contrast=\"auto\">Another focus of the secondment was AL. The goal of AL is that the machine learning algorithm itself decides which annotations provide the highest amount of information for the learning process, as shown in Figure 1. Therefore the annotation process reduces to annotating the really important images which can reduce the overall labeling effort. In this line we started a joint research project about AL for histopathological images. One major focus of this project is probabilistic deep learning models, more specifically Bayesian Neural Networks (BNNs). These models allow an uncertainty quantification of the predictions because their output is of probabilistic nature. In the context of AL, this uncertainty can be used to determine images that should be annotated by pathologists.<\/span><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\">\u00a0<\/span><\/p>\n<p style=\"text-align: justify;\"><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\"><\/span><\/p>\n<p><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\"><\/span><\/p>\n<p style=\"text-align: center;\"><a href=\"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-content\/uploads\/2022\/02\/The-process-of-active-learning-Ambiguous-uncertain-samples-are-selected-for-oracle-to.png\"><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-content\/uploads\/2022\/02\/The-process-of-active-learning-Ambiguous-uncertain-samples-are-selected-for-oracle-to-300x186.png\" width=\"468\" height=\"290\" alt=\"\" class=\"wp-image-2864 alignnone size-medium\" \/><\/span><\/a><\/p>\n<p style=\"text-align: center;\"><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\"><span class=\"NormalTextRun SCXW221361965 BCX0\">F<\/span><span class=\"NormalTextRun SCXW221361965 BCX0\">igure 1: The process of active learning: The machine learning model selects images to be annotated. With the newly annotated images, the model is retrained and can again selects images for annotation, etc.<\/span><\/span><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\"><\/span><\/p>\n<p><span data-ccp-props=\"{&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559738&quot;:0,&quot;335559739&quot;:0}\"><\/span><\/p>\n<p style=\"text-align: justify;\"><em>Arne Schmidt &#8211; ESR8<\/em><\/p>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The collaboration between the Universidad de Granada and Northwestern University moves forward \u2013 the secondment of Arne Schmidt (ESR8) at the Northwestern University was a great opportunity to start new projects. <\/p>\n","protected":false},"author":8,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","_eb_attr":"","footnotes":""},"categories":[11],"tags":[],"class_list":["post-2860","post","type-post","status-publish","format-standard","hentry","category-secondment"],"_links":{"self":[{"href":"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-json\/wp\/v2\/posts\/2860","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-json\/wp\/v2\/comments?post=2860"}],"version-history":[{"count":0,"href":"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-json\/wp\/v2\/posts\/2860\/revisions"}],"wp:attachment":[{"href":"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-json\/wp\/v2\/media?parent=2860"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-json\/wp\/v2\/categories?post=2860"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cvblab.webs.upv.es\/clarify-project.eu\/wp-json\/wp\/v2\/tags?post=2860"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}