{"id":2101,"date":"2016-05-17T09:15:33","date_gmt":"2016-05-17T08:15:33","guid":{"rendered":"http:\/\/www.lookingatnothing.com\/?p=2101"},"modified":"2016-05-17T10:11:00","modified_gmt":"2016-05-17T09:11:00","slug":"round-robin-initial-results","status":"publish","type":"post","link":"https:\/\/lookingatnothing.com\/index.php\/archives\/2101","title":{"rendered":"Round Robin: precision of SAXS"},"content":{"rendered":"<p>We<a href=\"http:\/\/www.lookingatnothing.com\/index.php\/archives\/2082\"> left off this issue a few weeks ago<\/a> after discussing the variations between the datasets. However, we did not evaluate how variations in the data affects the final morphological parameters. Let&#8217;s do that now.<!--more-->To evaluate this, we fired up McSAS and let it analyse each collected scattering pattern. In order to avoid artifacts, the radius range was adapted to match the limits imposed by the data for every pattern.<\/p>\n<figure id=\"attachment_2104\" aria-describedby=\"caption-attachment-2104\" style=\"width: 300px\" class=\"wp-caption alignright\"><a href=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASDistAll.png\" rel=\"attachment wp-att-2104\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-2104\" src=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASDistAll-300x300.png\" alt=\"Deviations from determined mean and width of the scatterer population. \" width=\"300\" height=\"300\" srcset=\"https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASDistAll-300x300.png 300w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASDistAll-150x150.png 150w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASDistAll-768x768.png 768w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASDistAll.png 900w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><figcaption id=\"caption-attachment-2104\" class=\"wp-caption-text\">Figure 1: Deviations from determined mean and width of the scatterer population. Click to enlarge.<\/figcaption><\/figure>\n<p>Each resulting distribution was quantified in terms of the distribution moments, in particular the mean and the variance. We can determine the median mean value, and the median variance, and plot the fractional deviations from those. This is shown in Figure 1, where an additional separation has been made between synchrotron and laboratory instruments. The horizontal axis signifies the deviation from the mean, and the vertical axis plots the deviation from the variance.<\/p>\n<figure id=\"attachment_2106\" aria-describedby=\"caption-attachment-2106\" style=\"width: 300px\" class=\"wp-caption alignright\"><a href=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASMeanKDE.png\" rel=\"attachment wp-att-2106\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-2106\" src=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASMeanKDE-300x300.png\" alt=\"Kernel density estimate plot for the deviation from the mean.\" width=\"300\" height=\"300\" srcset=\"https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASMeanKDE-300x300.png 300w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASMeanKDE-150x150.png 150w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASMeanKDE-768x768.png 768w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASMeanKDE.png 900w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><figcaption id=\"caption-attachment-2106\" class=\"wp-caption-text\">Figure 2: Kernel density estimate plot for the deviation from the mean. Click to enlarge.<\/figcaption><\/figure>\n<p>As can be estimated from that figure, there are a few outliers, but most data appears within about +\/- 1% of the mean, and +\/- 10% of the width. At first glance, there appears to be no obvious difference between synchrotron and laboratory instruments. We can, however, plot the distribution of deviations as a <a href=\"https:\/\/en.wikipedia.org\/wiki\/Kernel_density_estimation\">kernel density estimate plot<\/a>. This is shown for the means in Figure 2, and for the widths in Figure 3.<\/p>\n<figure id=\"attachment_2108\" aria-describedby=\"caption-attachment-2108\" style=\"width: 300px\" class=\"wp-caption alignright\"><a href=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASVarKDE-1.png\" rel=\"attachment wp-att-2108\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-2108\" src=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASVarKDE-1-300x300.png\" alt=\"Kernel Density Estimate plot of the deviation from the median variance. Click to enlarge.\" width=\"300\" height=\"300\" srcset=\"https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASVarKDE-1-300x300.png 300w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASVarKDE-1-150x150.png 150w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASVarKDE-1-768x768.png 768w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASVarKDE-1.png 900w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><figcaption id=\"caption-attachment-2108\" class=\"wp-caption-text\">Figure 3: Kernel Density Estimate plot of the deviation from the median variance. Click to enlarge.<\/figcaption><\/figure>\n<p>These plots show that the distribution of values for the means are indeed independent of whether it was measured on a laboratory or on a synchrotron. The widths, however, do show a wider spread for laboratory instruments than for synchrotron instruments. When calculated numerically over the entire set, one standard deviation of the mean is about 1.6%, and of the variance about 9%. Quite good for this technique, I&#8217;d say!<\/p>\n<figure id=\"attachment_2105\" aria-describedby=\"caption-attachment-2105\" style=\"width: 300px\" class=\"wp-caption alignright\"><a href=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2016\/05\/intraDiff.png\" rel=\"attachment wp-att-2105\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-2105\" src=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2016\/05\/intraDiff-300x200.png\" alt=\"Distance between each pair measured on a given instrument. Error bars show propagated uncertainty of determination. Click to enlarge. \" width=\"300\" height=\"200\" srcset=\"https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/intraDiff-300x200.png 300w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/intraDiff-768x512.png 768w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/intraDiff.png 900w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><figcaption id=\"caption-attachment-2105\" class=\"wp-caption-text\">Figure 4: Distance between each pair measured on a given instrument. Error bars show propagated uncertainty of determination. Click to enlarge.<\/figcaption><\/figure>\n<p>Finally, each laboratory was sent a pair of samples, and was requested to measure both of them. These samples were identical (which I can say now that the deadline has passed). These pairs allow us to estimate the intra-instrument precision as well, by quantifying the distance between the values of each pair.<\/p>\n<p>These distances are shown in Figure 4, which shows that the intra-instrument precision is (as expected) better than the inter-instrument precision. However, here we are falling within the uncertainty of determination using McSAS. Therefore, we&#8217;ll switch to another program (with added assumptions) to try and quantify this a little better.<\/p>\n<p>We are now working on the publication of these results. A very big thanks to all the laboratories who have graciously participated in this project, without whose efforts we would not have been able to determine the precision of SAXS. The anonymized, rebinned data will be made available under a creative-commons license after publication to allow further evaluation by you. As always, comments can be left in the comment section below!<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<div class=\"mh-excerpt\"><p>We left off this issue a few weeks ago after discussing the variations between the datasets. However, we did not evaluate how variations in the <a class=\"mh-excerpt-more\" href=\"https:\/\/lookingatnothing.com\/index.php\/archives\/2101\" title=\"Round Robin: precision of SAXS\">[&#8230;]<\/a><\/p>\n<\/div>","protected":false},"author":2,"featured_media":2104,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":4,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"","footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[1],"tags":[],"class_list":["post-2101","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/lookingatnothing.com\/wp-content\/uploads\/2016\/05\/McSASDistAll.png","jetpack_shortlink":"https:\/\/wp.me\/p1gZ2v-xT","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/posts\/2101","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/comments?post=2101"}],"version-history":[{"count":3,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/posts\/2101\/revisions"}],"predecessor-version":[{"id":2111,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/posts\/2101\/revisions\/2111"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/media\/2104"}],"wp:attachment":[{"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/media?parent=2101"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/categories?post=2101"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/tags?post=2101"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}