{"id":1074,"date":"2014-04-07T14:29:50","date_gmt":"2014-04-07T05:29:50","guid":{"rendered":"http:\/\/www.lookingatnothing.com\/?p=1074"},"modified":"2014-08-31T15:32:12","modified_gmt":"2014-08-31T06:32:12","slug":"12-corrections-in-a-row","status":"publish","type":"post","link":"https:\/\/lookingatnothing.com\/index.php\/archives\/1074","title":{"rendered":"12 corrections in a row"},"content":{"rendered":"<p>Just a couple of housekeeping notes: I&#8217;m giving talks in Europe in a month at the following locations:<\/p>\n<ol>\n<li>Unit\u00e9 Mat\u00e9riaux et Transformations (UMET), Lille on May 16, hosted by <a href=\"http:\/\/umet.univ-lille1.fr\/detailscomplets.php?id=39\">Gr\u00e9gory Stoclet<\/a>,<\/li>\n<li>Birmingham University, Birmingham on the 20th of May, hosted by <a href=\"http:\/\/schneppgroup.wordpress.com\">Zoe Schnepp<\/a>,<\/li>\n<li>Nottingham University, Nottingham, on the 23rd of May, hosted by <a href=\"http:\/\/www.nottingham.ac.uk\/physics\/people\/philip.moriarty\">Philip Moriarty<\/a>,<\/li>\n<\/ol>\n<p>Between these dates, I&#8217;ll also be joining Zoe and Martin for beamtime at the Diamond synchrotron (beamline I11) between May 21 and May 23. Please feel free to stop me at these locations and say hi!<\/p>\n<p>For today, I&#8217;ve got another bit of data correction to show. I thought it might be interesting to put them all together and show you what difference it makes to an integrated scattering pattern. Many of the data corrections implemented are quite straightforward shifts and scalings, but some are more involved and have a greater effect on the scattering pattern. <!--more-->First, let&#8217;s put all of them out there. This data is a sample of MgZn alloy, in early stages of precipitation. It has been measured for three hours on a reasonably good Bruker instrument with a low background (all-vacuum flight path, good collimation), and a Bruker HiStar wire detector <a href=\"http:\/\/www.lookingatnothing.com\/index.php\/archives\/1049\">which I have complained about before<\/a>. The new high speed molybdenum rotating anode source is quite stable (varying about 5% in intensity over the weeks I have been using it) and hasn&#8217;t let me down yet unlike <a href=\"http:\/\/www.lookingatnothing.com\/index.php\/archives\/976\">a particular (older) Rigaku generator <\/a>which is starting to make funny noises *again*. Anyway, I digress&#8230;<\/p>\n<figure id=\"attachment_1075\" aria-describedby=\"caption-attachment-1075\" style=\"width: 209px\" class=\"wp-caption alignright\"><a href=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2014\/04\/DemoAll.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-1075\" alt=\"The effect of 12 data corrections.\" src=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2014\/04\/DemoAll-209x300.png\" width=\"209\" height=\"300\" srcset=\"https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/DemoAll-209x300.png 209w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/DemoAll-715x1024.png 715w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/DemoAll-104x150.png 104w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/DemoAll.png 1146w\" sizes=\"auto, (max-width: 209px) 100vw, 209px\" \/><\/a><figcaption id=\"caption-attachment-1075\" class=\"wp-caption-text\"><strong>Figure 1:<\/strong> The effect of 12 data corrections.<\/figcaption><\/figure>\n<p>Figure 1 shows the collected data through its various correction steps (click on the image to enlarge). It is obvious that there is a lot of scaling going on, but there are also a few corrections that change the measured profile.<\/p>\n<p>The corrections performed are (in this order): DS, DC, MK, FF, TI, FL, TR, AU, SP, SA, BG, TH (abbreviations <a href=\"http:\/\/dx.doi.org\/10.1088\/0953-8984\/25\/38\/383201\">are in this paper<\/a>, <a href=\"https:\/\/bitbucket.org\/toQDuj\/imp2\/overview\">software here<\/a>. The correction abbreviations used here mean (respectively): data read-in, darkcurrent, mask, flatfield, time, flux, transmission, absolute intensity scaling, spherical (area dilation), self-absorption, background and thickness). GD (geometric distortion) is performed by the Bruker software. PO (polarisation) is still missing, as is MS and SM, DT and GA (multiple scattering, smearing effects, deadtime and nonlinearity). I don&#8217;t expect these to have large effects, but seeing is believing.<\/p>\n<p>The biggest changes here happen for BG, making it particularly important to get right. Smaller changes are seen for MK (especially for the last few datapoints) and FF (raising and lowering particular datapoints by about 5%).<\/p>\n<figure id=\"attachment_1078\" aria-describedby=\"caption-attachment-1078\" style=\"width: 300px\" class=\"wp-caption alignright\"><a href=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-01.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-1078\" alt=\"Data before and after corrections have been applied\" src=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-01-300x157.png\" width=\"300\" height=\"157\" srcset=\"https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-01-300x157.png 300w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-01-1024x537.png 1024w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-01-150x78.png 150w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-01.png 1240w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><figcaption id=\"caption-attachment-1078\" class=\"wp-caption-text\"><strong>Figure 2:<\/strong> Data before and after corrections have been applied<\/figcaption><\/figure>\n<p>When comparing the 2D images rather than the integrated data, we see that there are a lot of changes occurring in the patterns upon correction (Figure 2, click to enlarge). We are expecting a little anisotropicity in this sample (which is visible). I hope it is clear from the differences before and after correction, though, that we have been able to successfully remove most of the &#8220;shit&#8221;. Just to drive home the point, Figure 3 shows a close-up of the central part.<\/p>\n<figure id=\"attachment_1079\" aria-describedby=\"caption-attachment-1079\" style=\"width: 300px\" class=\"wp-caption alignright\"><a href=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-021.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-1079\" alt=\"Close-up of the effect of data correction\" src=\"http:\/\/www.lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-021-300x157.png\" width=\"300\" height=\"157\" srcset=\"https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-021-300x157.png 300w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-021-1024x537.png 1024w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-021-150x78.png 150w, https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-021.png 1240w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><figcaption id=\"caption-attachment-1079\" class=\"wp-caption-text\"><strong>Figure 3:<\/strong> Close-up of the effect of data correction<\/figcaption><\/figure>\n<p>In conclusion, data corrections are an essential but typically underrepresented part of small-angle scattering. It&#8217;s critical to get your data right, because all your conclusions will depend on it!<\/p>\n","protected":false},"excerpt":{"rendered":"<div class=\"mh-excerpt\"><p>Just a couple of housekeeping notes: I&#8217;m giving talks in Europe in a month at the following locations: Unit\u00e9 Mat\u00e9riaux et Transformations (UMET), Lille on <a class=\"mh-excerpt-more\" href=\"https:\/\/lookingatnothing.com\/index.php\/archives\/1074\" title=\"12 corrections in a row\">[&#8230;]<\/a><\/p>\n<\/div>","protected":false},"author":2,"featured_media":1077,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":4,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"","footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[1,85,53],"tags":[118,115,232,31],"class_list":["post-1074","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","category-looking-into-something","category-software-2","tag-data-correction","tag-data-processing","tag-imp","tag-software"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/lookingatnothing.com\/wp-content\/uploads\/2014\/04\/beforeAfter-02.png","jetpack_shortlink":"https:\/\/wp.me\/p1gZ2v-hk","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/posts\/1074","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/comments?post=1074"}],"version-history":[{"count":1,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/posts\/1074\/revisions"}],"predecessor-version":[{"id":1080,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/posts\/1074\/revisions\/1080"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/media\/1077"}],"wp:attachment":[{"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/media?parent=1074"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/categories?post=1074"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lookingatnothing.com\/index.php\/wp-json\/wp\/v2\/tags?post=1074"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}