Subject: Administrative: Status of GOES-16 Clear Sky Mask L2 data, --94eb2c1a642430f6210566350f37 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable *Topic: Status of GOES-16 Clear Sky Mask L2 DataDate/Time Issued: February 27, 2018 1735 UTCProduct(s) or Data Impacted: GOES-16 Clear Sky Mask L2 DataDate/Time of Initial Impact: February 18, 2018 at 2215 UTCDate/Time of Expected End: N/ALength of Event: N/A Details/Specifics of Change: The GOES-R Peer/Stakeholder Product Validation Review (PS-PVR) for the Advanced Baseline Imager (ABI) L2+ Clear Sky Mask (CSM), also known as the Binary Cloud Mask (BCM), Provisional Maturity was held on February 16, 2018. As a result of this review, the PS-PVR panel recommended that the ABI BCM be declared Provisional. The GOES-16 ABI BCM generates the cloud mask used by many of the ABI L2 Products. The BCM consists of the binary cloud mask, a 4-level mask and the results of individual tests. Only the binary cloud mask is made available to external users. In Mode 3 operations, the BCM is required to be generated every 15 minutes for ABI Full Disk (FD) of the Earth, every 5 minutes over the Continental United States (CONUS) region, and every 5 minute over the Mesoscale (MESO) regions, according the GOES-R Mission Requirements Document. However, operationally, the Mask is produced for every Mesoscale image due to downstream requirements. A full description and format of the BCM products can be found in the Product Definition and User=E2=80=99s Guide (PUG) document (http://www.goes-r.gov/products/docs/PUG-L2+-vol5.pdf ). The algorithm used to derive the BCM from GOES-16 ABI observations is described in detail in the =E2=80=9CGOES-R Advanced Baseline Imager (ABI) Algorithm Theoretical Ba= sis Document for ABI Cloud Mask=E2=80=9D (https://www.goes-r.gov/products/ATBDs/baseline/Cloud_CldMask_v2.0_no_color= .pdf ). The ABI L2+ BCM Beta, Provisional and Full Validation Readiness, Implementation and Management Plan (RIMP) defines Provisional maturity as: - Validation activities are ongoing and the general research community is now encouraged to participate;- Severe algorithm anomalies are identified and under analysis. Solutions to anomalies are in development and testing.- Incremental product improvements may still be occurring;- Product performance has been demonstrated through analysis of a small number of independent measurements obtained from select locations, periods, and associated ground truth or field campaign efforts;- Product analysis is sufficient to communicate product performance to users relative to expectations (Performance Baseline);- Documentation of product performance exists that includes recommended remediation strategies for all anomalies and weaknesses. Any algorithm changes associated with severe anomalies have been documented, implemented, tested, and shared with the user community;- Testing has been fully documented; and- Product is ready for operational use and for use in comprehensive cal/val activities and product optimization. Persons desiring to use the GOES-16 ABI Provisional maturity BCM products for any reason, including but not limited to scientific and technical investigations, are encouraged to consult the NOAA/NESDIS/STAR Algorithm Working Group (AWG) scientists for feasibility of the planned applications. The BCM product is sensitive to upstream processing that includes the quality of the calibration, navigation, terminator regions and dynamic ancillary data, such as the snow mask. Status of the current BCM products and any remaining known issues that are being resolved: - Summary of the measured performance of the BCM products as measured against reference data:- Accuracy specifications are met when compared with MODIS C6 MYD35 EDRs, excluding MYD35 EDRs with known issues- Accuracy is met for GOES-16 BCM when compared to the clear sky SST, and most SURFRAD observations- Accuracy specifications are met when compared with CALIPSO, is above specifications - The BCM has the current known issues and limitations, which are being addressed- False cloud due to fresh snow not being present in ancillary snow mask: The BCM is totally reliant on the ancillary snow mask. Errors in the snow mask will impact the BCM. Modifications to the BCM to reduce this reliance are being explored.- Some blocks on land around unmarked inland water due to the RFMFT- False Cloud (PFMFT/ETROP tests along coast lines): This issue is most prevalent in regions with a strong land/sea temperature gradient.- False Cloud over SST gradients: One of the BCM tests (RFMFT) is known to falsely detect cloud over strong SST gradients or features.- Missed Cloud (warm low stratus at night). Clouds which pose a very small thermal signal can be missed in the BCM. We are working to improve this performance.- Terminator Performance: Performance differences from day to night are apparent with more cloud being detected during the day than at night. This difference causes the terminator to be noticeable in the data. The BCM Team is working to remove any erroneous terminator artifacts.- Lingering impact of calibration of ABI Band2 still poses a risk. An ad-hoc adjustment was made to the RGCT (Reflectance Gross Contrast Test) to account for this but other tests remain unadjusted and this may also contribute to some terminator issues. If the ABI Band 2 calibration is adjusted, there will be a lag in time before the BCM can be adjusted accordingly. Contact for further information: OSPO User Services at SPSD.UserServices@noaa.gov Contacts for specific information on the ABI L2 BCM product:Wayne MacKenzie wayne.mackenzie@noaa.gov Andrew Heidinger andrew.heidinger@noaa.gov Jaime Daniels jaime.daniels@noaa.gov * <301-286-3647> --94eb2c1a642430f6210566350f37 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

Topic: S= tatus of GOES-16 Clear Sky Mask L2 Data

Date/= Time Issued: Fe= bruary 27, 2018 1735 UTC

Product(s) or Data Impacted<= /span>: GOES-16 Clear = Sky Mask L2 Data

Date/Time of Initial Impact: February 18, 2018 at 2= 215 UTC

Date/Time of Expected End: =C2=A0N/A

Length of Event: =C2=A0N/A

=C2=A0

Details/Specifics of Change: The GOES-R Peer/Stakeholder Product Validation Review (PS-PVR) for the Ad= vanced Baseline Imager (ABI) L2+ Clear Sky Mask (CSM), also known as the Bi= nary Cloud Mask (BCM), Provisional Maturity was held on February 16, 2018. = As a result of this review, the PS-PVR panel recommended that the ABI BCM b= e declared Provisional.

The GOES-16 ABI BCM generates the cloud mask used by many of = the ABI L2 Products. The BCM consists of the binary cloud mask, a 4-level m= ask and the results of individual tests. Only the binary cloud mask is made= available to external users. In Mode 3 operations, the BCM is required to = be generated every 15 minutes for ABI Full Disk (FD) of the Earth, every 5 = minutes over the Continental United States (CONUS) region, and every 5 minu= te over the Mesoscale (MESO) regions, according the GOES-R Mission Requirem= ents Document. However, operationally, the Mask is produced for every Mesos= cale image due to downstream requirements.

A full description and= format of the BCM products can be found in the Product Definition and User= =E2=80=99s Guide (PUG) document (http://www.goes-r.gov/products= /docs/PUG-L2+-vol5.pdf). The algorithm used to derive the BCM from GOES-16 ABI observatio= ns is described in detail in the =E2=80=9CGOES-R Advanced Baseline Imager (= ABI) Algorithm Theoretical Basis Document for ABI Cloud Mask=E2=80=9D (https://www.goes-r.gov/products/ATBDs/bas= eline/Cloud_CldMask_v2.0_no_color.pdf).

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0

The ABI L2+ BCM Beta, Provisional and Full Validation Readiness, I= mplementation and Management Plan (RIMP) defines Provisional maturity as:


  • Validation activities are ongoing and the general research community is no= w encouraged to participate;

  • Severe algorith= m anomalies are identified and under analysis. Solutions to anomalies are i= n development and testing.

  • Incremental produ= ct improvements may still be occurring;

  • Prod= uct performance has been demonstrated through analysis of a small number of= independent measurements obtained from select locations, periods, and asso= ciated ground truth or field campaign efforts;

  • Product analysis is sufficient to communicate product performance to use= rs relative to expectations (Performance Baseline);

  • Documentation of product performance exists that includes recommen= ded remediation strategies for all anomalies and weaknesses. Any algorithm = changes associated with severe anomalies have been documented, implemented,= tested, and shared with the user community;

  • Testing has been fully documented; and

  • Prod= uct is ready for operational use and for use in comprehensive cal/val activ= ities and product optimization.

= Persons desiring to use t= he GOES-16 ABI Provisional maturity BCM products for any reason, including = but not limited to scientific and technical investigations, are encouraged = to consult the NOAA/NESDIS/STAR Algorithm Working Group (AWG) scientists fo= r feasibility of the planned applications. The BCM product is sensitive to = upstream processing that includes the quality of the calibration, navigatio= n, terminator regions and dynamic ancillary data, such as the snow mask.

Status of the current BCM products and any remaining known issues tha= t are being resolved:

  • Summary of the measured performance of the BCM products as measured agai= nst reference data:

    • Accuracy specifications are met when compared with MODIS C6 MYD35 EDRs, = excluding MYD35 EDRs with known issues

    • = Accuracy is met for GOES-= 16 BCM when compared to the clear sky SST, and most SURFRAD observations

    • Accuracy specifications are met when compared with CALIPSO, is abo= ve specifications


  • The BCM has the current known issues and limitations, which ar= e being addressed

    • False cloud due to fresh snow not being present in ancillary snow mask: Th= e BCM is totally reliant on the ancillary snow mask. Errors in the snow mas= k will impact the BCM. Modifications to the BCM to reduce this reliance are= being explored.

    • Some blocks on land around unmarked inland wate= r due to the RFMFT

    • False Cloud (PFMFT/ETROP tests along coast li= nes): This issue is most prevalent in regions with a strong land/sea temper= ature gradient.

    • False Cloud over SST gradients: One of the BCM t= ests (RFMFT) is known to falsely detect cloud over strong SST gradients or = features.

    • Missed Cloud (warm low stratus at night). Clouds which= pose a very small thermal signal can be missed in the BCM. We are working = to improve this performance.

    • Terminator Performance: Performance= differences from day to night are apparent with more cloud being detected = during the day than at night. This difference causes the terminator to be n= oticeable in the data. The BCM Team is working to remove any erroneous term= inator artifacts.

    • Lingering impact of calibration of ABI Band2 s= till poses a risk. An ad-hoc adjustment was made to the RGCT (Reflectance G= ross Contrast Test) to account for this but other tests remain unadjusted a= nd this may also contribute to some terminator issues. If the ABI Band 2 ca= libration is adjusted, there will be a lag in time before the BCM can be ad= justed accordingly.

Contact for further information: OSPO User Servic= es at S= PSD.UserServices@noaa.gov

Contacts for specific information on the ABI L2 BCM product:=

Wayne MacKenzi= e wayne.m= ackenzie@noaa.gov

Andrew Heidinger andrew.heidinger@noaa.gov

Jaime Daniels jaime.daniels@noaa.gov



--94eb2c1a642430f6210566350f37--