Subject: Product Outage/Anomaly: (Update #5) NDE Product Outage, This is a multi-part message in MIME format. --Boundary_(ID_A3XYItcHOvmHYwkUwsgWAA) Content-type: text/plain; charset=utf-8; format=flowed Content-transfer-encoding: 7BIT *Update #5:* Successfullyfinished recovering missing data with minimal product failures at 1130Z 9/3/2016. NDE is currently working off the backlog. Some products were not delivered to users because users' timeliness requirements. Notice to Pull Data Users of NDE -- please check to see if you need to restart your pull scripts. _*Update #4*:At 1940Z, the SNPP NDE system is online and the system is processing/distributing SNPP data to authorized users. Technicians and Engineers areaggressively working to process backlogged data accumulated during the long outage period - this will take 12-15 hours to fully complete. The latest SNPP data from the most recent Svaalbard contacts will be processed/distributed first to all time critical users of the system to ensure those users have the most current data.At this time, we anticipate being able to successfully recover past data with minimal product failures, although some products will not be delivered if they do not meet users' timeliness requirements.Notice to Pull data users of NDE -- please check to see if you need to restart their pull scripts. *Update #3: *As of 1730Z, the SNPP**NDE system remains offline as technicians and engineers continue to restore the system. Progress to restore the system is being made, but the return to service time is not yet available. Further updates will be provided as soon as more information is made available. *Update #2 :* NDE continues to remain down. Engineers have been working through the night to fix the problem. More updates will be sent out when information becomes available. * Update #1:***Hardware failure has been identified as the cause of NDE problem. Engineers are still working on the solution. More updates will be sent out when information become available.* Topic: *NDE Product Outage** *Date/Time Issued**:*September 3, 2016 1310Z *Product(s) or Data Impacted:*NDE is currently not generating products. All NDE products are affected. *Date/Time of Initial Impact:*September 1, 2016 1627Z ** *Date/Time of Expected End:***September 2, 2016 1940z *Length of Event:*27 hours 13 minutes ***Details/Specifics of Change: *At ~1627Z all production servers stopped generating products. Engineers are currently investigating. *C**ontact Information for Further Information: * ESPC Operations at ESPCOperations@noaa.gov and 301-817-3880 You have been sent this and other notifications because you have opted in to receive it. If for any reason, you wish to unsubscribe, please contact ESPC Help Desk at ESPCOperations@noaa.gov or (301) 817-3880 . Please note: it may take up to two business days to process your unsubscribe request. ** *Web Site(s) for applicable information:*N/A --Boundary_(ID_A3XYItcHOvmHYwkUwsgWAA) Content-type: text/html; charset=utf-8 Content-transfer-encoding: 8BIT
Update #5: Successfully finished recovering missing data with minimal product failures at 1130Z 9/3/2016.  NDE is currently working off the backlog.  Some products were not delivered to users because users' timeliness requirements.  Notice to Pull Data Users of NDE -- please check to see if you need to restart your pull scripts.

Update #4:  At 1940Z, the SNPP NDE system is online and the system is processing/distributing SNPP data to authorized users. Technicians and Engineers are  aggressively working to process backlogged data accumulated during the long outage period - this will take 12-15 hours to fully complete. The latest SNPP data from the most recent Svaalbard contacts will be processed/distributed first to all time critical users of the system to ensure those users have the most current data.  At this time, we anticipate being able to successfully recover past data with minimal product failures, although some products will not be delivered if they do not meet users' timeliness requirements.  Notice to Pull data users of NDE -- please check to see if you need to restart their pull scripts.

Update #3:  As of 1730Z, the SNPP NDE system remains offline as technicians and engineers continue to restore the system.  Progress to restore the system is being made, but the return to service time is not yet available.  Further updates will be provided as soon as more information is made available.

Update #2 : NDE continues to remain down.  Engineers have been working through the night to fix the problem. More updates will be sent out when information becomes available. 

Update #1:
Hardware failure has been identified as the cause of NDE problem. Engineers are still working on the solution. More updates will be sent out when information become available.

Topic: 
NDE Product Outage 

Date/Time Issued:  September 3, 2016  1310Z

Product(s) or Data Impacted:  NDE is currently not generating products.  All NDE products are affected. 

Date/Time of Initial Impact:  September 1, 2016  1627Z

Date/Time of Expected End:  September 2, 2016  1940z

Length of Event:  27 hours 13 minutes

Details/Specifics of Change:  At ~1627Z  all production servers stopped generating products.  Engineers are currently investigating.   

Contact Information for Further Information:  ESPC Operations at ESPCOperations@noaa.gov and 301-817-3880

You have been sent this and other notifications because you have opted in to receive it. If for any reason, you wish to unsubscribe, please contact ESPC Help Desk at ESPCOperations@noaa.gov or (301) 817-3880. Please note: it may take up to two business days to process your unsubscribe request.

Web Site(s) for applicable information: N/A

--Boundary_(ID_A3XYItcHOvmHYwkUwsgWAA)--