Skip to Content.

mget-help - RE: [mget-help] AVHRR Pathfinder Level 3 Monthly Daytime SST Version 5 on MGET

Please Wait...

Subject: Marine Geospatial Ecology Tools (MGET) help

Text archives


RE: [mget-help] AVHRR Pathfinder Level 3 Monthly Daytime SST Version 5 on MGET


Chronological Thread 
  • From: Jason Roberts <>
  • To: Rodrigo Tardin <>
  • Cc: "" <>
  • Subject: RE: [mget-help] AVHRR Pathfinder Level 3 Monthly Daytime SST Version 5 on MGET
  • Date: Fri, 17 Feb 2017 14:29:50 +0000
  • Accept-language: en-US
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99

Hi Rodrigo,

 

I’m glad the Pathfinder SST is working for you now. I’m not sure what is happening with the ocean color data. The important part of the error is what I have highlighted below:

 

RuntimeError: Failed to query the NASA OceanColor server at https://oceandata.sci.gsfc.nasa.gov/search/file_search.cgi. The query was retried for 300 seconds without 

success. Check that the server is operating properly and that your computer can connect to it. If necessary, contact the server's operator for assistance. 

If the server and network are operating properly, this problem could be a programming error in this tool. If you suspect one, contact the author of this tool for 

assistance. Error details: ServerNotFoundError: Unable to find the server at oceandata.sci.gsfc.nasa.gov

 

Normally, when that error is reported it means there is a domain name system (DNS) problem. When that failure happens, can you access that server (oceandata.sci.gsfc.nasa.gov) from your browser using a https URL? It sounds like the answer is no, you cannot (“When I try to manually enter at the website it says I can't have access too”). If that is the case, then you will need help from your network administrator to find out why your computer cannot connect to the server. But if you can access it using your browser then something strange is going on with MGET. I will try to think of what could be the problem...

 

Jason

 

From: Rodrigo Tardin [mailto:]
Sent: Thursday, February 16, 2017 12:40 PM
To: Jason Roberts <>
Cc:
Subject: Re: [mget-help] AVHRR Pathfinder Level 3 Monthly Daytime SST Version 5 on MGET

 

Thank you very much Jason!

It worked prefectly well for SST! However I did not have the same luck for Chlorophyl MODIS Aqua 4km. The error I get it seems problems in internet conection, but this is not true since the internet is working fine (tried different websites and tools from ArcGIS that uses internet). When I try to mannualy enter at the website it says I can't have access too.

Would you have a clue on what's going on?

 

Thank you very much,

---

 

A summary for what I did on ArcGIS

Interpolate NASA OceanColor L3 SMI Product at Points

Sensor

Aqua

 

Temporal resolution

Monthly

 

Spatial resolution

4km

 

Level 3 SMI product code

CHL_chlor_a

 

Point features

Fishnet4km

 

Field to receive the interpolated values

CHL

 

Date field

DATE

 

Error

RuntimeError: Failed to query the NASA OceanColor server at https://oceandata.sci.gsfc.nasa.gov/search/file_search.cgi. The query was retried for 300 seconds without 

success. Check that the server is operating properly and that your computer can connect to it. If necessary, contact the server's operator for assistance. 

If the server and network are operating properly, this problem could be a programming error in this tool. If you suspect one, contact the author of this tool for 

assistance. Error details: ServerNotFoundError: Unable to find the server at oceandata.sci.gsfc.nasa.gov

Failed script OceanColorLevel3SMITimeSeriesInterpolateAtArcGISPoints...

 

Traceback (most recent call last):

  File "C:\Program Files\GeoEco\ArcGISToolbox\Scripts\OceanColorLevel3SMITimeSeriesInterpolateAtArcGISPoints.py", line 5, in <module>

    ExecuteMethodFromCommandLineAsArcGISTool('GeoEco.DataProducts.NASA.OceanColor', 'OceanColorLevel3SMITimeSeries', 'InterpolateAtArcGISPoints')

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\ArcGISScripts.py", line 210, in ExecuteMethodFromCommandLineAsArcGISTool

    exec sourceCode in globals(), locals()

  File "<string>", line 1, in <module>

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NASA\OceanColor.py", line 610, in InterpolateAtArcGISPoints

    grid = cls(sensor, temporalResolution, spatialResolution, product, timeout, maxRetryTime, cacheDirectory)

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NASA\OceanColor.py", line 522, in __init__

    super(OceanColorLevel3SMITimeSeries, self).__init__(collection, _expression_=_expression_, reportProgress=False)

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\Datasets\Virtual.py", line 62, in __init__

    self._CachedOldestGrid = collection.GetOldestDataset(_expression_, **options)

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\Datasets\__init__.py", line 758, in GetOldestDataset

    dataset = self._GetOldestDataset(parsedExpression, options, parentAttrValues, dateTimeAttrName)

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NASA\OceanColor.py", line 157, in _GetOldestDataset

    return self._GetOldestOrNewestDataset(parsedExpression, options, False)

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NASA\OceanColor.py", line 167, in _GetOldestOrNewestDataset

    self._QueryServer()

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NASA\OceanColor.py", line 334, in _QueryServer

    raise RuntimeError(_(u'Failed to query the NASA OceanColor server at %(url)s. The query was retried for %(retry)i seconds without success. Check that the server is operating properly and that your computer can connect to it. If necessary, contact the server\'s operator for assistance. If the server and network are operating properly, this problem could be a programming error in this tool. If you suspect one, contact the author of this tool for assistance. Error details: %(e)s: %(msg)s') % {u'url': url, u'retry': self._MaxRetryTime, u'e': e.__class__.__name__, u'msg': UserPreferredEncodingToUnicode(e)})

RuntimeError: Failed to query the NASA OceanColor server at https://oceandata.sci.gsfc.nasa.gov/search/file_search.cgi. The query was retried for 300 seconds without success. Check that the server is operating properly and that your computer can connect to it. If necessary, contact the server's operator for assistance. If the server and network are operating properly, this problem could be a programming error in this tool. If you suspect one, contact the author of this tool for assistance. Error details: ServerNotFoundError: Unable to find the server at oceandata.sci.gsfc.nasa.gov

 

Failed to execute (OceanColorLevel3SMITimeSeriesInterpolateAtArcGISPoints).

Failed at Thu Feb 16 13:45:30 2017 (Elapsed Time: 5 minutes 39 seconds)

 

 


Rodrigo Tardin

Pós-doutorando - Departamento de Ecologia - IBRAG - UERJ

Pesquisador Associado - Laboratório de Bioacústica e Ecologia de Cetáceos - UFRRJ/ IF/ DCA

D.Sc. em Ecologia e Evolução - IBRAG - UERJ

-----

Post-doctoral fellow - Ecology department - IBRAG - UERJ (RJ, Brazil)

D.Sc. in Ecology and Evolution - UERJ

Associate scientist at Cetacean Bioacoustics and Ecology Lab - UFRRJ/ IF/ DCA

 

 

 

2017-02-08 16:43 GMT-02:00 Jason Roberts <>:

Hi Rodrigo,

 

The problem is that NOAA NODC recently changed their server to require https connections to retrieve the data. MGET 0.8a64 tries to use http connections. Please uninstall 0.8a64 and install 0.8a66 instead (download here). It will use https.

 

Best,

Jason

 

From: Rodrigo Tardin [mailto:]
Sent: Wednesday, February 8, 2017 1:24 PM
To: Jason Roberts <>
Cc:
Subject: Re: [mget-help] AVHRR Pathfinder Level 3 Monthly Daytime SST Version 5 on MGET

 

Thanks for the fast answer.

However, I still get an error when I try to interpolate the SST Pathfinder version 5 to points (Using the 'Interpolate AVHRR PathFinder v5.2 SST at Points' tool - I also tried v5.1 and v5.2 and it gave me the same error).

I have ArcGIS v10.3.1 and MGET v.08a64.

 

I am lost about the reason of the error and how to get the tool works. If you could help me I will appreciate. Below you will find the details about the error. 

 

Executing: AVHRRPathfinderSSTTimeSeriesInterpolateAtArcGISPoints Yearly Daytime sst "Baia de Sepetiba\Fishnet_4km_5_FeatureToPoint" SST DATE Nearest # # true 4 false false false false false false false false false false false 120 600 # # 256 128 128 1

Start Time: Wed Feb 08 15:44:54 2017

Running script AVHRRPathfinderSSTTimeSeriesInterpolateAtArcGISPoints...

Failed to download THREDDS catalog http://data.nodc.noaa.gov/thredds/catalog/pathfinder/Version5.0/Yearly/catalog.xml. The HTTP request failed with SSLError: [Errno 185090050] _ssl.c:344: error:0B084002:x509 certificate routines:X509_load_cert_crl_file:system lib. Retrying...

Still retrying; 0:05:28.922215 elapsed since the problem started...

Failed script AVHRRPathfinderSSTTimeSeriesInterpolateAtArcGISPoints...

 

Traceback (most recent call last):

  File "C:\Program Files\GeoEco\ArcGISToolbox\Scripts\AVHRRPathfinderSSTTimeSeriesInterpolateAtArcGISPoints.py", line 5, in <module>

    ExecuteMethodFromCommandLineAsArcGISTool('GeoEco.DataProducts.NOAA.NODC', 'AVHRRPathfinderSSTTimeSeries', 'InterpolateAtArcGISPoints')

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\ArcGISScripts.py", line 210, in ExecuteMethodFromCommandLineAsArcGISTool

    exec sourceCode in globals(), locals()

  File "<string>", line 1, in <module>

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NOAA\NODC.py", line 702, in InterpolateAtArcGISPoints

    grid = AVHRRPathfinderSSTTimeSeries(temporalResolution, observationTime, parameter, maskLand, minOverallQualityFlag, maskIfBrightnessTempTestFailed, maskIfCloudTestFailed, maskIfUniformityTest1Failed, maskIfUniformityTest2Failed, maskIfZenithAngleTest1Failed, maskIfZenithAngleTest2Failed, maskIfReferenceTestFailed, maskIfStraySunlightTestFailed, maskIfEdgeTestFailed, maskIfGlintTestFailed, maskIfSSTTestFailed, timeout, maxRetryTime, cacheDirectory)

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NOAA\NODC.py", line 518, in __init__

    grid = TimeSeriesGridStack(_PathfinderSSTOPeNDAPURLCollection(temporalResolution, observationTime, parameter, timeout, maxRetryTime, cacheDirectory), reportProgress=reportProgress)

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\Datasets\Virtual.py", line 62, in __init__

    self._CachedOldestGrid = collection.GetOldestDataset(_expression_, **options)

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NOAA\NODC.py", line 107, in GetOldestDataset

    self._CreateTHREDDSCatalogs()

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NOAA\NODC.py", line 396, in _CreateTHREDDSCatalogs

    self._Version50Years = self._Version50THREDDSCatalog._ListContents('')

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\Datasets\OPeNDAP.py", line 141, in _ListContents

    raise RuntimeError(_(u'Failed to download THREDDS catalog from URL %(catalogURL)s. The download was retried for %(retry)i seconds without success. Verify that the URL is correct. If it is, check that the server is operating properly and that your computer can connect to it. If necessary, contact the server\'s operator for assistance. Error details: %(e)s: %(msg)s') % {u'catalogURL': catalogURL, u'retry': self._MaxRetryTime, u'e': e.__class__.__name__, u'msg': self._Unicode(e)})

RuntimeError: Failed to download THREDDS catalog from URL http://data.nodc.noaa.gov/thredds/catalog/pathfinder/Version5.0/Yearly/catalog.xml. The download was retried for 600 seconds without success. Verify that the URL is correct. If it is, check that the server is operating properly and that your computer can connect to it. If necessary, contact the server's operator for assistance. Error details: SSLError: [Errno 185090050] _ssl.c:344: error:0B084002:x509 certificate routines:X509_load_cert_crl_file:system lib

 

Failed to execute (AVHRRPathfinderSSTTimeSeriesInterpolateAtArcGISPoints).

Failed at Wed Feb 08 15:55:17 2017 (Elapsed Time: 10 minutes 23 seconds)

 

Thank you,

Rodrigo


Rodrigo Tardin

Pós-doutorando - Departamento de Ecologia - IBRAG - UERJ

Pesquisador Associado - Laboratório de Bioacústica e Ecologia de Cetáceos - UFRRJ/ IF/ DCA

D.Sc. em Ecologia e Evolução - IBRAG - UERJ

-----

Post-doctoral fellow - Ecology department - IBRAG - UERJ (RJ, Brazil)

D.Sc. in Ecology and Evolution - UERJ

Associate scientist at Cetacean Bioacoustics and Ecology Lab - UFRRJ/ IF/ DCA

 

 

 

2017-02-08 15:40 GMT-02:00 Jason Roberts <>:

Dear Rodrigo,

 

In the MGET toolbox, please check under Data Products, NOAA National Oceanographic Data Center, 4km AVHRR Pathfinder Version 5.0 and 5.1 SST. There are tools here for Pathfinder Version 5 and 5.1.

 

Best,

 

Jason

 

From: [mailto:] On Behalf Of Rodrigo Tardin
Sent: Wednesday, February 8, 2017 9:39 AM
To:
Subject: [mget-help] AVHRR Pathfinder Level 3 Monthly Daytime SST Version 5 on MGET

 

Dear Jason,

 

I have 4km-grid and I would like to interpolate the 'AVHRR Pathfinder Level 3 Monthly Daytime SST' Version 5 on MGET using the 'Create Climatological Rasters for GHRSST' toolbox. However, when I looked at the list I did not find this product. Is it available elsewhere on the MGET toolbox or it was not implemented yet?

 

Thanks in advance,

Rodrigo

 


Rodrigo Tardin

Pós-doutorando - Departamento de Ecologia - IBRAG - UERJ

Pesquisador Associado - Laboratório de Bioacústica e Ecologia de Cetáceos - UFRRJ/ IF/ DCA

D.Sc. em Ecologia e Evolução - IBRAG - UERJ

-----

Post-doctoral fellow - Ecology department - IBRAG - UERJ (RJ, Brazil)

D.Sc. in Ecology and Evolution - UERJ

Associate scientist at Cetacean Bioacoustics and Ecology Lab - UFRRJ/ IF/ DCA

 

 

 

 




Archive powered by MHonArc 2.6.19.

Top of Page