Skip to Content.

mget-help - Re: [mget-help] AVHRR Pathfinder Level 3 Monthly Daytime SST Version 5 on MGET

Please Wait...

Subject: Marine Geospatial Ecology Tools (MGET) help

Text archives


Re: [mget-help] AVHRR Pathfinder Level 3 Monthly Daytime SST Version 5 on MGET


Chronological Thread 
    < Chronological >      < Thread >
  • From: Rodrigo Tardin <>
  • To: Jason Roberts <>
  • Cc: "" <>
  • Subject: Re: [mget-help] AVHRR Pathfinder Level 3 Monthly Daytime SST Version 5 on MGET
  • Date: Thu, 16 Feb 2017 15:40:02 -0200
  • Authentication-results: oit.duke.edu; spf=pass
Thank you very much Jason!
It worked prefectly well for SST! However I did not have the same luck for Chlorophyl MODIS Aqua 4km. The error I get it seems problems in internet conection, but this is not true since the internet is working fine (tried different websites and tools from ArcGIS that uses internet). When I try to mannualy enter at the website it says I can't have access too.
Would you have a clue on what's going on?

Thank you very much,
---

A summary for what I did on ArcGIS
Interpolate NASA OceanColor L3 SMI Product at Points
Sensor
Aqua

Temporal resolution
Monthly

Spatial resolution
4km

Level 3 SMI product code
CHL_chlor_a

Point features
Fishnet4km

Field to receive the interpolated values
CHL

Date field
DATE

Error
RuntimeError: Failed to query the NASA OceanColor server at https://oceandata.sci.gsfc.nasa.gov/search/file_search.cgi. The query was retried for 300 seconds without 
success. Check that the server is operating properly and that your computer can connect to it. If necessary, contact the server's operator for assistance. 
If the server and network are operating properly, this problem could be a programming error in this tool. If you suspect one, contact the author of this tool for 
assistance. Error details: ServerNotFoundError: Unable to find the server at oceandata.sci.gsfc.nasa.gov
Failed script OceanColorLevel3SMITimeSeriesInterpolateAtArcGISPoints...

Traceback (most recent call last):
  File "C:\Program Files\GeoEco\ArcGISToolbox\Scripts\OceanColorLevel3SMITimeSeriesInterpolateAtArcGISPoints.py", line 5, in <module>
    ExecuteMethodFromCommandLineAsArcGISTool('GeoEco.DataProducts.NASA.OceanColor', 'OceanColorLevel3SMITimeSeries', 'InterpolateAtArcGISPoints')
  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\ArcGISScripts.py", line 210, in ExecuteMethodFromCommandLineAsArcGISTool
    exec sourceCode in globals(), locals()
  File "<string>", line 1, in <module>
  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NASA\OceanColor.py", line 610, in InterpolateAtArcGISPoints
    grid = cls(sensor, temporalResolution, spatialResolution, product, timeout, maxRetryTime, cacheDirectory)
  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NASA\OceanColor.py", line 522, in __init__
    super(OceanColorLevel3SMITimeSeries, self).__init__(collection, _expression_=_expression_, reportProgress=False)
  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\Datasets\Virtual.py", line 62, in __init__
    self._CachedOldestGrid = collection.GetOldestDataset(_expression_, **options)
  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\Datasets\__init__.py", line 758, in GetOldestDataset
    dataset = self._GetOldestDataset(parsedExpression, options, parentAttrValues, dateTimeAttrName)
  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NASA\OceanColor.py", line 157, in _GetOldestDataset
    return self._GetOldestOrNewestDataset(parsedExpression, options, False)
  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NASA\OceanColor.py", line 167, in _GetOldestOrNewestDataset
    self._QueryServer()
  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NASA\OceanColor.py", line 334, in _QueryServer
    raise RuntimeError(_(u'Failed to query the NASA OceanColor server at %(url)s. The query was retried for %(retry)i seconds without success. Check that the server is operating properly and that your computer can connect to it. If necessary, contact the server\'s operator for assistance. If the server and network are operating properly, this problem could be a programming error in this tool. If you suspect one, contact the author of this tool for assistance. Error details: %(e)s: %(msg)s') % {u'url': url, u'retry': self._MaxRetryTime, u'e': e.__class__.__name__, u'msg': UserPreferredEncodingToUnicode(e)})
RuntimeError: Failed to query the NASA OceanColor server at https://oceandata.sci.gsfc.nasa.gov/search/file_search.cgi. The query was retried for 300 seconds without success. Check that the server is operating properly and that your computer can connect to it. If necessary, contact the server's operator for assistance. If the server and network are operating properly, this problem could be a programming error in this tool. If you suspect one, contact the author of this tool for assistance. Error details: ServerNotFoundError: Unable to find the server at oceandata.sci.gsfc.nasa.gov

Failed to execute (OceanColorLevel3SMITimeSeriesInterpolateAtArcGISPoints).
Failed at Thu Feb 16 13:45:30 2017 (Elapsed Time: 5 minutes 39 seconds)



Rodrigo Tardin

Pós-doutorando - Departamento de Ecologia - IBRAG - UERJ
Pesquisador Associado - Laboratório de Bioacústica e Ecologia de Cetáceos - UFRRJ/ IF/ DCA
D.Sc. em Ecologia e Evolução - IBRAG - UERJ
-----
Post-doctoral fellow - Ecology department - IBRAG - UERJ (RJ, Brazil)
D.Sc. in Ecology and Evolution - UERJ
Associate scientist at Cetacean Bioacoustics and Ecology Lab - UFRRJ/ IF/ DCA



2017-02-08 16:43 GMT-02:00 Jason Roberts <>:

Hi Rodrigo,

 

The problem is that NOAA NODC recently changed their server to require https connections to retrieve the data. MGET 0.8a64 tries to use http connections. Please uninstall 0.8a64 and install 0.8a66 instead (download here). It will use https.

 

Best,

Jason

 

From: Rodrigo Tardin [mailto:]
Sent: Wednesday, February 8, 2017 1:24 PM
To: Jason Roberts <>
Cc:
Subject: Re: [mget-help] AVHRR Pathfinder Level 3 Monthly Daytime SST Version 5 on MGET

 

Thanks for the fast answer.

However, I still get an error when I try to interpolate the SST Pathfinder version 5 to points (Using the 'Interpolate AVHRR PathFinder v5.2 SST at Points' tool - I also tried v5.1 and v5.2 and it gave me the same error).

I have ArcGIS v10.3.1 and MGET v.08a64.

 

I am lost about the reason of the error and how to get the tool works. If you could help me I will appreciate. Below you will find the details about the error. 

 

Executing: AVHRRPathfinderSSTTimeSeriesInterpolateAtArcGISPoints Yearly Daytime sst "Baia de Sepetiba\Fishnet_4km_5_FeatureToPoint" SST DATE Nearest # # true 4 false false false false false false false false false false false 120 600 # # 256 128 128 1

Start Time: Wed Feb 08 15:44:54 2017

Running script AVHRRPathfinderSSTTimeSeriesInterpolateAtArcGISPoints...

Failed to download THREDDS catalog http://data.nodc.noaa.gov/thredds/catalog/pathfinder/Version5.0/Yearly/catalog.xml. The HTTP request failed with SSLError: [Errno 185090050] _ssl.c:344: error:0B084002:x509 certificate routines:X509_load_cert_crl_file:system lib. Retrying...

Still retrying; 0:05:28.922215 elapsed since the problem started...

Failed script AVHRRPathfinderSSTTimeSeriesInterpolateAtArcGISPoints...

 

Traceback (most recent call last):

  File "C:\Program Files\GeoEco\ArcGISToolbox\Scripts\AVHRRPathfinderSSTTimeSeriesInterpolateAtArcGISPoints.py", line 5, in <module>

    ExecuteMethodFromCommandLineAsArcGISTool('GeoEco.DataProducts.NOAA.NODC', 'AVHRRPathfinderSSTTimeSeries', 'InterpolateAtArcGISPoints')

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\ArcGISScripts.py", line 210, in ExecuteMethodFromCommandLineAsArcGISTool

    exec sourceCode in globals(), locals()

  File "<string>", line 1, in <module>

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NOAA\NODC.py", line 702, in InterpolateAtArcGISPoints

    grid = AVHRRPathfinderSSTTimeSeries(temporalResolution, observationTime, parameter, maskLand, minOverallQualityFlag, maskIfBrightnessTempTestFailed, maskIfCloudTestFailed, maskIfUniformityTest1Failed, maskIfUniformityTest2Failed, maskIfZenithAngleTest1Failed, maskIfZenithAngleTest2Failed, maskIfReferenceTestFailed, maskIfStraySunlightTestFailed, maskIfEdgeTestFailed, maskIfGlintTestFailed, maskIfSSTTestFailed, timeout, maxRetryTime, cacheDirectory)

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NOAA\NODC.py", line 518, in __init__

    grid = TimeSeriesGridStack(_PathfinderSSTOPeNDAPURLCollection(temporalResolution, observationTime, parameter, timeout, maxRetryTime, cacheDirectory), reportProgress=reportProgress)

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\Datasets\Virtual.py", line 62, in __init__

    self._CachedOldestGrid = collection.GetOldestDataset(_expression_, **options)

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NOAA\NODC.py", line 107, in GetOldestDataset

    self._CreateTHREDDSCatalogs()

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\DataProducts\NOAA\NODC.py", line 396, in _CreateTHREDDSCatalogs

    self._Version50Years = self._Version50THREDDSCatalog._ListContents('')

  File "C:\Python27\ArcGIS10.3\lib\site-packages\GeoEco\Datasets\OPeNDAP.py", line 141, in _ListContents

    raise RuntimeError(_(u'Failed to download THREDDS catalog from URL %(catalogURL)s. The download was retried for %(retry)i seconds without success. Verify that the URL is correct. If it is, check that the server is operating properly and that your computer can connect to it. If necessary, contact the server\'s operator for assistance. Error details: %(e)s: %(msg)s') % {u'catalogURL': catalogURL, u'retry': self._MaxRetryTime, u'e': e.__class__.__name__, u'msg': self._Unicode(e)})

RuntimeError: Failed to download THREDDS catalog from URL http://data.nodc.noaa.gov/thredds/catalog/pathfinder/Version5.0/Yearly/catalog.xml. The download was retried for 600 seconds without success. Verify that the URL is correct. If it is, check that the server is operating properly and that your computer can connect to it. If necessary, contact the server's operator for assistance. Error details: SSLError: [Errno 185090050] _ssl.c:344: error:0B084002:x509 certificate routines:X509_load_cert_crl_file:system lib

 

Failed to execute (AVHRRPathfinderSSTTimeSeriesInterpolateAtArcGISPoints).

Failed at Wed Feb 08 15:55:17 2017 (Elapsed Time: 10 minutes 23 seconds)

 

Thank you,

Rodrigo


Rodrigo Tardin

Pós-doutorando - Departamento de Ecologia - IBRAG - UERJ

Pesquisador Associado - Laboratório de Bioacústica e Ecologia de Cetáceos - UFRRJ/ IF/ DCA

D.Sc. em Ecologia e Evolução - IBRAG - UERJ

-----

Post-doctoral fellow - Ecology department - IBRAG - UERJ (RJ, Brazil)

D.Sc. in Ecology and Evolution - UERJ

Associate scientist at Cetacean Bioacoustics and Ecology Lab - UFRRJ/ IF/ DCA

 

 

 

2017-02-08 15:40 GMT-02:00 Jason Roberts <>:

Dear Rodrigo,

 

In the MGET toolbox, please check under Data Products, NOAA National Oceanographic Data Center, 4km AVHRR Pathfinder Version 5.0 and 5.1 SST. There are tools here for Pathfinder Version 5 and 5.1.

 

Best,

 

Jason

 

From: [mailto:] On Behalf Of Rodrigo Tardin
Sent: Wednesday, February 8, 2017 9:39 AM
To:
Subject: [mget-help] AVHRR Pathfinder Level 3 Monthly Daytime SST Version 5 on MGET

 

Dear Jason,

 

I have 4km-grid and I would like to interpolate the 'AVHRR Pathfinder Level 3 Monthly Daytime SST' Version 5 on MGET using the 'Create Climatological Rasters for GHRSST' toolbox. However, when I looked at the list I did not find this product. Is it available elsewhere on the MGET toolbox or it was not implemented yet?

 

Thanks in advance,

Rodrigo

 


Rodrigo Tardin

Pós-doutorando - Departamento de Ecologia - IBRAG - UERJ

Pesquisador Associado - Laboratório de Bioacústica e Ecologia de Cetáceos - UFRRJ/ IF/ DCA

D.Sc. em Ecologia e Evolução - IBRAG - UERJ

-----

Post-doctoral fellow - Ecology department - IBRAG - UERJ (RJ, Brazil)

D.Sc. in Ecology and Evolution - UERJ

Associate scientist at Cetacean Bioacoustics and Ecology Lab - UFRRJ/ IF/ DCA

 

 

 



Archive powered by MHonArc 2.6.19.

Top of Page