Skip to Content.

mget-help - RE: [mget-help] Error message using MGET tool

Please Wait...

Subject: Marine Geospatial Ecology Tools (MGET) help

Text archives


RE: [mget-help] Error message using MGET tool


Chronological Thread 
    < Chronological >      < Thread >
  • From: Jason Roberts <>
  • To: Fabio Ronchetti <>
  • Cc: "" <>
  • Subject: RE: [mget-help] Error message using MGET tool
  • Date: Thu, 8 Apr 2021 13:08:00 +0000
  • Accept-language: en-US
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=duke.edu; dmarc=pass action=none header.from=duke.edu; dkim=pass header.d=duke.edu; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=PO7ypSd5mCwJ0utOeASqk2Cc4Lbhz63hozVSiE/yRc4=; b=ieUfMjbLqInG5n4BtCV8DUabMcDDRy59TzALCLSiOYfRO9qntJLUxG2NGcFgZUzJEKH4HdqvLcNMxafCAgYRgKj/o5vmAWHf1tZtJLj8MLQZcNVDg7vtlJO3lBLDGkIGqs6ICsHRtZOAfl8SVwYUUylVyKtK/lKnPUb6GZMzraZQBFNArIYLe2Ya3j8MU6KtevxL4YUkntdukaksBHIlz6iCmxwiD9OQrIqK9LHvrWg8PJz3/fSo8o+0bXXgbMKkjFzOVfhKFF462SqsDBHgTTHrKsO8rfF9C3XejMK58vPoi94P1Hdl/FDFxj0R06+YzPdNsJgKhRRvWNSmmZjNNw==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=kqMg/XY0J9zMZQZYlg6Ctem2+LKkWYBvsMPYvNc44uaO+Lojsj7wUV5BEx7ZUmCAHpIHCgcoIRpA9rMA0uaOfrVU/mhpaAo4KK3QGtCp4xdFgW1nWvaOSBBPKK+8cQTx3ou7hK4nT2zlW9VdxxlpNuDydJZHwxOnAj2mTBnY9eNvbphNfSLkhQqngPxF7O7XCRYbHNGvrP1H+oPayjSYh7HJmDDzf2JLrzONbCg5SxfeDHy8p3aG8qfngnNNfvQP8CTELaowX2bW1hr3xMCfsxhSDMVy1JQTXz0cZ3eKsyAHgAxeixYPsz5spfElbHUzTle9E8OFAu/XkUT7ej2bSQ==
  • Authentication-results: gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=duke.edu;

Thanks, Fabio. This was indeed the problem and I have also been testing it with good success. I’ll roll this into the next build of MGET, 0.8a75. There should be no harm in you continuing to use your patched version.

 

Good luck with your analysis,

 

Jason

 

From: Fabio Ronchetti <>
Sent: Thursday, April 8, 2021 6:05 AM
To: Jason Roberts <>
Cc:
Subject: Re: [mget-help] Error message using MGET tool

 

Hi Jason,

I'm very grateful for your answer and the time you spent to provide all the necessary information and details.

The solution you provided is working! I've tried different products and it seems all ok. Thanks a lot.

Best regards,

Fabio

 

 

Dear Fabio,

 

Thanks for reporting this. I can reproduce the problem with ArcGIS 10.8 and the latest version of MGET.

 

It looks like NASA PO.DAAC reissued their server’s SSL certificate on 31 March. I suspect this is why it was working up until very recently. We ourselves were using this tool as recently as three weeks ago with no problem.

 

Internally, MGET uses a Python library called httplib2 to interact with web servers. httplib2 maintains a list of Certificate Authorities it trusts; in MGET’s copy of httplib2 these appear in C:\Python27\ArcGIS10.8\Lib\site-packages\GeoEco\httplib2\cacerts.txt. When this problem has happened in the past (SSLHandshakeError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed), it was because the server MGET was accessing began using a certificate that was ultimately tracible to a root CA that was not listed in httplib2’s cacerts.txt file. To fix it, we had to update the cacerts.txt file with an entry to the new root CA.

 

I’m going to investigate this further to see if that is the correct problem and solution here. If it is, I will probably take the opportunity to switch MGET over to use Mozilla’s store of root CAs. You can find a convenient and fairly authoritative copy of it rendered in the necessary format at https://curl.se/docs/caextract.html. If this is the right solution (which I’m not sure of yet) then you can probably patch your own installation by doing this:

 

  1. Close all ArcGIS programs
  2. Make a backup copy of C:\Python27\ArcGIS10.8\Lib\site-packages\GeoEco\httplib2\cacerts.txt
  3. Download the cacert.pem file referenced at the top of the curl.se link I mentioned above. Overwrite C:\Python27\ArcGIS10.8\Lib\site-packages\GeoEco\httplib2\cacerts.txt with that file (changing the name from cacert.pem to cacerts.txt).
  4. Start ArcGIS and try the MGET tool again. MGET’s copy of httplib2 will now use the new list of root certificates. If PO.DAAC’s new certificate descends from one of those, it will now be trusted.

 

I’ll let you know after I have a chance to look into this more.

 

Best,

Jason

 

 

Dear Jason and MGET team,

I am writing to request support in the use of the MGET tools for ArcGIS.

I'm running the Data Products tools to create a climatological raster for studying bottlenose dolphins. I'm using AVHRR_OI-NCEI-L4-GLOB-v2.0 to download SST. Everything was working fine until 3 days ago when I started to receive an error. Independently by the product that I'm going to select this is the message:

Failed to download THREDDS catalog https://opendap.jpl.nasa.gov/opendap/allData/ghrsst/data/GDS2/L4/catalog.xml. The HTTP request failed with SSLHandshakeError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:727).

 

I use Window 10 Home version 20H2, ArcGIS 10.8 and the last version of your tool (wonderful tool!). I've tried to manage this problem in my OS changing some settings about SSL/TSL with no success. I've tried also to cancel the update of the OS of these last days.

I am attaching txt file with the complete message. Could you provide some help? Any assistance is really appreciated because I do not have any idea how to get around this issue.

Best regards,


Archive powered by MHonArc 2.6.19.

Top of Page