Subject: Marine Geospatial Ecology Tools (MGET) help
Text archives
- From: "George N. White III" <>
- To:
- Cc: Raul Valente <>
- Subject: Re: [mget-help] Error messages running MGET tools
- Date: Sat, 27 Feb 2021 17:16:56 -0400
- Authentication-results: mail-gw.oit.duke.edu; spf=pass ; dkim=pass header.s=20161025 header.d=gmail.com; dmarc=pass header.from=gmail.com
Dear Jason and MGET team,I am writing to request support in the use of the MGET tools for ArcGIS.I am trying to run the Data Products tools and I am having several problems. It seems that there are some issues in accessing data. I only managed to extract some records of CHL (for the OceanColor SMI Product), but then it retrieved an error and it was not successful in extracting the data for all the points.I am attaching a word document with the errors and print screens. Could you provide some assistance and tell me how to get around these issues?
NASA now requires an EarthData login to download OceanColor products, if you haven't already done so, you need to register for an EarthData login. New reprocessings will use new filename conventions. Many download workflows have problems with the Single-SignOn (SSO) system NASA uses, so it may be necessary to download the files outside MGET and arrange for MGET to use local files. The NASA Ocean Color Forum had details, but is currently in the process of being transferred to the EarthData forum (for which your SSO login can be used). I'm copying the text of a relevant announcements as they have not appeared on the EarthData forum:
Thank you for your continued support of the OceanColor Forum, but times
they are a changin’. On March 1, 2021, we will transition to the
Earthdata Forum (https://forum.earthdata.nasa.gov/)
for new posts. While the OceanColor Forum will remain accessible for
historical knowledge and reference, users should rely on the Earthdata
Forum for latest announcements and active user support.
To ease the transition, many (but not all) of the posts on the OceanColor Forum will transferred to the Earthdata Forum. Posts to be transferred are those that were made after this forum transitioned to using Earthdata Login for user accounts. The good news is that if you already have an Earthdata Login account, you'll have ready access to Earthdata Forum, as part of the transition will include an import the accounts associated with the OceanColor Forum to the Earthdata Forum.
While we recommend you continue to post to the OceanColor Forum until the transition on 01 March 2021, please take time between now and then to explore Earthdata Forum, as it is a bit different in organizational structure.
Regards,
Sean
To ease the transition, many (but not all) of the posts on the OceanColor Forum will transferred to the Earthdata Forum. Posts to be transferred are those that were made after this forum transitioned to using Earthdata Login for user accounts. The good news is that if you already have an Earthdata Login account, you'll have ready access to Earthdata Forum, as part of the transition will include an import the accounts associated with the OceanColor Forum to the Earthdata Forum.
While we recommend you continue to post to the OceanColor Forum until the transition on 01 March 2021, please take time between now and then to explore Earthdata Forum, as it is a bit different in organizational structure.
Regards,
Sean
To our OceanColor community,
The Ocean Biology Processing Group (OBPG) and the Ocean Biology Distributed
Active Archive Center (OB.DAAC) would like to inform you of a few changes
coming over the next few weeks to months. These include:
1) Updated file naming convention (this announcement)
2) SST reprocessing (this announcement)
3) Data subscription reconfirmation (details to be provided in November)
4) EarthData Login requirement for data downloads (details to be provided in November)
1) Updated File Naming Convention
Our current file naming convention was defined over two decades ago with a
single mission in mind (SeaWiFS). As we took on responsibility for more
missions, we adapted as best we could to the SeaWiFS convention. Due to the
constraints of the original convention, not all missions were able to fit the
convention nicely, so inconsistencies arose. With each new mission, we
struggled with how to fit it into this legacy convention. We realized it was
time to redefine the convention. This change may be jarring to some, but the
consistency achieved is something we have long needed.
A couple examples of the change:
old: S2003244181700.L2.OC.nc
new: SEASTAR_SEAWIFS_GAC.20030901T181700.L2.OC.nc
old: A2002191053500.L2_LAC_SST.nc
new: AQUA_MODIS.20020710T053506.L2.SST.nc
Details about this new naming convention are available at:
https://oceancolor.gsfc.nasa.gov/docs/filenaming-convention/
The new naming convention will be applied to each mission/data set as it is
reprocessed by the Ocean Biology Processing Group. The first data set to get
the new scheme will be the SST data sets for MODIS (Aqua and Terra) and SNPP
VIIRS.
Speaking of SST reprocessing...
2) SST reprocessing
We will be initiating a reprocessing for MODIS (Aqua and Terra) and SNPP VIIRS
SST beginning on 28 October 2019. The SNPP VIIRS mission will be reprocessed
first, followed by Aqua MODIS and finally Terra MODIS.
R2016.2
The SNPP VIIRS SST reprocessing is primarily to bring consistency to the full
mission. In mid-2018, a minor update to the VIIRS SST processing was
introduced in the forward stream. This reprocessing will apply those changes
to the full mission, as well as introduce the use of the GHRSST CMC (Canadian
Meteorological Center) Global Foundation Sea Surface Temperature product as
the reference SST.
https://oceancolor.gsfc.nasa.gov/reprocessing/r2016/sst/
R2019.0
The SST products for the MODIS sensors on both the Aqua and Terra platforms
will be reprocessed to incorporate a revised cloud classification scheme based
on the theory of Alternating Decision Trees (ADtree) developed by Freund and
Mason 1999 and modified by Pfahringer et. al. 2000. This methodology has been
in use for the VIIRS-SNPP SST product since R2016.0.
Additionally, a correction for atmospheric dust aerosol contaminated nighttime
data based on the work of Luo et al., (2019) has been implemented and, as with
the VIIRS reprocessing, the use of the CMC reference SST will be included.
https://oceancolor.gsfc.nasa.gov/reprocessing/r2019/sst/
Stay tuned for another message to be sent next month describing the changes to
the data subscription service and explaining the EarthData Login requirement
for data downloads.
Regards,
Sean
The Ocean Biology Processing Group (OBPG) and the Ocean Biology Distributed
Active Archive Center (OB.DAAC) would like to inform you of a few changes
coming over the next few weeks to months. These include:
1) Updated file naming convention (this announcement)
2) SST reprocessing (this announcement)
3) Data subscription reconfirmation (details to be provided in November)
4) EarthData Login requirement for data downloads (details to be provided in November)
1) Updated File Naming Convention
Our current file naming convention was defined over two decades ago with a
single mission in mind (SeaWiFS). As we took on responsibility for more
missions, we adapted as best we could to the SeaWiFS convention. Due to the
constraints of the original convention, not all missions were able to fit the
convention nicely, so inconsistencies arose. With each new mission, we
struggled with how to fit it into this legacy convention. We realized it was
time to redefine the convention. This change may be jarring to some, but the
consistency achieved is something we have long needed.
A couple examples of the change:
old: S2003244181700.L2.OC.nc
new: SEASTAR_SEAWIFS_GAC.20030901T181700.L2.OC.nc
old: A2002191053500.L2_LAC_SST.nc
new: AQUA_MODIS.20020710T053506.L2.SST.nc
Details about this new naming convention are available at:
https://oceancolor.gsfc.nasa.gov/docs/filenaming-convention/
The new naming convention will be applied to each mission/data set as it is
reprocessed by the Ocean Biology Processing Group. The first data set to get
the new scheme will be the SST data sets for MODIS (Aqua and Terra) and SNPP
VIIRS.
Speaking of SST reprocessing...
2) SST reprocessing
We will be initiating a reprocessing for MODIS (Aqua and Terra) and SNPP VIIRS
SST beginning on 28 October 2019. The SNPP VIIRS mission will be reprocessed
first, followed by Aqua MODIS and finally Terra MODIS.
R2016.2
The SNPP VIIRS SST reprocessing is primarily to bring consistency to the full
mission. In mid-2018, a minor update to the VIIRS SST processing was
introduced in the forward stream. This reprocessing will apply those changes
to the full mission, as well as introduce the use of the GHRSST CMC (Canadian
Meteorological Center) Global Foundation Sea Surface Temperature product as
the reference SST.
https://oceancolor.gsfc.nasa.gov/reprocessing/r2016/sst/
R2019.0
The SST products for the MODIS sensors on both the Aqua and Terra platforms
will be reprocessed to incorporate a revised cloud classification scheme based
on the theory of Alternating Decision Trees (ADtree) developed by Freund and
Mason 1999 and modified by Pfahringer et. al. 2000. This methodology has been
in use for the VIIRS-SNPP SST product since R2016.0.
Additionally, a correction for atmospheric dust aerosol contaminated nighttime
data based on the work of Luo et al., (2019) has been implemented and, as with
the VIIRS reprocessing, the use of the CMC reference SST will be included.
https://oceancolor.gsfc.nasa.gov/reprocessing/r2019/sst/
Stay tuned for another message to be sent next month describing the changes to
the data subscription service and explaining the EarthData Login requirement
for data downloads.
Regards,
Sean
To unsubscribe from this list, visit: https://lists.nicholas.duke.edu/sympa/ca/initiate_unsubscribe/mget-help/gnwiii%40gmail.comThank you in advance.Best regards,Raul Valente
--
George N. White III
- [mget-help] Error messages running MGET tools, Raul Valente, 02/27/2021
- Re: [mget-help] Error messages running MGET tools, George N. White III, 02/27/2021
- RE: [mget-help] Error messages running MGET tools, Jason Roberts, 02/27/2021
- Re: [mget-help] Error messages running MGET tools, Raul Valente, 02/28/2021
- RE: [mget-help] Error messages running MGET tools, Jason Roberts, 02/27/2021
- Re: [mget-help] Error messages running MGET tools, George N. White III, 02/27/2021
Archive powered by MHonArc 2.6.19.