Subject: Marine Geospatial Ecology Tools (MGET) help
Text archives
From: | "Jason Roberts" <> |
---|---|
To: | <> |
Cc: | <> |
Subject: | RE: [mget-help] Help Downloading HYCOM data- array error |
Date: | Sat, 27 Aug 2011 13:33:26 -0400 |
Nathan,
It turns out that the data you want to access is affected by the HYCOM
service outage. The HYCOM website does say that "forecast data has been
restored" for the GOMl0.04/expt_30.1 dataset and that dataset is supposed to
extend back to 1 January 2011, but it turns out that it currently contains
data only for 8 August 2011 and later. I suspect their disk outage affected
all of their datasets and so far they have only been able to bring the real
time forcasting capability online. I don't know the details of the failure,
but if it was a major problem then it might take them some time to bring the
whole archive online. The hurricane is probably not helping them move
quickly.
I have some contacts in HYCOM. Would you like me to inquire with them about
the status?
Jason
-----Original Message-----
From: Jason Roberts
[mailto:]
Sent: Friday, August 26, 2011 12:37 PM
To:
''
Cc:
''
Subject: RE: [mget-help] Help Downloading HYCOM data- array error
Hi Nathan,
I'm sorry you're seeing this problem. I reproduced it on my own installation
using the latest released version of MGET. I'm not sure yet whether it is a
bug in MGET, a problem with the HYCOM server, or something else. As you
noted, HYCOM had a major disk array failure the other day that took many of
their products offline. That could be the culprit. But if it was, the tool
should have failed at an earlier stage. (The tools that access the global
HYCOM dataset do indeed fail at an earlier stage.)
I'll investigate more and get back to you shortly...
Jason
-----Original Message-----
From:
[mailto:]
Sent: Friday, August 26, 2011 12:03 PM
To:
Subject: [mget-help] Help Downloading HYCOM data- array error
Dear MGET Help,
First of all, thank you for providing such a wonderful set of tools!
I am new to MGET, but am having issues downloading HYCOM data (any of the
'create raster' within the 'HYCOM consortium' tools). Specifically, I have
tried downloading Gulf of Mexico data, either 3D or 4D data. I have posted
all
output below (please let me know if there is other output needed).
The error I get continuously (regardless of variable selected) is
"ValueError:
total size of new array must be unchanged
<type 'exceptions.ValueError'>: total size of new array must be unchanged."
I also realize that HYCOM's server is having issues currently, but I have
selected (or at least I think) datasets and times that match what is
currently
working on the HYCOM site. Thank you so much for your help.
Sincerely,
-Nathan
Executing: HYCOMGOMl0043DCreateClimatologicalArcGISRasters ssh Mean Monthly
C:\GIS_data\HYCOM_2 Add
%(VariableName)s;%(ClimatologyBinType)s_Climatology;%(VariableName)s_%(Clima
tologyBinName)s_%(Statistic)s.img
1 1 # Degrees 2/1/2011 5/1/2011 600 # # true false C:\GIS_data\HYCOM_2
Start Time: Fri Aug 26 11:00:04 2011
Running script HYCOMGOMl0043DCreateClimatologicalArcGISRasters...
The HYCOM OPeNDAP server often requires five to ten minutes to return the
data
required to create the first raster. Please be patient. After the first one
is
created, the rest will go much faster. Because the first raster takes so
long,
the first status report may estimate an absurdly long time to completion.
Please wait for the second status report, issued five minutes after the
first
one, for a better estimate. This tool cannot be cancelled until the first
raster is created. If this tool fails with to a timeout error, increase the
timeout value and try again.
Querying monthly climatological mean of the ssh grid of the HYCOM + NCODA
Gulf
of Mexico 1/25 degree Analysis (GOMl0.04), clipped to indices tMin = 31,
tMax =
120.
No data is available to create the January climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
No data is available to create the June climatological mean of the ssh grid
of
the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped to
indices tMin = 31, tMax = 120.
No data is available to create the July climatological mean of the ssh grid
of
the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped to
indices tMin = 31, tMax = 120.
No data is available to create the August climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
No data is available to create the September climatological mean of the ssh
grid of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04),
clipped to indices tMin = 31, tMax = 120.
No data is available to create the October climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
No data is available to create the November climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
No data is available to create the December climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
Query complete: 0:00:00 elapsed, 4 datasets found, 0:00:00.028750 per
dataset.
Importing 4 datasets into ArcGIS Folder C:\GIS_data\HYCOM_2 with mode "add".
Checking for existing destination datasets.
Finished checking: 0:00:00 elapsed, 4 datasets checked, 0:00:00.000250 per
dataset.
0 destination datasets already exist. Importing 4 datasets.
Aggregating 28 grids to create the February climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
Aggregation stopped before all grids were aggregated: 0:00:11 elapsed, 0
grids
aggregated, 0:00:00 per grid, 28 not aggregated.
Import stopped before all datasets were imported: 0:00:11 elapsed, 0
datasets
imported, 0:00:00 per dataset, 4 datasets not imported.
ValueError: total size of new array must be unchanged
<type 'exceptions.ValueError'>: total size of new array must be unchanged
Failed to execute (HYCOMGOMl0043DCreateClimatologicalArcGISRasters).
End Time: Fri Aug 26 11:00:16 2011 (Elapsed Time: 12.00 seconds)
It turns out that the data you want to access is affected by the HYCOM
service outage. The HYCOM website does say that "forecast data has been
restored" for the GOMl0.04/expt_30.1 dataset and that dataset is supposed to
extend back to 1 January 2011, but it turns out that it currently contains
data only for 8 August 2011 and later. I suspect their disk outage affected
all of their datasets and so far they have only been able to bring the real
time forcasting capability online. I don't know the details of the failure,
but if it was a major problem then it might take them some time to bring the
whole archive online. The hurricane is probably not helping them move
quickly.
I have some contacts in HYCOM. Would you like me to inquire with them about
the status?
Jason
-----Original Message-----
From: Jason Roberts
[mailto:]
Sent: Friday, August 26, 2011 12:37 PM
To:
''
Cc:
''
Subject: RE: [mget-help] Help Downloading HYCOM data- array error
Hi Nathan,
I'm sorry you're seeing this problem. I reproduced it on my own installation
using the latest released version of MGET. I'm not sure yet whether it is a
bug in MGET, a problem with the HYCOM server, or something else. As you
noted, HYCOM had a major disk array failure the other day that took many of
their products offline. That could be the culprit. But if it was, the tool
should have failed at an earlier stage. (The tools that access the global
HYCOM dataset do indeed fail at an earlier stage.)
I'll investigate more and get back to you shortly...
Jason
-----Original Message-----
From:
[mailto:]
Sent: Friday, August 26, 2011 12:03 PM
To:
Subject: [mget-help] Help Downloading HYCOM data- array error
Dear MGET Help,
First of all, thank you for providing such a wonderful set of tools!
I am new to MGET, but am having issues downloading HYCOM data (any of the
'create raster' within the 'HYCOM consortium' tools). Specifically, I have
tried downloading Gulf of Mexico data, either 3D or 4D data. I have posted
all
output below (please let me know if there is other output needed).
The error I get continuously (regardless of variable selected) is
"ValueError:
total size of new array must be unchanged
<type 'exceptions.ValueError'>: total size of new array must be unchanged."
I also realize that HYCOM's server is having issues currently, but I have
selected (or at least I think) datasets and times that match what is
currently
working on the HYCOM site. Thank you so much for your help.
Sincerely,
-Nathan
Executing: HYCOMGOMl0043DCreateClimatologicalArcGISRasters ssh Mean Monthly
C:\GIS_data\HYCOM_2 Add
%(VariableName)s;%(ClimatologyBinType)s_Climatology;%(VariableName)s_%(Clima
tologyBinName)s_%(Statistic)s.img
1 1 # Degrees 2/1/2011 5/1/2011 600 # # true false C:\GIS_data\HYCOM_2
Start Time: Fri Aug 26 11:00:04 2011
Running script HYCOMGOMl0043DCreateClimatologicalArcGISRasters...
The HYCOM OPeNDAP server often requires five to ten minutes to return the
data
required to create the first raster. Please be patient. After the first one
is
created, the rest will go much faster. Because the first raster takes so
long,
the first status report may estimate an absurdly long time to completion.
Please wait for the second status report, issued five minutes after the
first
one, for a better estimate. This tool cannot be cancelled until the first
raster is created. If this tool fails with to a timeout error, increase the
timeout value and try again.
Querying monthly climatological mean of the ssh grid of the HYCOM + NCODA
Gulf
of Mexico 1/25 degree Analysis (GOMl0.04), clipped to indices tMin = 31,
tMax =
120.
No data is available to create the January climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
No data is available to create the June climatological mean of the ssh grid
of
the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped to
indices tMin = 31, tMax = 120.
No data is available to create the July climatological mean of the ssh grid
of
the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped to
indices tMin = 31, tMax = 120.
No data is available to create the August climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
No data is available to create the September climatological mean of the ssh
grid of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04),
clipped to indices tMin = 31, tMax = 120.
No data is available to create the October climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
No data is available to create the November climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
No data is available to create the December climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
Query complete: 0:00:00 elapsed, 4 datasets found, 0:00:00.028750 per
dataset.
Importing 4 datasets into ArcGIS Folder C:\GIS_data\HYCOM_2 with mode "add".
Checking for existing destination datasets.
Finished checking: 0:00:00 elapsed, 4 datasets checked, 0:00:00.000250 per
dataset.
0 destination datasets already exist. Importing 4 datasets.
Aggregating 28 grids to create the February climatological mean of the ssh
grid
of the HYCOM + NCODA Gulf of Mexico 1/25 degree Analysis (GOMl0.04), clipped
to
indices tMin = 31, tMax = 120.
Aggregation stopped before all grids were aggregated: 0:00:11 elapsed, 0
grids
aggregated, 0:00:00 per grid, 28 not aggregated.
Import stopped before all datasets were imported: 0:00:11 elapsed, 0
datasets
imported, 0:00:00 per dataset, 4 datasets not imported.
ValueError: total size of new array must be unchanged
<type 'exceptions.ValueError'>: total size of new array must be unchanged
Failed to execute (HYCOMGOMl0043DCreateClimatologicalArcGISRasters).
End Time: Fri Aug 26 11:00:16 2011 (Elapsed Time: 12.00 seconds)
Archives powered by MHonArc.