Subject: Marine Geospatial Ecology Tools (MGET) help
Text archives
| From: | "Jason Roberts" <> |
|---|---|
| To: | "'Anna Meissner'" <> |
| Cc: | <> |
| Subject: | RE: [mget-help] extracting problems on ArcGIS 9.2 |
| Date: | Tue, 4 Aug 2009 15:36:23 -0400 |
Hi Anna,
I'm sorry you're seeing this problem. It sounds like a bug in either MGET or
ArcGIS. We recently did some work in MGET to better support non-English
operating systems and ArcGIS versions. Even if you are using the English OS
and ArcGIS, this fix may still come into effect if your files and rasters
have non-ASCII characters in the file name. It looks like that is happening
here, and it makes me suspect that our work in MGET was not sufficient.
Can you please try the following, to help us understand the problem?
1. Enable verbose logging. The instructions are here:
http://code.env.duke.edu/projects/mget/wiki/Configuring%20MGET%20logging
2. Reproduce the problem. This will produce much more output.
3. Email me all of the output. This should give me a better idea where the
failure occurred.
Thanks for your help and with best regards,
Jason
-----Original Message-----
From: Anna Meissner
[mailto:]
Sent: Tuesday, August 04, 2009 2:43 PM
To:
Subject: [mget-help] extracting problems on ArcGIS 9.2
Dear,
I have been using MGET for some times, and managed so far. I am
currently facing some extaction problems although I have not changed the
processing steps, have not changed my software... I cannot figure out
what is wrong...
I am working on ArcView 9.2
I am extracting remote sensing data from Seawifs, AquaMOdis and
Pathfinder. Any is not working anymore!
I get the following error message:
when running the extraction from a hdf file (Pathfinder map, the map has
been previously cut at X=0 and Y=35), and using the conversion tool "To
ArcGis Raster" and "HDF SDS to ArcGIS Raster":
----------------------------------------------------------------------------
-------------------------------------------
Executing (HDFSDSToArcGISRaster_4): HDFSDSToArcGISRaster "C:\Documents
and Settings\meissner anna\Bureau\statelit\76611.hdf" "C:\Documents and
Settings\meissner anna\Bureau\statelit\essai" Temperature 0 35 0,0439453
#
GEOGCS['GCS_WGS_1984',DATUM['D_WGS_1984',SPHEROID['WGS_1984',6378137.0,298.2
57223563]],PRIMEM['Greenwich',0.0],UNIT['Degree',0.0174532925199433]]
# # # # # # # false
Start Time: Tue Aug 04 20:28:58 2009
Running script HDFSDSToArcGISRaster...
Extracting SDS "Temperature" from HDF file C:\Documents and
Settings\meissner anna\Bureau\statelit\76611.hdf to ArcGIS raster
C:\Documents and Settings\meissner anna\Bureau\statelit\essai...
An error was encountered while executing ASCIIToRaster.
("esriGeoAnalyst.GridEngine") Could not save dataset with specified name
and output format
Failed to execute (ASCIIToRaster).
An error was encountered while executing ASCIIToRaster.
("esriGeoAnalyst.GridEngine") Could not save dataset with specified name
and output format
Failed to execute (ASCIIToRaster).
ArcGISError: An ArcGIS geoprocessing function failed. This usually
results from a problem with your inputs. Please check them and try
again. Also review any preceding error messages and the detailed error
information that appears at the end of this message. If you suspect the
failure is due to a programming mistake in this function or ArcGIS,
please contact the author of this function for assistance. Detailed
error information: ArcGIS Geoprocessor object 0x015BE670: Invocation of
ASCIIToRaster_Conversion(*args=(u'C:\\Temp\\GeoEcoTemp_meissner
anna\\tmputqjfl\\temp.asc', u'C:\\Temp\\GeoEcoTemp_meissner
anna\\tmputqjfl\\output', u'FLOAT')) raised UnicodeDecodeError: 'ascii'
codec can't decode byte 0xe9 in position 13: ordinal not in range(128)
The following consequences resulted from the original error:
Could not convert C:\Temp\GeoEcoTemp_meissner anna\tmpunqs3y\binary to
raster C:\Documents and Settings\meissner anna\Bureau\statelit\essai
Could not extract SDS "Temperature" from HDF file C:\Documents and
Settings\meissner anna\Bureau\statelit\76611.hdf to ArcGIS raster
C:\Documents and Settings\meissner anna\Bureau\statelit\essai
Python script
C:\PYTHON24\lib\SITE-P~1\GeoEco\ARCGIS~1\Scripts\HDFSDSToArcGISRaster.py
exiting with return value 1, indicating failure.
Error in script HDFSDSToArcGISRaster.
Error in executing: cmd.exe /C
C:\PYTHON24\lib\SITE-P~1\GeoEco\ARCGIS~1\Scripts\HDFSDS~1.PY
"C:\Documents and Settings\meissner anna\Bureau\statelit\76611.hdf"
"C:\Documents and Settings\meissner anna\Bureau\statelit\essai"
"Temperature" "0" "35" "0,0439453" "#"
"GEOGCS['GCS_WGS_1984',DATUM['D_WGS_1984',SPHEROID['WGS_1984',6378137.0,298.
257223563]],PRIMEM['Greenwich',0.0],UNIT['Degree',0.0174532925199433]]"
"#" "#" "#" "#" "#" "#" "#" "false"
Failed to execute (HDFSDSToArcGISRaster_4).
End Time: Tue Aug 04 20:29:33 2009 (Elapsed Time: 35,00 seconds)
----------------------------------------------------------------------------
--------------------
when running the extraction from a directory file (Seawifs map), using
the convesrion tool "To ArcGIS Raster" and "Find HDFs and Extract SDSes
To ArcGIS":
----------------------------------------------------------------------------
--------
Executing (HDFFindAndConvertToArcGISRasters_5):
HDFFindAndConvertToArcGISRasters "C:\Documents and Settings\meissner
anna\Bureau\satelit" "C:\Documents and Settings\meissner
anna\Bureau\satelit" l3m_data -180 -90 0,083333 # * false # # # # # #
GEOGCS['GCS_WGS_1984',DATUM['D_WGS_1984',SPHEROID['WGS_1984',6378137.0,298.2
57223563]],PRIMEM['Greenwich',0.0],UNIT['Degree',0.0174532925199433]]
# # # # # # # false os.path.join(outputWorkspace,
os.path.dirname(inputFile[len(directoryToSearch)+1:]),
os.path.basename(inputFile).split(u'.')[0][:13]) os.path false
"C:\Documents and Settings\meissner anna\Bureau\satelit"
Start Time: Tue Aug 04 20:35:39 2009
Running script HDFFindAndConvertToArcGISRasters...
Finding files and inserting rows into table "work":
directory="C:\Documents and Settings\meissner anna\Bureau\satelit",
wildcard="*", searchTree=False, minSize=None, maxSize=None,
minDateCreated=None, maxDateCreated=None, minDateModified=None,
maxDateModified=None
Finished inserting rows: 0:00:00 elapsed, 1 rows inserted,
0:00:00.062000 per row.
Updating field "outputRaster" in table "work"...
Querying the table "work" to build lists of inputs and outputs...
Query complete: 0:00:00 elapsed, 1 rows retrieved, 0:00:00 per row.
Processing 1 inputs...
Extracting SDS "l3m_data" from HDF file C:\Documents and
Settings\meissner anna\Bureau\satelit\S19981611998168.L3m_8D_CHLO_9.bz2
to ArcGIS raster C:\Documents and Settings\meissner
anna\Bureau\satelit\S199816119981...
An error was encountered while executing ASCIIToRaster.
("esriGeoAnalyst.GridEngine") Could not save dataset with specified name
and output format
Failed to execute (ASCIIToRaster).
An error was encountered while executing ASCIIToRaster.
("esriGeoAnalyst.GridEngine") Could not save dataset with specified name
and output format
Failed to execute (ASCIIToRaster).
ArcGISError: An ArcGIS geoprocessing function failed. This usually
results from a problem with your inputs. Please check them and try
again. Also review any preceding error messages and the detailed error
information that appears at the end of this message. If you suspect the
failure is due to a programming mistake in this function or ArcGIS,
please contact the author of this function for assistance. Detailed
error information: ArcGIS Geoprocessor object 0x015BE828: Invocation of
ASCIIToRaster_Conversion(*args=(u'C:\\Temp\\GeoEcoTemp_meissner
anna\\tmppdzlrf\\temp.asc', u'C:\\Temp\\GeoEcoTemp_meissner
anna\\tmppdzlrf\\output', u'INTEGER')) raised UnicodeDecodeError:
'ascii' codec can't decode byte 0xe9 in position 13: ordinal not in
range(128)
The following consequences resulted from the original error:
Could not convert C:\Temp\GeoEcoTemp_meissner anna\tmpgrlrjl\binary to
raster C:\Documents and Settings\meissner anna\Bureau\satelit\S199816119981
Could not extract SDS "l3m_data" from HDF file C:\Documents and
Settings\meissner anna\Bureau\satelit\S19981611998168.L3m_8D_CHLO_9.bz2
to ArcGIS raster C:\Documents and Settings\meissner
anna\Bureau\satelit\S199816119981
Python script
C:\PYTHON24\lib\SITE-P~1\GeoEco\ARCGIS~1\Scripts\HDFFindAndConvertToArcGISRa
sters.py
exiting with return value 1, indicating failure.
Error in script HDFFindAndConvertToArcGISRasters.
Error in executing: cmd.exe /C
C:\PYTHON24\lib\SITE-P~1\GeoEco\ARCGIS~1\Scripts\HDFFIN~1.PY
"C:\Documents and Settings\meissner anna\Bureau\satelit" "C:\Documents
and Settings\meissner anna\Bureau\satelit" "l3m_data" "-180" "-90"
"0,083333" "#" "*" "false" "#" "#" "" "" "" ""
"GEOGCS['GCS_WGS_1984',DATUM['D_WGS_1984',SPHEROID['WGS_1984',6378137.0,298.
257223563]],PRIMEM['Greenwich',0.0],UNIT['Degree',0.0174532925199433]]"
"#" "#" "#" "#" "#" "#" "#" "false" "os.path.join(outputWorkspace,
os.path.dirname(inputFile[len(directoryToSearch)+1:]),
os.path.basename(inputFile).split(u'.')[0][:13])" "os.path" "false"
"C:\Documents and Settings\meissner anna\Bureau\satelit"
Failed to execute (HDFFindAndConvertToArcGISRasters_5).
End Time: Tue Aug 04 20:37:06 2009 (Elapsed Time: 1 minutes 27 seconds)
----------------------------------------------------------------------------
--------
I have tried to change the place of the directory, C:/, D:/, F:/...
I tried on old files I know it worked (already did it, and succeed in
extracting the data)...
I really don't know why it is not working anymore.
Any help or advise would be really welcome!
thanks a lot!
Best regards,
Anna Meissner
University of Aberdeen, UK
I'm sorry you're seeing this problem. It sounds like a bug in either MGET or
ArcGIS. We recently did some work in MGET to better support non-English
operating systems and ArcGIS versions. Even if you are using the English OS
and ArcGIS, this fix may still come into effect if your files and rasters
have non-ASCII characters in the file name. It looks like that is happening
here, and it makes me suspect that our work in MGET was not sufficient.
Can you please try the following, to help us understand the problem?
1. Enable verbose logging. The instructions are here:
http://code.env.duke.edu/projects/mget/wiki/Configuring%20MGET%20logging
2. Reproduce the problem. This will produce much more output.
3. Email me all of the output. This should give me a better idea where the
failure occurred.
Thanks for your help and with best regards,
Jason
-----Original Message-----
From: Anna Meissner
[mailto:]
Sent: Tuesday, August 04, 2009 2:43 PM
To:
Subject: [mget-help] extracting problems on ArcGIS 9.2
Dear,
I have been using MGET for some times, and managed so far. I am
currently facing some extaction problems although I have not changed the
processing steps, have not changed my software... I cannot figure out
what is wrong...
I am working on ArcView 9.2
I am extracting remote sensing data from Seawifs, AquaMOdis and
Pathfinder. Any is not working anymore!
I get the following error message:
when running the extraction from a hdf file (Pathfinder map, the map has
been previously cut at X=0 and Y=35), and using the conversion tool "To
ArcGis Raster" and "HDF SDS to ArcGIS Raster":
----------------------------------------------------------------------------
-------------------------------------------
Executing (HDFSDSToArcGISRaster_4): HDFSDSToArcGISRaster "C:\Documents
and Settings\meissner anna\Bureau\statelit\76611.hdf" "C:\Documents and
Settings\meissner anna\Bureau\statelit\essai" Temperature 0 35 0,0439453
#
GEOGCS['GCS_WGS_1984',DATUM['D_WGS_1984',SPHEROID['WGS_1984',6378137.0,298.2
57223563]],PRIMEM['Greenwich',0.0],UNIT['Degree',0.0174532925199433]]
# # # # # # # false
Start Time: Tue Aug 04 20:28:58 2009
Running script HDFSDSToArcGISRaster...
Extracting SDS "Temperature" from HDF file C:\Documents and
Settings\meissner anna\Bureau\statelit\76611.hdf to ArcGIS raster
C:\Documents and Settings\meissner anna\Bureau\statelit\essai...
An error was encountered while executing ASCIIToRaster.
("esriGeoAnalyst.GridEngine") Could not save dataset with specified name
and output format
Failed to execute (ASCIIToRaster).
An error was encountered while executing ASCIIToRaster.
("esriGeoAnalyst.GridEngine") Could not save dataset with specified name
and output format
Failed to execute (ASCIIToRaster).
ArcGISError: An ArcGIS geoprocessing function failed. This usually
results from a problem with your inputs. Please check them and try
again. Also review any preceding error messages and the detailed error
information that appears at the end of this message. If you suspect the
failure is due to a programming mistake in this function or ArcGIS,
please contact the author of this function for assistance. Detailed
error information: ArcGIS Geoprocessor object 0x015BE670: Invocation of
ASCIIToRaster_Conversion(*args=(u'C:\\Temp\\GeoEcoTemp_meissner
anna\\tmputqjfl\\temp.asc', u'C:\\Temp\\GeoEcoTemp_meissner
anna\\tmputqjfl\\output', u'FLOAT')) raised UnicodeDecodeError: 'ascii'
codec can't decode byte 0xe9 in position 13: ordinal not in range(128)
The following consequences resulted from the original error:
Could not convert C:\Temp\GeoEcoTemp_meissner anna\tmpunqs3y\binary to
raster C:\Documents and Settings\meissner anna\Bureau\statelit\essai
Could not extract SDS "Temperature" from HDF file C:\Documents and
Settings\meissner anna\Bureau\statelit\76611.hdf to ArcGIS raster
C:\Documents and Settings\meissner anna\Bureau\statelit\essai
Python script
C:\PYTHON24\lib\SITE-P~1\GeoEco\ARCGIS~1\Scripts\HDFSDSToArcGISRaster.py
exiting with return value 1, indicating failure.
Error in script HDFSDSToArcGISRaster.
Error in executing: cmd.exe /C
C:\PYTHON24\lib\SITE-P~1\GeoEco\ARCGIS~1\Scripts\HDFSDS~1.PY
"C:\Documents and Settings\meissner anna\Bureau\statelit\76611.hdf"
"C:\Documents and Settings\meissner anna\Bureau\statelit\essai"
"Temperature" "0" "35" "0,0439453" "#"
"GEOGCS['GCS_WGS_1984',DATUM['D_WGS_1984',SPHEROID['WGS_1984',6378137.0,298.
257223563]],PRIMEM['Greenwich',0.0],UNIT['Degree',0.0174532925199433]]"
"#" "#" "#" "#" "#" "#" "#" "false"
Failed to execute (HDFSDSToArcGISRaster_4).
End Time: Tue Aug 04 20:29:33 2009 (Elapsed Time: 35,00 seconds)
----------------------------------------------------------------------------
--------------------
when running the extraction from a directory file (Seawifs map), using
the convesrion tool "To ArcGIS Raster" and "Find HDFs and Extract SDSes
To ArcGIS":
----------------------------------------------------------------------------
--------
Executing (HDFFindAndConvertToArcGISRasters_5):
HDFFindAndConvertToArcGISRasters "C:\Documents and Settings\meissner
anna\Bureau\satelit" "C:\Documents and Settings\meissner
anna\Bureau\satelit" l3m_data -180 -90 0,083333 # * false # # # # # #
GEOGCS['GCS_WGS_1984',DATUM['D_WGS_1984',SPHEROID['WGS_1984',6378137.0,298.2
57223563]],PRIMEM['Greenwich',0.0],UNIT['Degree',0.0174532925199433]]
# # # # # # # false os.path.join(outputWorkspace,
os.path.dirname(inputFile[len(directoryToSearch)+1:]),
os.path.basename(inputFile).split(u'.')[0][:13]) os.path false
"C:\Documents and Settings\meissner anna\Bureau\satelit"
Start Time: Tue Aug 04 20:35:39 2009
Running script HDFFindAndConvertToArcGISRasters...
Finding files and inserting rows into table "work":
directory="C:\Documents and Settings\meissner anna\Bureau\satelit",
wildcard="*", searchTree=False, minSize=None, maxSize=None,
minDateCreated=None, maxDateCreated=None, minDateModified=None,
maxDateModified=None
Finished inserting rows: 0:00:00 elapsed, 1 rows inserted,
0:00:00.062000 per row.
Updating field "outputRaster" in table "work"...
Querying the table "work" to build lists of inputs and outputs...
Query complete: 0:00:00 elapsed, 1 rows retrieved, 0:00:00 per row.
Processing 1 inputs...
Extracting SDS "l3m_data" from HDF file C:\Documents and
Settings\meissner anna\Bureau\satelit\S19981611998168.L3m_8D_CHLO_9.bz2
to ArcGIS raster C:\Documents and Settings\meissner
anna\Bureau\satelit\S199816119981...
An error was encountered while executing ASCIIToRaster.
("esriGeoAnalyst.GridEngine") Could not save dataset with specified name
and output format
Failed to execute (ASCIIToRaster).
An error was encountered while executing ASCIIToRaster.
("esriGeoAnalyst.GridEngine") Could not save dataset with specified name
and output format
Failed to execute (ASCIIToRaster).
ArcGISError: An ArcGIS geoprocessing function failed. This usually
results from a problem with your inputs. Please check them and try
again. Also review any preceding error messages and the detailed error
information that appears at the end of this message. If you suspect the
failure is due to a programming mistake in this function or ArcGIS,
please contact the author of this function for assistance. Detailed
error information: ArcGIS Geoprocessor object 0x015BE828: Invocation of
ASCIIToRaster_Conversion(*args=(u'C:\\Temp\\GeoEcoTemp_meissner
anna\\tmppdzlrf\\temp.asc', u'C:\\Temp\\GeoEcoTemp_meissner
anna\\tmppdzlrf\\output', u'INTEGER')) raised UnicodeDecodeError:
'ascii' codec can't decode byte 0xe9 in position 13: ordinal not in
range(128)
The following consequences resulted from the original error:
Could not convert C:\Temp\GeoEcoTemp_meissner anna\tmpgrlrjl\binary to
raster C:\Documents and Settings\meissner anna\Bureau\satelit\S199816119981
Could not extract SDS "l3m_data" from HDF file C:\Documents and
Settings\meissner anna\Bureau\satelit\S19981611998168.L3m_8D_CHLO_9.bz2
to ArcGIS raster C:\Documents and Settings\meissner
anna\Bureau\satelit\S199816119981
Python script
C:\PYTHON24\lib\SITE-P~1\GeoEco\ARCGIS~1\Scripts\HDFFindAndConvertToArcGISRa
sters.py
exiting with return value 1, indicating failure.
Error in script HDFFindAndConvertToArcGISRasters.
Error in executing: cmd.exe /C
C:\PYTHON24\lib\SITE-P~1\GeoEco\ARCGIS~1\Scripts\HDFFIN~1.PY
"C:\Documents and Settings\meissner anna\Bureau\satelit" "C:\Documents
and Settings\meissner anna\Bureau\satelit" "l3m_data" "-180" "-90"
"0,083333" "#" "*" "false" "#" "#" "" "" "" ""
"GEOGCS['GCS_WGS_1984',DATUM['D_WGS_1984',SPHEROID['WGS_1984',6378137.0,298.
257223563]],PRIMEM['Greenwich',0.0],UNIT['Degree',0.0174532925199433]]"
"#" "#" "#" "#" "#" "#" "#" "false" "os.path.join(outputWorkspace,
os.path.dirname(inputFile[len(directoryToSearch)+1:]),
os.path.basename(inputFile).split(u'.')[0][:13])" "os.path" "false"
"C:\Documents and Settings\meissner anna\Bureau\satelit"
Failed to execute (HDFFindAndConvertToArcGISRasters_5).
End Time: Tue Aug 04 20:37:06 2009 (Elapsed Time: 1 minutes 27 seconds)
----------------------------------------------------------------------------
--------
I have tried to change the place of the directory, C:/, D:/, F:/...
I tried on old files I know it worked (already did it, and succeed in
extracting the data)...
I really don't know why it is not working anymore.
Any help or advise would be really welcome!
thanks a lot!
Best regards,
Anna Meissner
University of Aberdeen, UK
Archives powered by MHonArc.