Skip to Content.

mget-help - Re: [mget-help] Trouble Running MGET on AWS cloud

Please Wait...

Subject: Marine Geospatial Ecology Tools (MGET) help

Text archives


Re: [mget-help] Trouble Running MGET on AWS cloud


Chronological Thread 
  • From: Stephanie Gad <>
  • To: Jason Roberts <>
  • Cc: "" <>
  • Subject: Re: [mget-help] Trouble Running MGET on AWS cloud
  • Date: Thu, 19 Jan 2017 22:39:53 +0000
  • Accept-language: en-US
  • Authentication-results: spf=none (sender IP is ) ;
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99

Hi Jason, 


Thank you for getting back to me. To answer your questions - yes it is correct that I am seeing "Reading habitat patch data" and then the script hangs with nothing more reported after that. I do not see the "Reading xx ocean currents images..." Tried running our script again today on the AWS cloud to see if any popup boxes might be hiding with additional error information, and did not see any. 


Since my initial email, have scheduled a meeting with Ben for next week and will explore your suggestions. Thank you very much for your time. I'll keep you updated as we progress.


Cheers, 

Stephanie 




From: Jason Roberts <>
Sent: Thursday, January 19, 2017 7:02:47 AM
To: Stephanie Gad
Cc:
Subject: RE: Trouble Running MGET on AWS cloud
 

Hi Stephanie,

 

This is an unusual problem. I’m not sure why your script would work on your own machines but not on an AWS cloud server. First to confirm what is happening. Is it correct that you are seeing “Reading habitat patch data...” and then the script hangs, with nothing more reported after that? The next message would be “Reading XX ocean currents images...”, which you do not see, correct? Finally, have you looked around the screen and the Windows taskbar to see if there might be a popup box hiding somewhere with some additional error information, waiting for you to press ok?

 

I have two initial wild guesses:

 

1.    There is a Windows Server 2012 security setting that is interfering somehow. Windows Server releases are configured in a super paranoid way by default that can prevent nearly anything from working correctly. It can be a chore just to get a web browser functioning. It would not surprise me if there was something, somewhere that was blocking some part of this because it was “untrusted”, or something like that. But I don’t have a lot of confidence in this hypothesis; if it was happening the script shouldn’t have gotten as far as it did.

 

2.    There is some configuration difference between the working desktop machine and the non-working AWS machine that you don’t know about or are not remembering. The hang occurs during code that reads rasters with the gdal library and Python numpy package. If you installed numpy or gdal yourself, or they were installed by something else, this could be the configuration difference. I bring this up especially because I know Ben well and he’s always tinkering with the latest libraries and packages. Because gdal is not something that most users ever install themselves, MGET includes a copy of it. MGET’s copy is several years old; building and testing gdal is a large undertaking so I do not update it frequently. If a newer version was installed, there could be a conflict.

 

Could either of those be it?

 

Jason

 

From: [mailto:] On Behalf Of Stephanie Gad
Sent: Tuesday, January 17, 2017 6:10 PM
To:
Subject: [mget-help] Trouble Running MGET on AWS cloud

 

Dear MGET Help, 

 

Hello my name is Stephanie Gad -- I am working on a project using MGET for my Masters thesis at the Bren School of Environmental Science and Management, UC Santa Barbara. I have been working on this model with Dr. Ben Best and we consulted with Dr. Jason Roberts at the early stages of this project. We have been making great progress with our model but have hit a major roadblock. We have successfully installed MGET on our school computers (Windows 7, running on ArcGIS 10.3) and have been running the model multiple times for our larval fish data using a python script. Due to a short time schedule, we are trying to speed up our modeling by utilizing the Amazon Cloud server. For some reason, when trying to run the same script, with the same softwares installed as our school computers,  the AWS cloud (Windows 2012) gets hung up on reading habitat patch data on the  the LarvalDispersalRunSimulation2012 tool. 

 

We would greatly appreciate any thoughts you have on addressing these errors. We are really excited about this MGET model and want to make sure we can use it to the best of its capability for our project! Please let me know if any additional information is needed to understand our problem. I've also attached a copy of our script. Thanks for your time.

 

Best, 

Stephanie 

 

Stephanie Gad

Master’s Student | Class of 2017

Bren School of Environmental Science & Management

University of California, Santa Barbara (UCSB)

| 714-606-5204




Archive powered by MHonArc 2.6.19.

Top of Page