How to select which...
 
Notifications
Clear all

How to select which files are returned?  

 
diegorad
(@diegorad)
Member

Hi,

Since the recent update I'm not able to download the resulting data files from my jobs. The result folder is empty.

My bash script creates a directory where all the resulting files are saved, which before the update was the only folder returned.

I've been exploring the new version and it seems that further configuration to select which files are returned can be done using one of the predetermined missions, but I'm not sure if it's possible to run my code in one of them.

 

By the way, I've been using Galileo for a few weeks and it has been great. It was quick to learn how to send jobs and it has been super useful to my work. So congrats to all the team. Thanks you.

Quote
Posted : 19/07/2020 11:40 pm
Todd
 Todd
(@todd)
CTO Admin

Hi @diegorad

Thanks for your question and I'm glad to hear that you've enjoyed Galileo so far.

 

The reason your results folder is being returned empty is because of a change we had to make to our runtime procedures for improved security and performance. When you run a job in Galileo with your own Dockerfile now, you need to use /home/galileo as your working directory. Please see the Dockerfile in our Github example here: https://github.com/GoHypernet/Galileo-examples/blob/python/Dockerfile . You'll see that you need to add the following lines to your Dockerfile: 

 

RUN useradd -ms /bin/bash galileo

USER galileo

WORKDIR /home/galileo

 

Put these lines right before the COPY statement in the Dockerfile you are using for your project. If you have trouble, you can share your Dockerfile here and I can help correct it for you. 

 

Sincerely, 
Todd Chapman

CTO, Hypernet Labs

This post was modified 2 weeks ago 2 times by Todd
ReplyQuote
Posted : 20/07/2020 9:39 pm