feature request or guidance: how to upload local files in coiled batch run?

[andersy005]

I'm aware that coiled run supports the --file or -f flag for uploading local files or directories. Is there a way to achieve similar functionality with coiled batch run? If this is currently supported, I'd appreciate guidance or documentation on how to use it. If not, adding support for a flag to upload files and directories when executing batch jobs would be great

[ntabris]

Sorry, this isn't currently supported. For coiled batch we can't ship files in the same way we do for coiled run (which uses SSH connection to a single VM). There's definitely interest in a good way to send files to coiled batch so we're thinking about how best to support this.

For now, the best approach would be to put your files in S3 (or some other cloud storage) and then read them from there on your VMs.

[andersy005]

thank you for the prompt response, @ntabris! i'll keep an eye out for the feature... in the meantime, i discovered that for my use case i can simply pass the information i need via the --env-file