Skip to content

Fix download_things.sh: pass password to unzip#12

Open
c-mulliken wants to merge 1 commit into
masterfrom
fix-download-things-password
Open

Fix download_things.sh: pass password to unzip#12
c-mulliken wants to merge 1 commit into
masterfrom
fix-download-things-password

Conversation

@c-mulliken

Copy link
Copy Markdown
Collaborator

Problem

The THINGS OSF archive (images_THINGS.zip, project jum2f) is password-protected, but scripts/download_things.sh ran unzip images_THINGS.zip with no password — so the download step always failed at unzip, then rm'd the archive. Confirmed while pulling the data to Oscar: the fetch succeeds (5.02 GB) but the stock script cannot unpack it.

Fix

  • Pass the (public) password things4all to unzip -P, overridable via THINGS_ZIP_PASSWORD.
  • Add set -euo pipefail so a failed fetch/unzip aborts instead of proceeding to rm a missing/partial archive.
  • unzip -o to overwrite cleanly on re-runs.

Verified end-to-end on Oscar: fetch + unzip -P things4all unpacks to data/THINGS/object_images/ (1,854 concept folders, 26,107 images).

🤖 Generated with Claude Code

The THINGS OSF archive is password-protected, but the script called `unzip`
with no password, so the download always failed at the unzip step. Pass the
(public) password `things4all`, overridable via THINGS_ZIP_PASSWORD, and add
`set -euo pipefail` so a failed fetch/unzip aborts instead of `rm`-ing a
partial/again-missing archive.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant