Skip to content

Update Dockerfile to be a bit less fragile#1

Open
ppietikainen wants to merge 1 commit intoouspg:mainfrom
ppietikainen:main
Open

Update Dockerfile to be a bit less fragile#1
ppietikainen wants to merge 1 commit intoouspg:mainfrom
ppietikainen:main

Conversation

@ppietikainen
Copy link
Member

Make base ubuntu packages + python dependencies + DependencyCheck
separate RUN statements (If building image goes wrong intermediate
steps are cached).

Try to do everything as user ubuntu.

Make base ubuntu packages + python dependencies + DependencyCheck
separate RUN statements (If building image goes wrong intermediate
steps are cached).

Try to do everything as user ubuntu.
@ppietikainen ppietikainen changed the title Update ubuntu base to latest supported one Update Dockerfile to be a bit less fragile Nov 8, 2024
Copy link
Collaborator

@Zippo00 Zippo00 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CentOS 7 distrolla, kun asensi README:n "Setup for CPU only" -ohjeiden mukaisesti, ei garak enää toiminut. README:n esimerkki probea yrittäessä ajaa, herjasi:
"
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/main.py", line 13, in
main()
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/main.py", line 9, in main
cli.main(sys.argv[1:])
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/cli.py", line 486, in main
command.probewise_run(generator, probe_names, evaluator, buff_names)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/command.py", line 212, in probewise_run
probewise_h.run(generator, probe_names, evaluator, buffs)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/harnesses/probewise.py", line 106, in run
h.run(model, [probe], detectors, evaluator, announce_probe=False)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/harnesses/base.py", line 93, in run
attempt_results = probe.probe(model)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/probes/base.py", line 204, in probe
attempts_completed = self._execute_all(attempts_todo)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/probes/base.py", line 182, in _execute_all
result = self._execute_attempt(this_attempt)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/probes/base.py", line 145, in _execute_attempt
this_attempt.outputs = self.generator.generate(this_attempt.prompt)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/generators/base.py", line 96, in generate
return self._call_model(prompt, generations_this_call)
File "/home/ubuntu/.local/lib/python3.10/site-packages/backoff/_sync.py", line 105, in retry
ret = target(*args, **kwargs)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/generators/huggingface.py", line 346, in _call_model
raise IOError(
OSError: 🤗 reported: 424 Request failed during generation: Server error: error trying to connect: Connection refused (os error 111)
"

Plus responsiivisuus vaikutti laskevan ja llm_hackathon kontin terminaaliin kirjoittaessa pientä lagia - ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants