Update Dockerfile to be a bit less fragile#1
Conversation
Make base ubuntu packages + python dependencies + DependencyCheck separate RUN statements (If building image goes wrong intermediate steps are cached). Try to do everything as user ubuntu.
Zippo00
left a comment
There was a problem hiding this comment.
CentOS 7 distrolla, kun asensi README:n "Setup for CPU only" -ohjeiden mukaisesti, ei garak enää toiminut. README:n esimerkki probea yrittäessä ajaa, herjasi:
"
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/main.py", line 13, in
main()
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/main.py", line 9, in main
cli.main(sys.argv[1:])
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/cli.py", line 486, in main
command.probewise_run(generator, probe_names, evaluator, buff_names)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/command.py", line 212, in probewise_run
probewise_h.run(generator, probe_names, evaluator, buffs)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/harnesses/probewise.py", line 106, in run
h.run(model, [probe], detectors, evaluator, announce_probe=False)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/harnesses/base.py", line 93, in run
attempt_results = probe.probe(model)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/probes/base.py", line 204, in probe
attempts_completed = self._execute_all(attempts_todo)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/probes/base.py", line 182, in _execute_all
result = self._execute_attempt(this_attempt)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/probes/base.py", line 145, in _execute_attempt
this_attempt.outputs = self.generator.generate(this_attempt.prompt)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/generators/base.py", line 96, in generate
return self._call_model(prompt, generations_this_call)
File "/home/ubuntu/.local/lib/python3.10/site-packages/backoff/_sync.py", line 105, in retry
ret = target(*args, **kwargs)
File "/home/ubuntu/.local/lib/python3.10/site-packages/garak/generators/huggingface.py", line 346, in _call_model
raise IOError(
OSError: 🤗 reported: 424 Request failed during generation: Server error: error trying to connect: Connection refused (os error 111)
"
Plus responsiivisuus vaikutti laskevan ja llm_hackathon kontin terminaaliin kirjoittaessa pientä lagia - ?
Make base ubuntu packages + python dependencies + DependencyCheck
separate RUN statements (If building image goes wrong intermediate
steps are cached).
Try to do everything as user ubuntu.