Skip to content

Running recall@1 for baseline KeyError: 'generated_dependency' #8

@pldlgb

Description

@pldlgb

Running recall@1 for baseline post-codeqwen
TODO Completions: 201

100%|███████████████████████████████████████████████████████████████████████████████████████████████| 201/201 [17:38<00:00, 5.27s/it]
Traceback (most recent call last):
File "/mnt/intern/QwenEval/EvoCodeBench/parser/recall_k.py", line 229, in
main()
File "/mnt/intern/QwenEval/EvoCodeBench/parser/recall_k.py", line 225, in main
report_results(args, k_list, output_data, benchmark_data)
File "/mnt/intern/QwenEval/EvoCodeBench/parser/recall_k.py", line 56, in report_results
parse_results[namespace][completion] = js['generated_dependency']
KeyError: 'generated_dependency'

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions