Skip to content

[good first issue] Create evaluation topic benchmark dataset #37

Description

@federicodeponte

Create a reproducible benchmark dataset of 20 diverse research topics for evaluation.

What to do:

  • Create data/eval_topics.json with 20 topics
  • Cover diverse domains: CS, medicine, economics, social science, physics, biology
  • Include expected canonical papers for each topic
  • Document evaluation criteria in EVALUATION.md

Skills needed: Research background, JSON editing

Related: EVALUATION.md

Metadata

Metadata

Assignees

No one assigned

    Labels

    evalsEvaluation and benchmarkinggood first issueGood for newcomers

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions