Skip to content

Matching articles from SPECTER's dataset with S2ORC IDs #37

Description

@zoranmedic

Hi,

I want to match articles used in SPECTER's training and validation sets with the articles from S2ORC.
The problem is that article IDs in SPECTER's training and validation sets are not used in the S2ORC dataset, i.e., S2ORC uses different paper IDs compared to SPECTER.

For example, this article can be found in SPECTER's validation set and its ID there is: 793efec2096f6511c45430ff5f2f08a362dcf3eb.
Corpus ID of this paper is 11967120 and this Corpus ID is used in S2ORC as paper_id. (I've found this Corpus ID on the Semantic Scholar's webpage linked above)

Is there any easy way to obtain these Corpus IDs for articles from SPECTER's dataset?
I'm aware I could use Semantic Scholar's API for this, but I think that would be very time-consuming (SPECTER's dataset contains over 165k unique article IDs if I calculated correctly).

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions