Skip to content

Create a scraper for documents and websites #9

@dani-ajah

Description

@dani-ajah

As a developer of the SKS project, creating a scrapper to search for and find documents or website URLs would help to populate the linkages and documents datasets.

This could be a multipurpose scrapper or could just be 2 different scrappers.

  • We need to find more organizations' websites and then scrape their website text (This could also be an identifier of websites - take a list of names and find a website.)
  • We need to potentially find documents

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    Status

    Data Modeling & Processing

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions