Skip to content

The search engine dedicated to indexing personal websites.

Notifications You must be signed in to change notification settings

0x2E/RawWeb.org

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 

Repository files navigation

RawWeb.org

👋 This is the "blog" of RawWeb.org.

Intro

We miss the golden age of the internet when people thought, wrote, and shared on their personal websites and blogs.

That’s why we’ve built this search engine to help you discover and explore content from personal websites.

How the crawler works

Our crawler is designed to be considerate of your website's resources.

  • It will request the feed link using the User-Agent rawweb-bot/1.0.
  • The time between requests will vary from 30 minutes to 48 hours, depending on several factors.

Feed sources

In addition to user submissions, we've imported multiple large feed sources. We're grateful for all of this wonderful work.

Sorted by date added:

About

The search engine dedicated to indexing personal websites.

Resources

Stars

Watchers

Forks