Crawling same url twice

[yesidc]

Does anybody know if crawl4ai makes sure that urls are not crawled twice? Or do I need to take care of this?
Read some of the code, but could not find any implementation.
Thanks.

[yesidc]

After some debugging, I found this line of code in database.py :

DB_PATH = os.path.join(os.getenv("CRAWL4_AI_BASE_DIRECTORY", Path.home()), ".crawl4ai")

Is there a way to configure this path?