-ef parameter only filters at the output level, increasing memory usage

[kayra-s4e]

katana version:

v1.1.2 (latest)

Current Behavior:

When using the -ef parameter to exclude specific file extensions, I can see that they are filtered out in the JSON output. However, when analyzing network traffic with Wireshark, I noticed that requests are still being made to the excluded files.

This suggests that Katana is only filtering these files at the output level, while still storing them in memory. As a result, even with -ef css, CSS files are not included in the output, but they still consume RAM. This leads to excessive memory usage in large-scale crawls.

Expected Behavior:

Katana should completely ignore the specified extensions on the client side and should not send any requests to those files at all.

Steps To Reproduce:

1. Run the following command:
   katana -u http://testphp.vulnweb.com -ef css -j
2. Monitor network traffic using Wireshark or Burp Suite.
3. Notice that requests are still being made to excluded file types (.css).
4. Observe that CSS files do not appear in the JSON output but still affect RAM usage.

Anything else:

Thank you for your interest