Like Ra's Naughty Forum

Killed the most annoying crawlers/bots (e.g. SemRush, PetalBot, DotBot) and the bandwidth cache jumped to 94%, HTTP/3 to 50.14% and the disk load dropped by 30%. Nice!

(16 Aug 2023, 22:33 )Like Ra Wrote: [ -> ]the bandwidth cache jumped to 94%

95%!

I've deployed CF to a number of sites. One thing you can do on your origin server now is block connections from only Cloudflare IPs (https://www.cloudflare.com/ips/). The other thing you could do instead is utilize Cloudflare tunnel.

(02 Aug 2023, 21:23 )Like Ra Wrote: [ -> ]More side effects:

- possible stale cache. Free tier users can purge the whole cache only.
- SPAMmers can not be identified by IP, as all traffic to the site comes from the CloudFlare addresses.

You should be able to turn on "scrutinize" in MyBB and it will get the forwarded IPs. https://community.cloudflare.com/t/cloud...ums/6807/2

(24 Aug 2023, 23:15 )zan Wrote: [ -> ]One thing you can do on your origin server now is block connections from only Cloudflare IPs

You mean "allow", right?

(24 Aug 2023, 23:15 )zan Wrote: [ -> ]The other thing you could do instead is utilize Cloudflare tunnel.

This one? https://developers.cloudflare.com/cloudf...-networks/

To be honest, I do not want to completely isolate the origin server (what can be achieved? additional security?), and do not want to add another level of complexity - it's not the first priority at the moment. What I'm currently trying to achieve is to make Google index the images and use mobile friendly pages to move up the ranks.

(24 Aug 2023, 23:15 )zan Wrote: [ -> ]The other thing you could do instead is utilize Cloudflare tunnel.

Currently reading about it...

(24 Aug 2023, 23:19 )zan Wrote: [ -> ]You should be able to turn on "scrutinize" in MyBB and it will get the forwarded IPs.

Allowed. Let's see what it will change...

There should be a Cloudflare setting to add the "forwarded" header. Can't find it...

(24 Aug 2023, 23:48 )Like Ra Wrote: [ -> ]

Quote:You should be able to turn on "scrutinize" in MyBB and it will get the forwarded IPs.

Allowed. Let's see what it will change...

Yes! It works! Thanks!

(16 Aug 2023, 22:33 )Like Ra Wrote: [ -> ]Killed the most annoying crawlers/bots (e.g. SemRush, PetalBot, DotBot) and the bandwidth cache jumped to 94%, HTTP/3 to 50.14% and the disk load dropped by 30%. Nice!

The effect of blocking useless bots by Cloudflare on Aug 21:

[attachment=60204]

Bandwidth stat for the last 30 days:

[attachment=60241]

1.32TB in total, the server saw only 114.41GB. The previous maximum was 844MB.

Cloudflare works!