Error 403 Forbidden while fetching RSS feed

[Mathiewz]

Hi.

I'm trying to fetch official news rss feed from a quarkus API but I get an error 403 Forbidden while doing so. However, if I make a direct call from my browser, postman or any client, I just get the feed without any error.

Is there something like a blacklist that could block my cloud provider and then my app ?

Thanks

 

[Costello]

Hi.

I'm trying to fetch official news rss feed from a quarkus API but I get an error 403 Forbidden while doing so. However, if I make a direct call from my browser, postman or any client, I just get the feed without any error.

Is there something like a blacklist that could block my cloud provider and then my app ?

Thanks

View attachment 479887

I'm afraid Cloudflare does this as a means of protection against spam and to lower strain on the site.
It detects the client and regulates what consistutes a good client from a bad. We can't lower the level of protection from cloudflare or else it will kill our servers.
There is no real solution apart from using a client that works / that doesn't get restricted by cloudflare.

 

[SylverReZ]

I'm afraid Cloudflare does this as a means of protection against spam and to lower strain on the site.
It detects the client and regulates what consistutes a good client from a bad. We can't lower the level of protection from cloudflare or else it will kill our servers.
There is no real solution apart from using a client that works / that doesn't get restricted by cloudflare.

What about what's happening with the servers recently? I've gotten a lot of database errors throughout the weekend whilst browsing GBAtemp.

I'm uncertain if there's an issue with Cloudflare at the moment in terms of large traffic, or in regard to the lack of server maintainers keeping them up.

 

[Costello]

What about what's happening with the servers recently? I've gotten a lot of database errors throughout the weekend whilst browsing GBAtemp.

I'm uncertain if there's an issue with Cloudflare at the moment in terms of large traffic, or in regard to the lack of server maintainers keeping them up.

not much, just the usual DDOS, spam, floods and whatnot.
it's a lot of fun

 

[kijetesantakalu042]

not much, just the usual DDOS, spam, floods and whatnot.
it's a lot of fun

In an alternate universe GBATemp has the funding it needs

 

[Costello]

In an alternate universe GBATemp has the funding it needs

yes, now go find me a big donor that donates 1 million USD for gbatemp's servers

 

[Megadriver94]

There are options besides Cloudflare, such as AWS, Imperva, CD77, and Fastly.

 

[Deleted member 731084]

Config rule​

(http.request.uri.path wildcard "*.rss")

*Set "Security Level" to "Essentially Off"

Caching rule​

(http.request.uri.path wildcard "*.rss")

* Edge TTL -> Ignore cache-control header and use this TTL (2h is fine)
* Cache Key -> Ignore query string

and now you should serve RSS feeds exactly one per cloudflare CDN edge in 2 hours.

not much to do with clients, security level when fetching programmatically is pretty much always required to be at least essentially off (that still blocks, but no longer based on browser detection), sometimes off where available. we apply it to all our API servers.