less subscribe buttons more rss feeds

anyway i am thinking of making a furaffinity to rss scraper

i found an existing one but it quotes lowtax in its readme so im going to pass

maybe someone who is actually familiar with how fa works should be doing this instead of me

it is extremely frustrating that i could scrape almost everything i need in a single request *except* submission date for which i need to visit each submission's page

this *could* have been easy but instead i'm going to have to involve *cache*

why does FA insist on calling every time zone "Something Standard Time"

shout outs for not having the same wonky time zone list as half the web but no shout outs for, whatever the fuck this is

update on this garbage: it works

i do not know how careful i should be hitting fa with automated requests so i'm not making it public quite yet

@codl people whine about things and then dragoneer adds tanuki to the wrong category after 10 years

@codl you really really really gotta hammer them to get banned, i've done sustained 3-4 requests a second without being banned in the past

@codl I've written a browser extension that opens all submission links on a page into new tabs with a default rate limit of 1 sec per link, which is almost always fine. If the site is under heavy load it will sometimes start throwing 503s but it's rare. I imagine each link generates at least a couple of requests.


Tired: Using tzdata, which is what everyone on the Internet uses, and which is maintained by like three people total

Wired: Maintaining your own timezone list, used by your website, maintained by you
@codl this code looks copy-pasted wholesale from gamefaqs circa 2003

@codl wow, it's literally just a list of "here's all the UTC offsets that are currently used in time zones"

but just the UTC offsets, no other time zone rules?

I'd expect the daylight savings time support to be broken on this site (like, does it handle north vs south hemisphere, or changes by a different amount than 1h?)

@kepstin yeah i have no idea, there is a checkbox for dst but that's it

and i have to *reverse* that mystery dst since i'm making a scraper

Sign in to participate in the conversation

Chitter is a social network fostering a friendly, inclusive, and incredibly soft community.