Kalanyr: The errors I was referring to where during update ( specifically fetching the top level game data after the shelf page ) which could be far more problematic though still recoverable if caught in time ( if you're a little careless it could result in you trashing files that are still good because they got orphaned because the game was blanked ).
Is this the relevant part in the script:
# HTTP request settings
HTTP_FETCH_DELAY = 1 # in seconds
HTTP_RETRY_DELAY = 5 # in seconds
HTTP_RETRY_COUNT = 3
HTTP_TIMEOUT = 30
So if you increase the number of retries and maybe increase the retry delay, would that make it less probable that there will be "blanks", ie. games that were omitted? Something like this (I guess fetch delay probably isn't directly related to this, but whatever):
# HTTP request settings
HTTP_FETCH_DELAY = 5 # in seconds
HTTP_RETRY_DELAY = 30 # in seconds
HTTP_RETRY_COUNT = 20
HTTP_TIMEOUT = 30
mrkgnao: Oh. I misunderstood. I haven't seen these,
despite using gogrepoc almost every weekday.
I was frankly going to just ask about this, ie. is the "GOG servers are under lots of pressure" related to GOG homepages and servers where gogrepo apparently fetches the game info (during gogrepoc update), or the CDN servers from where you actually download the actual games?
I guess it is the former then, and I assumed it is. So if one is going to perform a full "gogrepoc update" refresh and not just get the flagged (new/updated) games, then try to perform it in some more peaceful time or day? Then again I have no idea what that would be as GOG homepages are accessed from so many different timezones, so is the worst time to run "gogrepoc update" when Europeans are hammering the pages, or when the Americans are hammering them, or when the Chinese are hammering them?
It would actually be interesting to see what are the actual "peak hours" for GOG, all over the world. And then one could try to avoid those when e.g. running full gogrepoc update. Or will each main area have their own servers anyway, so just pick 2AM - 6AM your local time for the update?
EDIT: Oh, and why are you using gogrepoc "almost every weekday"? Just asking as I tend to do a full refresh to my local GOG repository like once a month, sometimes much more rarely. Now I will probably do it again as I've recently bought quite many important games that I want to add to the local repository.