It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
Community
General discussionGOG Database - A website that collects data on GOG games(775 posts)(775 posts)
(775 posts)
Pages:
1
2
3
4
5
10
20
30
40
52
This is my favourite topic
Posted June 16, 2017
Very nice—big thumbs up!
Posted June 16, 2017
high rated
avatar
muntdefems: I cannot help any of you in that regard (have you tried contacting mrkgnao?), but I could send you the complete list of existing packages with the correspondence between catalog ID and library IDs. :)
I have contacted mrkgnao and he gave me his scraper code including all the hardcoded mappings. Thanks for the offer though :).

avatar
adaliabooks: It's not too difficult to do manually, the trick is to find a way to automate it so we don't have to, and that's where the issue arises.

I've even asked Johny about it in the past and whatever method Gog uses of giving you the right products in your library when you purchase a pack is either entirely server side or occurs by magic. Neither of which is very helpful to an endeavour like this.
Most of the packages are deluxe editions and should work really well with the cart method. The 1+2+3 bundles are also really easy to figure out using some fuzzy matching. For the few items where that's not the case it should be possible to do them manually.

But I just remembered another method. The account page has a store link for every game which gives us the last bought pack that contains the game. If we can convince a few users with massive libraries to "donate" their product list that should cover pretty much everything.
Posted June 16, 2017
avatar
Yepoleb: Most of the packages are deluxe editions and should work really well with the cart method. The 1+2+3 bundles are also really easy to figure out using some fuzzy matching. For the few items where that's not the case it should be possible to do them manually.
There is a thread list some of these packages. But many cases are not covered yet, I think.
https://www.gog.com/forum/general/bug_buy_base_game_upgrade_but_full_version_tagged_unowned
Posted June 16, 2017
avatar
Yepoleb: ...
The timestamps originate from Unix and have been in seconds since 1975. Milliseconds wasn't possible because it had to fit into a 32bit integer and that would have been just around 50 days of date range. It's the default in Python, PHP, Ruby, C++, C, C# and many more, the Java languages indeed seem to be the outliers.
Minor correction... UNIX epoch time counts the seconds that have elapsed since January 1st 1970 00:00:00 UTC not including leap seconds that have occurred over time, stored in a signed integer (which wraps on 32 bit systems in 2038, yay!). :)
Posted June 16, 2017
avatar
Yepoleb: But I just remembered another method. The account page has a store link for every game which gives us the last bought pack that contains the game. If we can convince a few users with massive libraries to "donate" their product list that should cover pretty much everything.
Now that is an excellent idea, I hadn't considered the store page links at all.
And they must come from somewhere because the library cards are generated purely by JavaScript.. I'll look into it when I get a chance.
Posted June 16, 2017
high rated
avatar
Yepoleb: GOG Database collects data from the store pages and Galaxy APIs and makes it accessible on a single page for each game. Currently its uses are a bit limited and mostly developer focused, but I have many ideas of features that could be useful for all players. As the name suggests, this project has been heavily inspired by Steam Database, you should definitely check them out if you're a Steam user.

Current features:
* Downloads list
* Basic API data
* Dollar price tracking

Planned features:
* Regional prices
* Store info tracking
* Non-store games
* File tracking

The site can be found at http://gogdb.yepoleb.me and is hosted on my home server, so please be gentle if it's going a bit slow.
Hey, I see some nice work done there! :) You must have spent lots of time on it. :) I see you've used colors, shadows and font from the site. For me it's always good to see our community involved.

I wonder if it will grow, since it's open source.
Posted June 16, 2017
nice work!
Posted June 16, 2017
avatar
Yepoleb: But I just remembered another method. The account page has a store link for every game which gives us the last bought pack that contains the game. If we can convince a few users with massive libraries to "donate" their product list that should cover pretty much everything.
I've had a look, unfortunately the functions that retrieve those URLs only work on owned games... I'm trying to see if there is a work around but I'm not confident there will be...
Posted June 16, 2017
avatar
Yepoleb: But I just remembered another method. The account page has a store link for every game which gives us the last bought pack that contains the game. If we can convince a few users with massive libraries to "donate" their product list that should cover pretty much everything.
Ah, well, that doesn't sound too bad. Bummer that it can't be used on unowned products, as adaliabooks just mentioned. If you need a list of all the "pack" ids in order to make sure you have all the bundles covered once you get the implementation rolling, just let me know ;).
Posted June 16, 2017
wow, very nice. its great to pull up the extras in one go. i will also be watching the price tracking as it gains more data with time


thanks!
Posted June 16, 2017
This is gonna be huge someday. Thanks for your hard work!
Posted June 16, 2017
Excellent job. Bookmarked your site.

I have one question. Why are there two types (Package and Game) for some games? Like Fallout 3 for example.

http://gogdb.yepoleb.me/product/1248282609

http://gogdb.yepoleb.me/product/1454315831
Post edited June 16, 2017 by Engerek01
Posted June 16, 2017
avatar
Engerek01: Excellent job. Bookmarked your site.

I have one question. Why are there two types (Package and Game) for some games? Like Fallout 3 for example.

http://gogdb.yepoleb.me/product/1248282609

http://gogdb.yepoleb.me/product/1454315831
Package is a bundled game, basically the ID you get in the library is different than the catalogue or you get multiple games.

There are two entries for the Bethesda games because the original ones didn't include the free Daggerfall or Arena so they had to create new entries.
Posted June 16, 2017
high rated
avatar
Johny.: Hey, I see some nice work done there! :) You must have spent lots of time on it. :) I see you've used colors, shadows and font from the site. For me it's always good to see our community involved.

I wonder if it will grow, since it's open source.
Yes, I used a lot of style elements from the GOG site to make the site look more familiar to visitors and because I really like it. It's modern without being too minimalistic or wasting a lot of space. Not sure if the open source license(s) will help the site grow, it didn't really work with the API docs and they're really easy to contribute to, but I've already had some people use it as a reference for building their own stuff. Thanks for the kind words!

avatar
Yepoleb: But I just remembered another method. The account page has a store link for every game which gives us the last bought pack that contains the game. If we can convince a few users with massive libraries to "donate" their product list that should cover pretty much everything.
avatar
adaliabooks: I've had a look, unfortunately the functions that retrieve those URLs only work on owned games... I'm trying to see if there is a work around but I'm not confident there will be...
I don't think a workaround is necessary. I already know someone with access to about 1000 games and finding the remaining half shouldn't be much of a problem. Maybe Barefoot Monkey can help us out by modifying his script to allow uploading the library to GOGDB in addition to GOGWiki (or you do that). We'll see in the future, because I'm still far from being able to handle non-store games.
Posted June 28, 2017
I love this database already. Fast, clean and simple. Has already helped me confirm spot a true sale. Sweet. Thank you for your work Yepoleb.
Post edited June 28, 2017 by vidsgame
Pages:
1
2
3
4
5
10
20
30
40
52
This is my favourite topic
Community
General discussionGOG Database - A website that collects data on GOG games(775 posts)(775 posts)
(775 posts)