It may have taken me all evening to do, but that's an evening well spent. The Sales Page will now be importing sales from Steam.
It's taken a long time to find an easy way to do it, since Steam changed their API a while ago which made it difficult (the SteamDB guys have their own ways, but far too complicated for me).
We are essentially scraping their HTML and parsing it. Using this script to do the heavy lifting and my code to parse it all together and keep track of it in the database. I actually only discovered it thanks to this lovely website that actually has a box that briefly explains how they managed to do it.
I will have to adjust it any time Steam changes their design, but they hardly ever do that so it shouldn't be much of an issue. The search pages we use especially almost never change.
Thanks to everyone's support on Patreon, I am able to properly spend time on the website once again, as well as doing the news. Thank you!
This should certainly make the Sales Page a lot more useful now!
If you have ideas for the page to make it more useful, now is the time to let me know.
Now if you'll excuse me, I'm off for a well deserved glass of rum.
It's taken a long time to find an easy way to do it, since Steam changed their API a while ago which made it difficult (the SteamDB guys have their own ways, but far too complicated for me).
We are essentially scraping their HTML and parsing it. Using this script to do the heavy lifting and my code to parse it all together and keep track of it in the database. I actually only discovered it thanks to this lovely website that actually has a box that briefly explains how they managed to do it.
I will have to adjust it any time Steam changes their design, but they hardly ever do that so it shouldn't be much of an issue. The search pages we use especially almost never change.
Thanks to everyone's support on Patreon, I am able to properly spend time on the website once again, as well as doing the news. Thank you!
This should certainly make the Sales Page a lot more useful now!
If you have ideas for the page to make it more useful, now is the time to let me know.
Now if you'll excuse me, I'm off for a well deserved glass of rum.
Some you may have missed, popular articles from the last month:
All posts need to follow our rules. For users logged in: please hit the Report Flag icon on any post that breaks the rules or contains illegal / harmful content. Guest readers can email us for any issues.
It will certainly be useful during Steam sales. ;) Also gone are the days when I could name all Linux games. I look at the list, and there is a bunch I have never even heard of. Man, I imagine it's nigh impossible for them to get any publicity on more saturated platforms.
1 Likes, Who?
Just a note, you can easily filter for Linux games deals at your preferred store using [isthereanydeal.com](https://isthereanydeal.com). You can place titles in your wishlist and be notified via email or rss. Maybe we don't need to re-implement that site here, that one works really well.
0 Likes
Just a note, you can easily filter for Linux games deals at your preferred store using isthereanydeal.com. You can place titles in your wishlist and be notified via email or rss. Maybe we don't need to re-implement that site here, that one works really well.I am fully aware other sites exist. That particular websites Linux filter doesn't even work, tons upon tons of Windows only games when filtering to Linux.
Like everything on GOL, we do things our own way because we want to do it differently.
Last edited by Liam Dawe on 8 Jun 2016 at 10:48 pm UTC
2 Likes, Who?
Thanks for this!!! Just bought trine.
1 Likes, Who?
Just a note, you can easily filter for Linux games deals at your preferred store using [isthereanydeal.com](https://isthereanydeal.com). You can place titles in your wishlist and be notified via email or rss. Maybe we don't need to re-implement that site here, that one works really well.
Or perhaps some of us appreciate being able to come here for our news and deal searches knowing they are already narrowed down to linux.
The effort is appreciated.
2 Likes, Who?
Make sure you don't extract data that is not exposed by the public API, because databases are also protected by copyright in the EU.
Last edited by Nyamiou on 8 Jun 2016 at 11:59 pm UTC
Last edited by Nyamiou on 8 Jun 2016 at 11:59 pm UTC
1 Likes, Who?
Awesomesauce!
1 Likes, Who?
Awesome. FYI it's only working for EUR prices currently. I'm pretty sure the sale % will be consistent across regions though.
0 Likes
Gog Summer Sale is On
http://www.overclock.net/t/1602468/gog-summer-sale-is-on
https://www.gog.com/
-- Looks like I'm late I noticed the post in the feed just now prior to this one, dunno how I missed that.
Last edited by ElectricPrism on 9 Jun 2016 at 4:54 am UTC
http://www.overclock.net/t/1602468/gog-summer-sale-is-on
https://www.gog.com/
-- Looks like I'm late I noticed the post in the feed just now prior to this one, dunno how I missed that.
Last edited by ElectricPrism on 9 Jun 2016 at 4:54 am UTC
0 Likes
nice job!!
0 Likes
Hey thats very useful, thank you, good work !
0 Likes
The Raven - Legacy of a Master Thief is -90% on Bundle Stars, but I'm not sure they even count Linux sales.
0 Likes
Make sure you don't extract data that is not exposed by the public API, because databases are also protected by copyright in the EU.
Looks like Liam is scraping the public Steam Store so there is no way that he could expose non public data.
0 Likes
Bingo, we are only using the data you would see with your eyeballs.Make sure you don't extract data that is not exposed by the public API, because databases are also protected by copyright in the EU.
Looks like Liam is scraping the public Steam Store so there is no way that he could expose non public data.
0 Likes
You did a very awesome job. Congratulation.
If you're looking for a next improvement, I would like to have a watch list of games and being notify when they get a rebate.
If you're looking for a next improvement, I would like to have a watch list of games and being notify when they get a rebate.
0 Likes
The Raven - Legacy of a Master Thief is -90% on Bundle Stars, but I'm not sure they even count Linux sales.Of course all the caveats of dealing with key resellers apply.
0 Likes
I am doing an overhaul of the sales page at the moment, so it will group the same sales together from different stores, so no more duplicate sales from different stores. I'm also going to stop showing all currencies at the same time, as it makes no sense. You will be able to set the currency you want to see and change it any time.
Once that is done, I will look into implementing a wish list for people to get notifications.
It already has an RSS feed (RSS button is at the top of the page).
Once that is done, I will look into implementing a wish list for people to get notifications.
It already has an RSS feed (RSS button is at the top of the page).
0 Likes
See more from me