I have been hoping to see something like this. Open Game Benchmarks is a brand new website dedicated to showing off benchmarks from Linux games.
Previously we've only really had Phoronix (and people know how I feel about the quality on Phoronix in recent times), so it's good to see some healthy competition in the Linux benchmarking area. While we do benchmarks, it's generally only on big new titles as we focus more on the Sales Page, the Calendar and general day to day Linux gaming news.
I was actually going to be adding something exactly like Open Game Benchmarks to GOL, but now I don't see a need which is great. I am going to try and team up with them to feature benchmarks here on GOL too.
It currently only supports games from Steam for Linux, as they claim that gives them a big enough selection and all high profile Linux games will be on it. It's hard to argue with that really, but I still hope they open up a bit in future if it's not too much trouble.
They also plan to open source it once they have cleaned it up enough, so that's even better news. I would hate for it to die off, and if it ever does we could always host it.
It has a nice simple layout, everything looks clean and to the point, it even has simple and nice looking graphs on each game. Article taken from GamingOnLinux.com.
Previously we've only really had Phoronix (and people know how I feel about the quality on Phoronix in recent times), so it's good to see some healthy competition in the Linux benchmarking area. While we do benchmarks, it's generally only on big new titles as we focus more on the Sales Page, the Calendar and general day to day Linux gaming news.
I was actually going to be adding something exactly like Open Game Benchmarks to GOL, but now I don't see a need which is great. I am going to try and team up with them to feature benchmarks here on GOL too.
It currently only supports games from Steam for Linux, as they claim that gives them a big enough selection and all high profile Linux games will be on it. It's hard to argue with that really, but I still hope they open up a bit in future if it's not too much trouble.
They also plan to open source it once they have cleaned it up enough, so that's even better news. I would hate for it to die off, and if it ever does we could always host it.
It has a nice simple layout, everything looks clean and to the point, it even has simple and nice looking graphs on each game. Article taken from GamingOnLinux.com.
0 Likes
Some you may have missed, popular articles from the last month:
The comments on this article are closed.
Jan 30, 2016
This could be really useful, not only to the gamers but also to the game developers. It makes things transparent which is always a good thing. Thumbs up!
1 Likes, Who?
The developer has already provided me with a feed to display the latest benchmarks on it, so I will look to find a way to include them on GOL the next time I push a big update.
3 Likes, Who?
Hey, OpenGameBenchmarks dev here! I am looking forward to make this little project of mine grow and mature with the help of the community. Let's bring gaming on Linux to new heights!
9 Likes, Who?
Doc Angelo Jan 30, 2016
I'm kinda curious how it will turn out, that these will be benchmarks of random scenery or level of a game. Someone could benchmark looking 5 minutes at the sky box at lowest settings. Someone else could upload a benchmark result of 5 minutes in a complex level with highest settings in 4k resolution. If there will only be 1 single average value, it will be pointless. But it's a young project, we'll see where it will go.
3 Likes, Who?
ChuckDaniels87 Jan 30, 2016
Great news!
0 Likes
Quoting: Doc AngeloI'm kinda curious how it will turn out, that these will be benchmarks of random scenery or level of a game. Someone could benchmark looking 5 minutes at the sky box at lowest settings. Someone else could upload a benchmark result of 5 minutes in a complex level with highest settings in 4k resolution. If there will only be 1 single average value, it will be pointless. But it's a young project, we'll see where it will go.
This.
I'm not sure I follow the purpose of the site at all. I'm all for a benchmark consolidation site where we all throw scores of our tests at but there are quire a few problems.
I can't run other peoples tests, so I can't compare against them. Allowing users to run their own tests at all seems dangerous, since the scores vary wildly depending on what your doing in game/test. Finally, I've noticed the only way to disginguish users is by hardware, driver (though NOT version), and distro (again, not version). So I could run Mesa on Ubuntu Warty Warthog and then try to compare against a seemingly same user running Ubuntu Utopic Unicon and obviously the results would be absolutely massivly different.
The concept is cool, but I can't see how the implementation is [i]useful/i].
If this seems like a rant, it's meant to be constructive critisizm. As someone who has been doing Mesa benchmarks for two years, I want to have tools that can reproduce results correctly.
0 Likes
Quoting: Half-ShotQuoting: Doc AngeloI'm kinda curious how it will turn out, that these will be benchmarks of random scenery or level of a game. Someone could benchmark looking 5 minutes at the sky box at lowest settings. Someone else could upload a benchmark result of 5 minutes in a complex level with highest settings in 4k resolution. If there will only be 1 single average value, it will be pointless. But it's a young project, we'll see where it will go.
This.
I'm not sure I follow the purpose of the site at all. I'm all for a benchmark consolidation site where we all throw scores of our tests at but there are quire a few problems.
I can't run other peoples tests, so I can't compare against them. Allowing users to run their own tests at all seems dangerous, since the scores vary wildly depending on what your doing in game/test. Finally, I've noticed the only way to disginguish users is by hardware, driver (though NOT version), and distro (again, not version). So I could run Mesa on Ubuntu Warty Warthog and then try to compare against a seemingly same user running Ubuntu Utopic Unicon and obviously the results would be absolutely massivly different.
The concept is cool, but I can't see how the implementation is useful.
If this seems like a rant, it's meant to be constructive critisizm. As someone who has been doing Mesa benchmarks for two years, I want to have tools that can reproduce results correctly.
Thanks for the fedback, I see where are you coming from.
As you know, having standardized tests is hard, if possible at all in this case, where the vast majority of games do not have a benchmark tool. One way could be having a set of hardware various enough, and doing all the tests in a controlled environment. The other way is letting the community accumulate data (surely noisy and less controlled) to a centralized place, and then try to make some sense of it: filtering, aggregating, normalizing, visualizing.
The idea here is I, random_linux_user_37, want to buy game X, and I want to know how with my settings (cpu, gpu, resolution) that game would run.
Another thing that I hope the site will provide is some sort of comparison grounds with Windows. Hopefully, with the accumulation of enough data, and possibly the development of automating tools (that for example can run a certain game at certain settings, certain stage, and then upload everything), we will have a solid ground to make informed decisions and try to push developers and porters to focus on better performance on Linux.
Finally, I could add even more fields like driver version and Linux distro; but on one hand I am a bit skeptical that that would be really that big of a difference (given same hardware and driver) between two Ubuntu versions (as in your example), and on the other hand adding variables can possibly complicate even more an already noisy situation.
QuoteIf there will only be 1 single average value, it will be pointless.That should not be the case; each benchmark is stored with all of its data, and several statistical measures are computed. And then you can compare benchmarks, selecting which one do you want to see (ex. "let's see how game X performs on open source and proprietary drivers")
Last edited by J_Salem on 30 January 2016 at 9:02 pm UTC
0 Likes
So why not using Phoronix test suite for this?
Is Linux/Windows, easy to install and can run tests in controlled conditions easy to reproduce.
Is Linux/Windows, easy to install and can run tests in controlled conditions easy to reproduce.
0 Likes
Like with anything that takes user input it can be gamed, but it won't be too hard to spot if there's more than one of each test done on a game.
0 Likes
Patreon
PayPal
See more from me