Well, Valve and Linux Gaming together have come a very long way since the early blogs posts about getting Left 4 Dead 2 running fast on Linux to the new Steam Deck. But just how far have they come? Let's do a little reminiscing.
The Rise of Steam on Linux
It's hard to imagine that it's now been around 9 years since Valve confirmed that the Steam Client would be coming to Linux, after previously denying it was happening back in 2010 in an interview with GamesIndustry.biz. Things were pretty quiet until much later in July 2012 when it would all be confirmed. Valve opened up their special Linux blog to talk about their plans, where they said Gabe Newell had directly been interested in getting Steam and the Source game engine to Linux.
During July 2012 it was also the time that Valve's Gabe Newell mentioned his intense dislike for Windows 8, saying very clear and bluntly how "I think Windows 8 is a catastrophe for everyone in the PC space.".
After that, their now quite famous (amongst Linux users) blog post titled Faster Zombies! appeared in August 2012 to talk about getting their games performing well on Linux, to the point that they mentioned it ran better with OpenGL than on Windows 7 with Direct3D.
This was felt across the industry, with many taking notice of what Valve were saying, even back then they were a company everyone had a keen eye on. Even Microsoft took interest, as ex-Valve developer Richard Geldreich mentioned in a personal blog post how weeks after the Faster Zombies post that Microsoft appeared and seemed to start taking DirectX seriously again. So not only did Valve's plans for Linux expand to everything we have now, elements of it caused Microsoft to improve gaming too.
What began with a limited Beta that saw over 60,000 people originally sign up for testing back in November 2012, Valve quickly expanded to a fully public release in December of 2012. Things didn't calm down after this, with Kotaku catching up with Gabe Newell in December 2012 on the red carpet at the VGAs who briefly mentioned some sort of hardware plans. This was then backed up by reports quickly circulating in January 2013 about a Valve engineer attending the SSIM 2013 conference where they seemingly confirmed an upcoming Valve console. This was later confirmed in another article on The Verge in January 2013 where Newell talked a little about their plans.
Moving forward to February 14, 2013 and Valve then officially released the Steam client for Linux for everyone as it left Beta. From there, things have changed a lot over the years.
Picture - Valve, 2013.
After they released Steam for Linux properly in early 2013, it was a very exciting time to be on Linux. Suddenly so many of us felt this awesome sense of validation that not much else had done before (except, perhaps, early Humble Indie Bundles). A lot more was yet to come. Finally, we could tell our friends "I run Linux!" and not be laughed out of the room. Okay, that didn't happen, they still laughed but at least we could go home and play Left 4 Dead 2 to dry our tears.
You could of course play games on Linux before Steam arrived, however it was few and far between. Being realistic, we had close to nothing worth talking about. Mostly a bunch of open source games, id Software threw out a few unsupported Linux builds like Doom 3 and Quake 4, and certain earlier stuff), there were also a few older ports from the likes of Loki Entertainment and Linux Game Publishing (who both died out some time before) and quite a few Humble Indie Bundles but Steam arriving really helped usher in something of a small golden age for Linux gaming. Even back then the compatibility layer Wine was in some really rough shape and not a whole lot worked and performed well (there was some that did though of course).
Along with the release, when Team Fortress 2 also let everyone on Linux in officially Valve did something a bit amusing. They offered up a "Tux" Penguin in-game cosmetic item, to anyone who joined the game on Linux up until March 1, 2013.
At this point things were going well but why? Sure, Newell disliked where Windows was going but was that enough to suddenly pump resources into a completely unproven market for serious gaming? Was it the upcoming Steambox?
SteamOS and Steam Machines
It really wasn't long before everything would change yet again and we would have some real answers. We come to September 2013, and it all suddenly became rather serious, with Valve finally announcing SteamOS and Steam Machines. Looking back on it a lot of people probably don't remember just how close this announcement was to Steam coming to Linux, a time when everything was so fresh.
A mere 9 months or so between a public Steam for Linux Beta to the Steam Machine announcement. It's actually a little bit crazy to think about how ridiculously quick everything moved back then.
Direct Link
Valve's Gabe Newell famously said "Linux really is the future of gaming" which you can see in the video above. See the full talk from Gabe Newell available on our YouTube Channel.
We did end up seeing specialised porting companies including Feral Interactive, Aspyr Media, Virtual Programming and many smaller developers like Ryan "Icculus" Gordon, Ethan Lee, Knockout Games and others try to get more AAA/AA and indie games on Linux. For a time they succeeded with XCOM, Borderlands 2, Civilization V and VI, Mad Max, Tomb Raider, Company of Heroes 2 and so on plus tons of high quality indie games.
The first of those bigger ports (apart from Valve's own titles) was likely Serious Sam 3: BFE from Croteam which was playable on Linux shortly after Steam arrived. The likes of Civilization V from Aspyr Media didn't come until June 10, 2014 closely followed by XCOM: Enemy Unknown from Feral Interactive on June 19, 2014.
Remember this image?
This banner for The Witcher 3 wasn't live on Steam for particularly long in June 2014, only a few hours, until Valve pulled it down and neither Valve or CDPR ever properly commented on what actually happened. As a side point, Valve's investment into Wine to turn it into Steam Play Proton (along with DXVK, VKD3D-Proton) should help prevent anything like that happening again. We did speak to a few developers back in 2017 on why Linux games saw delays and plenty of it still remains true years later.
It should also be made clear that Valve had a nice hand it the creation of Vulkan too, including early visits from The Khronos Group to Valve's offices. Valve developer Pierre-Loup Griffais was also involved early on too, including doing talks on it back in 2015 at GDC although they were involved earlier than this. One such talk can be seen here with other industry members. Over time Valve developers and contractors (amongst other vendors) have also worked on various Vulkan extensions. Developer Dan Ginsburg did a presentation at SIGGRAPH in August, 2015 about porting Source 2 to Vulkan and then Valve were also one of the earliest companies to showcase Vulkan actually being used in Dota 2.
Everything seemed pretty calm then for a while, we saw a number of ports appear and we seemed to be enjoying quite the heyday. Eventually, Valve released the Steam Machines and SteamOS after a few years in November 2015 and it turned out pretty quiet - there were no major new releases to come along with it. Honestly, the launch was thoroughly underwhelming overall.
Steam Machines were unfortunately pretty short lived for many reasons. The marketing was overall pretty confusing, with multiple vendors appearing (and some never actually went through with making one), there wasn't actually many games and as it turned out there really wasn't a big market for yet another living room box at the time. The point about games was an especially harsh point, with multiple confirmed ports never actually happening. It also didn't take long for things to drop off after the failure of Steam Machines and most companies over time reduced the amount they ported or stopped entirely. Linux gaming was now getting into a tougher spot.
However, it's worth remembering the impact that Steam Machines actually had. They absolutely did trigger something that for Linux users was felt long after they vanished. Linux gaming went from close to nothing, to (currently) near to 8,000 games marked as having a Linux version on the Steam store. Porters like Aspyr Media (original interview) and Feral Interactive (original interview) both mentioning that getting into Linux ports was due to Steam Machines and SteamOS. Not only that, the various game engines that added Linux support too, more apps come to Linux and so on - the resulting improvements were felt everywhere.
No matter what, Linux on the Steam Hardware Survey didn't move a whole lot (some stats). Never managing to break 3% and often hovering around 1% for years. Questions were starting to be asked about Linux and Linux gaming, and how things could improve. What would Valve do now Steam Machines were gone and properly wiped from Steam back in March, 2018. After this though, Valve developer Pierre-Loup Griffais (who has been heavily involved in Steam Machines, Proton and now the Steam Deck too) mentioned in a post on Steam how Valve were continuing to support Linux and they had some plans in motion they weren't yet ready to talk about.
DXVK, Steam Play Proton
What plans? What could Valve possibly be doing? Why were they still investing into Linux gaming? They're not a charity, they're a for-profit business and honestly Linux gaming can't have been making them much money over this time, a drop in the ocean compared with the revenue they get from a cut of Windows games. So why?
Curiously, a project called DXVK appeared back in January 2018. DXVK translates Direct3D 9, Direct3D 10 and Direct3D 11 to Vulkan when used with Wine. This means you get better performance from Windows games played in Wine with it, with the first title it supported being NieR:Automata. It very quickly expanded to cover more games, gain more performance improvements and make Wine gaming suddenly pretty impressive with it. People repeatedly asked the developer how they could support them and donate, which the developer repeatedly denied and just carried on working. Why was it suddenly getting lots of updates?
It wasn't long before we found out why to all of those previous questions.
Rumours started flying once again on August 14, 2018 about Valve possibly adding support in the Steam client for compatibility tools. We speculated they might use Wine and DXVK and even DOSBox and of course we were totally unprepared for what was to come only a week later.
Suddenly on August 21, 2018 we had the official announcement from Valve about a new version of Steam Play in partnership with the company CodeWeavers. Originally, Steam Play was a simple tag/icon on Steam to show that you would buy the game once and have access to all versions of a game (Linux, macOS, Windows) but this tag was actually removed from the Steam store at some point in 2016. Valve had taken the Wine project, added in DXVK (confirming they were funding its development) along with other patches and integrated it into the Steam client to enable running Windows games on Linux with Steam. This began a whole new way to play games on Linux, without fiddling directly with Wine for those titles that didn't have Linux versions and with that something of an explosion in the popularity of Linux gaming with many bigger sites and YouTubers actually taking notice.
You can see our previous interview with the creator of DXVK for some background info.
After the news of Proton we went around to a few developers to find out what their opinion on it was including porter Ethan Lee, Subset Games, and Rémi Verschelde of Godot Engine. Worth noting that porters Ethan Lee and Ryan Gordon have some updated thoughts as of July 2021.
There were a few times when things looked a little dicey. One such example is where Canonical, creator of Ubuntu Linux announced back in June 2019 that they would be dropping 32bit support for future Ubuntu releases. Valve were clearly not amused, stating they would no longer support Ubuntu or recommend it and it wasn't long before Canonical did something of a 180 and decided to continue supply 32bit packages but in a frozen form. Panic over? Phew. Thankfully, it all seemed to be quiet after that.
Valve continued to get more improvements across Linux in a number of ways since the Proton announcement. One of them was the Steam Linux Runtime Container in November 2019, which allows you to put games into a more contained environment that can prevent dependency issues and it gives developers something more solid to test against. Later, Valve then updated Proton to also use the newer runtime contain system as of Proton 5.13-1 in October 2020. A clever and very useful idea, since there's some older ports that end up with some sort of library dependency rot that causes them to break on newer Linux distributions. Even some modern ports have trouble, like Game Maker Studio which doesn't seem to supply the Linux dependencies needed and ends up relying on exactly what ships with Ubuntu (causing libcurl errors) - which Valve now seem to have solved with the latest updates to the Steam Linux Runtime Container as of the last month or two.
Collabora is another company Valve has been working with to improve Linux gaming too. Collabora developers have been involved in the Steam Linux Runtime Container, along with hacking away at the Linux Kernel with "futex2" to try and get new features hooked up to help Wine and Proton - which as of earlier in July 2021 still hasn't been finished and merged into the mainline Linux Kernel. This Kernel work should further help compatibility and performance with Windows games and Proton.
Direct Link
This overall Linux improvement work continued apace, with Valve getting work done on AMD GPU drivers to improve performance even further with the announcement of a new Mesa shader compiler "ACO" in July 2019. The idea was to reduce shader compile time for games, and help to increase overall FPS while reducing some stutter too. No guessing needed on why they focused on AMD GPUs, as they have open source drivers so Valve had the ability to actually do something about it directly.
Even more was coming. Valve forked the VKD3D project as VKD3D-Proton from the Wine team which, which focuses on translating Direct3D 12 to Vulkan for Proton (which seemed to appear properly around July 2020). This was Valve clearly preparing for the next wave of Windows games, which would increase the number using Direct3D 12 and plenty would likely not have options for earlier versions so they needed to do something. It's worth noting here that the original creator of Wine's VKD3D died back in 2019. So now they had the ability to quickly bring up Direct3D 12 support for Proton without relying on the Wine team.
That wasn't the last of it, there's many other things across Linux that Valve has helped funding. Like the Zink driver for example, which runs OpenGL on top of Vulkan as Valve has been sponsoring developer Mike Blumenkrantz to work on it too.
One big question remained: why were Valve doing all of this? What was the point? Much like when we wondered with previous announcements, there needed to be a goal. Linux was still not gaining any notable ground on Steam. Finally, the real answer came on July 15, 2021.
Steam Deck
Nearly a decade later we come to the Steam Deck (see also: our early thoughts), the culmination of all the work Valve and their contractors and partners have put in to usher in the possible next golden age of Linux gaming. It's truly hard to imagine just how much a difference it will make right now, but hardware is absolutely the key to gaining more market share and getting users and developers to properly pay attention.
At last, your Steam library can follow you around everywhere and taunt you on how much of it you haven't yet played.
The Steam Deck has the chance to really get everyone and their dog to pay attention to Linux in some way. Not only is it a handheld gaming device, it's also a full Linux desktop too. Powered by SteamOS 3, which is based upon Arch Linux under the hood if you hook it up to an external monitor, and you've got yourself the full Linux experience. At last, "btw I use Arch" will no longer be just a meme but a reality for many people (and lots won't even realise it still) and perhaps now it will turn into Arch Linux gaming on the toilet, or the train - whatever.
It's been a long 9+ years for Valve and Linux.
With thanks to win8linux for the title idea.
Article taken from GamingOnLinux.com.
I think CatKiller was referring to developers, not "most people".People have already experienced what it's like to have the whole industry under Microsoft's control, and I don't think they're keen to have that continue indefinitely.Honestly, IMO, most people do not care about underlying technology.
ElectricPrism Jul 23, 2021
LinuxCon September 16th, 2013
Gabe Newell
https://www.youtube.com/watch?v=Gzn6E2m3otg&t=14:08
Time Index 14:08
"These other [proprietary] systems put a tremendous number of road blocks in the way of doing that. It takes Valve several months to get through certification process for a single update. It took us 6 months to get one update through the Apple Store to ship an iPad update. We have a lot of resources and have a huge commercial motivation. No individual user if they are the center of gravity for content production is going to have the wherewithal or stubbornness to get through that.
One of many ways that closed systems appear to us to be antithetical to our user-centric model of content production going forward.
Time Index 15:05
"We think that process is going to continue [to shift to user created content] and we think that we need to be knocking down as many barriers and reducing friction not going in the other direction."
--
If you wanted to enhance the article I think notation of Valve's early on interest in SDL v2 and getting Linux Input ready for the vast array of Proprietary Controllers that work out of box was also a pretty amazing achievement that made Linux Gaming give Windows a run for its money where the controller setup was much less easy & less intuitive.
Edit: On this occasion I must also say. Valve by and large made PC Gaming what it is today. And now they are making Linux the PC of Choice where games don't simply rot and break as time marches on. What Valve is doing is preserving their PC Gaming legacy & enabling PC Gamers to bring their library with them into the future as they enjoy new games they can enjoy old games too without keeping around a obscure PC box or console with old controllers in various worsening conditions.
Valve set out to make game development on Linux easier, and that's exactly what they achieved.
Last edited by ElectricPrism on 23 July 2021 at 6:00 pm UTC
Yes. Well, the ecosystem.I think CatKiller was referring to developers, not "most people".People have already experienced what it's like to have the whole industry under Microsoft's control, and I don't think they're keen to have that continue indefinitely.Honestly, IMO, most people do not care about underlying technology.
People don't seem to generally use Windows because they like using Windows, but because it's where developers put their applications and because it's what came with their computer. Historically, Microsoft were ruthless about maintaining those pillars and making sure that no competitor was visible or viable. For them it was a virtuous cycle, and for everyone else it was chicken and egg.
Microsoft fought the Browser Wars so hard because they knew that if people wrote applications for the Internet then Microsoft would lose its platform grip on developers. And that's what happened, albeit later than it could have been. On the hardware front, Microsoft made sure that they got paid for every purchase - whether it used their OS or not - to prevent anyone else being able to compete on price. They managed it with PCs and phones.
Microsoft of the 90s seemed undefeatable; Microsoft now seems like they've already lost. But it might all be wishful thinking.
ElectricPrism Jul 23, 2021
Microsoft of the 90s seemed undefeatable; Microsoft now seems like they've already lost. But it might all be wishful thinking.
I'll go on record saying Microsoft has indeed already lost. According to the verge there are over 3 billion active Android devices in the world.
Numerically, Android/Linux is king. iOS is probably second, and then the desktop operating systems after that.
Edit: If you look at Microsoft's behavior over the last few years too they have started to do some odd things like create their own line of computers, begin to promote SaaS Software as a Service and strengthen their server divisions, Xbox and so on -- reducing Windows 10 price to $0 for a while -- essentially their OS license wasn't their bread and butter anymore and they realized it so they subsidized it. They also bought Mojang to get control over MineCraft and several other game studios to steer the teenage demographic back into their Walled Garden -- because they realized most kids and teens experience with electronics is on Android and iOS phones and they literally had 0 interest or need for Windows -- Microsoft was not "needed" -- a problem Microsoft intended to correct.
Edit 2: Microsoft also got the sense that their grip over developers was weakening too, developers no longer focused on their obscure technology as the web evolved and popularity rose with iOS, Android, and Linux. They also "corrected" this "problem" by buying GitHub and [ installing ] themselves into the center of the developer community to try to ensure their longevity to exert influence to ensure their survival.
RIP GitHub, especially after the illegal AI stealing code from their users and literally breaking licenses & laws to do it.
Last edited by ElectricPrism on 23 July 2021 at 6:33 pm UTC
Mohandevir Jul 23, 2021
And I'm sure some portable gadgets will follow (be it "Surface Go", "Xbox on Wheels" or whatever).
Round two! Fight!!!
i mentioned this recently in the deck threads and got a lukewarm reaction. But i think your right, if the deck is popular other larger tech giants will follow.
In fact, what I said, in that thread, it's that Microsoft could launch a handheld. It's probably the only company in a position to offer a pricing range that matches Valve's Steam Deck (30% cut on Xbox games?). But Microsoft is Xbox centric, when it comes to gaming, so i'm quite sure that it would be a lockdown Xbox handheld that will serve to promote Xbox Gamepass and XCloud. My 2 cents.
Edit: As for Steam being integrated to the Windows store, they have no choice but to aknowledge Steam's domination and deal with it. I don't think it would lead Microsoft to supply an hardware platform to the likes of Steam.
Last edited by Mohandevir on 23 July 2021 at 6:53 pm UTC
Microsoft of the 90s seemed undefeatable; Microsoft now seems like they've already lost. But it might all be wishful thinking.
I'll go on record saying Microsoft has indeed already lost. According to the verge there are over 3 billion active Android devices in the world.
Numerically, Android/Linux is king. iOS is probably second, and then the desktop operating systems after that.
Edit: If you look at Microsoft's behavior over the last few years too they have started to do some odd things like create their own line of computers, begin to promote SaaS Software as a Service and strengthen their server divisions, Xbox and so on -- reducing Windows 10 price to $0 for a while -- essentially their OS license wasn't their bread and butter anymore and they realized it so they subsidized it. They also bought Mojang to get control over MineCraft and several other game studios to steer the teenage demographic back into their Walled Garden -- because they realized most kids and teens experience with electronics is on Android and iOS phones and they literally had 0 interest or need for Windows -- Microsoft was not "needed" -- a problem Microsoft intended to correct.
Edit 2: Microsoft also got the sense that their grip over developers was weakening too, developers no longer focused on their obscure technology as the web evolved and popularity rose with iOS, Android, and Linux. They also "corrected" this "problem" by buying GitHub and [ installing ] themselves into the center of the developer community to try to ensure their longevity to exert influence to ensure their survival.
RIP GitHub, especially after the illegal AI stealing code from their users and literally breaking licenses & laws to do it.
And of course there is also this: https://github.com/microsoft/CBL-Mariner no desktop, only server, but still :-)
once we get the linux year, can we start fighting for the bsd year?
You already had that with PS4 and PS5. Wish you luck with games for BSD on PCs, but you'd need something like Amazon throwing all their might behind it, I fear.
Last edited by const on 23 July 2021 at 11:35 pm UTC
Philadelphus Jul 24, 2021
Overall, if we look at the picture as a whole, it seems this is a market share war and Microsoft seems to be the lead in this "dance". Valve does not act; it reacts to Microsoft's input.And as we all know, Villains Act, Heroes React.
And CDProjekt? A reaction to a reaction… Does English have a word for that?A counter-reaction?
Why were they still investing into Linux gaming? They're not a charity, they're a for-profit business
Valve is a privately owned company, with Gabe Newell owning the majority of it – maybe even all of it. So whether Valve’s goal is to maximize profits or not really depends on what Gabe wants the company to do, he could decide to pour all profits into Linux game development if he wanted to, if that makes him happy.
Side note: It’s funny that Gabe and his co-founder worked at Microsoft before they decided to launch Valve. So the connection between Valve and Microsoft is closer than for most gaming companies.
once we get the linux year, can we start fighting for the bsd year?
You already had that with PS4 and PS5. Wish you luck with games for BSD on PCs, but you'd need something like Amazon throwing all their might behind it, I fear.
it was an joke.
but couting ps4 is not much different from counting stadia, nes mini, playstation classic, sega Lindbergh arcades, sega game gear, as linux devices.
speaking of it, look how many devices we have!
all those mentioned above, android, atari vcs, steam deck.
and in the past sony officialy supported linux on ps2 and ps3
I sometimes reflect on this whole ride and I tell to myslef how exciting this whole ride has been, and hopefully there is an even brighter future :)
Proton is great and will surely help Steam Deck from a shorter time perspective, but I really hope that this won't lead to no new native ports of AAA games. Native ports are (almost) always better, at least in my opinion.
Soldier is for native games.
The problem with native is that there are so many different distributions with each their own problems. It's worse than windows.
Soldier should be like a virtual env where nothing changes so games should work in 5 years too.
Most linux games I have are not worth to try to get running these days unless the engine is open source. I just buy the windows version again and use proton.
But at that time it was better than nothing. And enough to show Lord Gaben it is viable.
So once it's worth it's while, bigger or more tech savvy software houses will make a linux build targeting soldier with even better support, like CRO-team.
In the mean time, proton will attract the windows users.
Why? well, this is why:
https://www.youtube.com/watch?v=bSQn4OIsXqw
Games run better on Steam/Proton/Linux than on Windows.
https://www.youtube.com/watch?v=05Z8wvnJM3Q
Last edited by Ardje on 30 July 2021 at 10:26 am UTC
Patreon
PayPal
See more from me