Language Selection

English French German Italian Portuguese Spanish

Hardware Reviews for Sale

Filed under

By Charlie Demerjian

I WAS PLANNING on going to sleep early tonight, and checked my email and a few sites before I went to sleep. Bad move, I am now to0 angry to sleep, so it is time to rant, and get a few things off my chest, all while outing a few dirty internet secrets.

It all comes down to this, the hardware review world is going to hell in a hand basket, and the reasons are money, stupidity, and PR people that are too effective. Low morals on the part of many in the scene are also to blame, but they only contribute to the problem.

One of the nice things about working for The INQ is that you are not only dissuaded from ever signing an NDA, but you are strictly forbidden from doing it. While this may seem like a stupid thing on the surface, it is probably the best thing that can happen to a hardware person. It takes one of the biggest levers away from the unscrupulous PR and industry people. As an aside, I would say that the vast majority of PR people and hardware companies are above the board, good and solid people, but it does not take many to spoil the entire industry.

The no NDA rule pretty much rules out that. The INQ will bring you reviews the second that the products come out, people won't send us things if they know we will scoop everyone else. Fair enough, they are right. This also affords us the ability to tell you about things first if we can find out about them. Things are not handed to us on a silver platter, but there is also no ability for a company to say no. Additionally, the things we find tend not to be spun so hard they warp space around them. Net result, you win, and tend to get the truth, or at least not a slightly reworded press release from us.

Hardware sites are also known to the companies and PR firms to be either docile ass-kissers, or, well, not. The docile ones are the ones you want to use to get a story out, especially if the story is not all that good if measured against the unvarnished facts. The docile sites are the ones that get the sneak peaks, exclusives and perks that few others tend to get. Some are too stupid to do more than reword press releases and swipe slides from PDFs, others are flat out bought. It does not take a genius to figure out which sites fall into which categories.

You notice I said bought. If you have any doubts, let me tell you, the current hardware review site industry is flat out for sale. The higher up you go, the fewer exceptions to the rule there are. Some sites are directly for sale, I am sure you have seen it, it is a hard thing to miss. It works like this, when an NDA expires, there are 10 or so reviews of a new chip, board or widget. Most use the same benchmark set, or at least most of the sites have a fair number of benches in common, it is really hard to avoid a Doom3 bench. 90% of the sites will have a similar result, part A beats part B in commonly used apps, with A winning 80%, B winning 20%.

One site will have the opposite result, and come up with a bunch of new benches, most of which tend to be very curious. Some are games that you wonder why they are included, some are just odd. End result, product B wins by a lot, and goes against the grain, common sense, and good taste. If you are wondering, someone really did just make a lot of money.

The bribery takes several forms, the first is pretty basic, you send a check in with a review. These tend to be the easiest to spot, if you spend $20K or so, you are going to make it pretty good for your product. Sometimes it isn't as blatant, and the site gets to conduct and write the review the manufacturer designed.

The next one is more subtle, you pay us and you get veto rights to a story that we are doing. If you do in essence pay for the story, and then decline to have it published, you don't the money back, but the site owner probably gets a shiny new car. This may seem less harmful, but I think it is more insidious. Closely related is the false separation of the editorial side of the business from the advertising side. The ad side acts as the gatekeeper, but ostensibly has no direct control of the stories. If you want your product in the next roundup, you better have an ad campaign already paid for.

This separation, while it sounds less sleazy, tends to lead to flat out bribes in really short order. I know of several sites who take this route, and it is really laughable how they try to spin this as 'we don't take bribes'.

The industry basically comes down to three things, the stupid, the for sale, and the meek, and combinations thereof. The players on the other side of the hardware reviews all know who is who, and who to go to to get the message they want out, when they want, how they want. That is why our industry is so fundamentally broken, they are always better funded than we are, and usually better organized. The fact that many sites go out of they way to help the bad side of the PR world only makes the corruption easier.

Several sites are shining beacons of abjectly not selling out, and not regurgitating spun information in frankly demeaning ways. They tend to have the hardest time of it, ending up not getting comments from the companies, having to buy their own hardware to review, and worse yet, not getting ad dollars. The sites and people in the industry that stand up sadly don't tend to last.

It couldn't be all that bad, can it? Well yes, it is, and I have witnessed most of it personally, and the rest I have heard from to many trusted sources to disbelieve. It really sucks when someone tries to hand you more cash than you have had in your bank account for the last 6 months, and you have to turn it down. How do I know, I have done it. I have also had more than enough companies with good, honest PR people tell me who is for sale, and the names all center around a small group of sites and people. If I had anyone who was willing to go on the record, I would dearly love to publish names, but the combination of being blacklisted and the inevitable lawsuits are more than enough to cower most people.

If you look, several candidates float to the top of this sewer. Some are the stupid, some are the for sale, some offer nothing more than press releases. Some do rock the boat, and tell the truth even when it is clearly not in their best interest. I feel their pain, having been shut out more than my fair share of times.

So what brought this on? The dual core release today. The two reviews I read, both on major hardware sites, were so flawed it was laughable. The first was an update so riddled with factual errors that it was laughable. Not complex errors that are forgivable, but well known facts, previously released, that make my head hurt. The person who wrote this story must simply be a moron, and the person who moves his lips for him when he reads must have the technical sense of your average brick. It physically hurt to read.

The next one was a review in full, or at least in half. It was stated that it was given as a special preview to the site, which set off warning bells number 1-3 in my head. It purportedly put up the dual core gaming chip against the single core gaming chip predecessor, and also against the gaming chip from the competition. It looked to be a great job, with lots of benchmarks, and an attempt to start up a new way of benchmarking in an environment with multiple tasks running. Cool, finally something worth reading.

To step sideways a bit, the current dual core chips are all going to suck on games regardless of whether they come from Intel or AMD. Both are heat limited and will debut several clock bins below their single core counterparts. The Intel side also takes a step backward in bus speed because of the added loads on the bus. All these are engineering realities, and in no way diminish the really great jobs both companies are doing to bring dual cores to the masses.

It does mean however that until software catches up, most likely not this year, that gaming is going to suck on them. They will cost more, take more power, and be a status symbol for the rich and stupid, but their frame rates will blow dead goats. On multitasking and multithreaded apps, they will shine like the sun, but how many of these are there? How many times do you encode a movie while typing a document, zipping your C drive, doing some heavy CFD work all while listening to a few MP3s? Yeah, me neither, but at least 3DSMax and photoshop will rock on the new chips.

Getting back to reality, imagine my surprise when I saw that this new preview studiously avoided games. They are testing two of the most popular gaming chips out there, and the heir to the throne, and they did not put in one single game benchmark. Not one, think about that.

In the rebuttal to this, there will be the usual cries of 'we were not testing gaming performance' or some such bullsh*t ass covering, but here is the truth, if you are going to multitask and do and do anything that tasks both of the CPUs, one of those is going to be a game.

If you read up on the benchmarks posited by the current crop of reviews, how many are things you do regularly? How many fit the a scenario that you have EVER found yourself in? How many of you would do 7 things concurrently if you had seven things to do rather than do one or two at a time, and probably end up at the finish line first? The human mind does not multitask well, so 19 active windows is 17 or 18 more than you really can use at once.

The simple fact is that these chips suck on games, so the preview was done either implicitly, explicitly, or with bushels of cash, but it was done is a very deliberate fashion. And you probably believed it. Think I am full of crap? Look at how many reviews the top sites did before today of either CPUs or GPUs, and count the numbers that had zero games. Count the number that did not even speculate about gaming performance. See a pattern? Toss in a few factual oddities, stretchings of the truth at the most innocent, and you have a wonderfully deniable bending of the truth with a purpose.

The whole affair today typifies everything I think is wrong with the industry. I didn't name names, post links, or lay blame directly on purpose. To be honest, this time I have no proof. People have tried to bribe me, people have tried to get me to write things they want written, and people have tried to cower me. I have told them all that they possess more than enough orifices to place their ideals. Today fits this pattern.

Today's crop of stories goes to graphically show who is either tame, openly influenced, or flat out bought. Read all the previews one after another, the patterns you see really are there, and the reasons they are there are as bad as you fear. Toss in that a couple of sites who you would have thought should get CPUs didn't, and you have the makings of a conspiracy. It isn't one though.

Well, that is enough venting for now. If I can't get to sleep after all this time, I can always stick my head out the window and scream until I get arrested. Hardware reviewers are going bad fast, and there are precious few left. I applaud the good ones, and decry the rest, hopefully in a way that makes things a little bit better. µ


More in Tux Machines

Ubuntu Budgie 18.04 Beta 2, Replacement for gksu

  • The Unique Ubuntu Budgie 18.04 Beta 2
    It is the most unique among the Official Flavors in the 18.04. It's the only to bring Chromium browser, and it gives you the unique Budgie Desktop experiences. It is really a good place for everyone who wants new, distinct desktop experience with modern version of software and broad space to explore. And ultimately it is still available for 32 bit, which has been abandoned by Ubuntu original. We will wait until the planned release on April 26.
  • Welcome To The (Ubuntu) Bionic Age: Behind communitheme: interviewing Frederik
    My name is Frederik, I live in Germany and I am working as a java software developer in my daily job. I am using Ubuntu since 5 years and quickly started to report bugs and issues when they jumped into my face. Apart from that, I like good music, and beautiful software. I also make my own music in my free time.
  • gksu Removed From Ubuntu, Here's The Recommended Replacement
    gksu is used to allow elevating your permissions when running graphical applications, for example in case you want to run a graphical text editor as root to edit a system file, or to be able to remove or add a file to a system folder.

Devices: Aaeon, Tizen and Android

OSS Leftovers

  • Open source crucial to Orange as it prepares for ONAP deployment
    Orange has long played a key part in the testing and adoption of ONAP, dating back to when its ECOMP predecessor was created by AT&T as a platform for managing a software-defined network. The move to open source and its development as the ONAP project has made the platform a key component of the new telco open networking movement. But why should other telcos look to ONAP as they embark on their network transformation strategies, and how does it help enable the automated network that will lead to new business opportunities?
  • Lessons from OpenStack Telemetry: Deflation
    At some point, the rules relaxed on new projects addition with the Big Tent initiative, allowing us to rename ourselves to the OpenStack Telemetry team and splitting Ceilometer into several subprojects: Aodh (alarm evaluation functionality) and Panko (events storage). Gnocchi was able to join the OpenStack Telemetry party for its first anniversary.
  • Dev-tools in 2018
    This is a bit late (how is it the middle of April already?!), but the dev-tools team has lots of exciting plans for 2018 and I want to talk about them! [...] We're creating two new teams - Rustdoc, and IDEs and editors - and going to work more closely with the Cargo team. We're also spinning up a bunch of working groups. These are more focused, less formal teams, they are dedicated to a single tool or task, rather than to strategy and decision making. Primarily they are a way to let people working on a tool work more effectively. The dev-tools team will continue to coordinate work and keep track of the big picture.
  • Nonny de la Peña & the Power of Immersive Storytelling
    This week, we’re highlighting VR’s groundbreaking potential to take audiences inside stories with a four part video series. There aren’t many examples of creators doing that more effectively and powerfully than Nonny de la Peña. Nonny de la Peña is a former correspondent for Newsweek, the New York Times and other major outlets. For more than a decade now, de la Peña has been focused on merging her passion for documentary filmmaking with a deep-seeded expertise in VR. She essentially invented the field of “immersive journalism” through her company, Emblematic Group.
  • Collabora Online 3.2 Brings More Powerful Features to LibreOffice in the Cloud
    Michael Meeks of the Collabora Productivity has the pleasure of informing Softpedia today on the availability of Collabora Online 3.2, the second point release of the Collabora Online 3 series that promises yet another layer of new features and improvements to the enterprise-ready, cloud-based office suite. Based on the LibreOffice 6.1 open-source office suite, Collabora Online 3.2 introduces support for creating and inserting charts into Writer and Impress documents, and the ability to validate data in Calc, which might come in handy for engineers who want to do a final assembly inspection on their tablets, as well as to collaborate with their colleagues to ensure all tests are passed by a complete product.
  • Oracle demands dev tear down iOS app that has 'JavaScript' in its name
    Oracle, claims developer Zhongmin Steven Guo, has demanded that Apple remove an app he created because it contains the trademarked term "JavaScript." The app in question, published by Guo's Tyanya Software LLC – which appears to be more a liability shield than a thriving software business – is titled "HTML5, CSS, JavaScript, HTML, Snippet Editor." The name, Guo explains in a Hacker News comment, was chosen in an effort to "game the App Store ranking by adding all the keywords to the app name."
  • FoundationDB is Open Source
    Starting today, FoundationDB starts its next chapter as an open source project! FoundationDB is a distributed datastore, designed from the ground up to be deployed on clusters of commodity hardware. These clusters scale well as you add machines, automatically heal from hardware failures, and have a simple API. The key-value store supports fully global, cross-row ACID transactions. That's the highest level of data consistency possible. What does this mean for you? Strong consistency makes your application code simpler, your data models more efficient, and your failure modes less surprising. The great thing is that FoundationDB is already well-established — it's actively developed and has years of production use. We intend to drive FoundationDB forward as a community project and we welcome your participation.
  • Apple Open Sources FoundationDB, Releases Code On GitHub
    Back in 2015, Apple bought FoundationDB, a NoSQL database company. It created a distributed database of the same name designed to deal with large masses of structured data across clusters of servers. In a recent development, Apple has shared the FoundationDB core and turned it into an open source project.
  • Microsoft offers limited-time 30 percent discount on SQL Server on Linux [Ed: Microsoft is googlebombing Linux again and as I predicted it would be done only to help Microsoft sell malicious proprietary software. Mary Jo Foley is like Microsoft marketing at CBS. In this case she promotes proprietary software. She also says "SQL Server on Linux" (no such thing exists, it's an illusion).]
  • Friday Free Software Directory IRC meetup time: April 20th starting at 12:00 p.m. EDT/16:00 UTC
    Help improve the Free Software Directory by adding new entries and updating existing ones. Every Friday we meet on IRC in the #fsf channel on Tens of thousands of people visit each month to discover free software. Each entry in the Directory contains a wealth of useful information, from basic category and descriptions, to providing detailed info about version control, IRC channels, documentation, and licensing info that has been carefully checked by FSF staff and trained volunteers.
  • Researchers deliver open-source simulator for cyber physical systems
    Cyber physical systems (CPS) are attracting more attention than ever thanks to the rapid development of the Internet of Things (IoT) and its combination with artificial intelligence (AI), machine learning and the cloud. These interacting networks of physical and computational components will provide the foundation of critical infrastructure, form the basis of ‘smart’ services, and improve the quality of life in areas ranging from energy and environment to transportation and healthcare. CPS technologies are already transforming the way people interact with engineered systems in the ‘real’ or ‘physical’ world, just as the internet has transformed the way people interact with information. Yet, due to their complexity, the developers of CPS face a major problem: the lack of simulation tools and models for their design and analysis.
  • Creators face an evolving challenge protecting IP
    The GNU General Public License, under which the operating system Linux and much open-source software is shared, is another example of copyleft. Open-source software, where programs are worked on together by loosely connected developer communities rather than traditional software houses, show one way IP can be shared without stifling innovation. Linux, the mobile operating system Android and the database system MySQL have all achieved widespread adoption, and are continually innovating despite, or perhaps because of, being open source.
  • Emerging Tech Speaker Series Talk with Rian Wanstreet
    This is an opportunity for the open source community, as alternative technologies and platforms are being developed which provide farmers the ability to farm outside of walled gardens. From open source seed initiatives, to open farm technologies, to data platform cooperatives, there is a small, but growing, collaborative movement that recognizes that farmers are at a critical moment: they can help to establish tools that advance freedom, or accept machines that foster dependencies.
  • Williamson Schools to develop open source social studies curriculum
    The open source science curriculum saved the district about $3.3 million. An open source social studies curriculum may post similar savings, with estimates at about $3.5-4 million, Gaddis said.
  • Large Open-Source Data Set Released to Help Train Algorithms Spot Malware
    For the first time, a large dataset has been released by a security firm to help AI research and training of machine learning models that statically detect malware. The data set released by cybersecurity firm Endgame is called EMBER is a collection of more than a million representations of benign and malicious Windows-portable executable files. Hyrum Anderson, Endgame's technical director of data science who worked on EMBER, says: "This dataset fills a void in the information security machine learning community: a benign/malicious dataset that is large, open and general enough to cover several interesting use cases. ... [We] hope that the dataset, code and baseline model provided by EMBER will help invigorate machine learning research for malware detection, in much the same way that benchmark datasets have advanced computer vision research."

Android Leftovers