Language Selection

English French German Italian Portuguese Spanish

Servers: Hadoop, Amazon Rivals, Red Hat/IBM, Kubernetes, OpenStack and More

Filed under
Server
  • Breaking Out of the Hadoop Cocoon

    The announcement last fall that top Hadoop vendors Cloudera and Hortonworks were coming together in a $5.2 billion merger – and reports about the financial toll that their competition took on each other in the quarters leading up to the deal – revived questions that have been raised in recent years about the future of Hadoop in an era where more workloads are moving into public clouds like Amazon Web Services (AWS) that offer a growing array of services that many of the jobs that the open-source technology already does.

    Hadoop gained momentum over the past several years as an open-source platform to collect, store and analyze various types of data, arriving as data was becoming the coin of the realm in the IT industry, something that has only steadily grown since. As we’ve noted here at The Next Platform, Hadoop has evolved over the years, with such capabilities as Spark in-memory processing and machine learning being added. But in recent years more workloads and data have moved to the cloud, and the top cloud providers, including Amazon Web Services (AWS), Microsoft Azure and Google Cloud Platform all offer their own managed services, such as AWS’ Elastic Map Reduce (EMR). Being in the cloud, these services also offer lower storage costs and easier management – the management of the infrastructure is done by the cloud provider themselves.

  • A guide for database as a service providers: How to stand your ground against AWS – or any other cloud

    NoSQL database platform MongoDB followed suit in October 2018 announcing a Server Side Public License (SSPL) to protect “open source innovation” and stop “cloud vendors who have not developed the software to capture all of the value while contributing little back to the community.” Event streaming company, Confluent issued its own Community License in December 2018 to make sure cloud providers could no longer “bake it into the cloud offering, and put all their own investments into differentiated proprietary offerings.”

  • The CEO of DigitalOcean explains how its 'cult following' helped it grow a $225 million business even under the shadow of Amazon Web Services

    DigitalOcean CEO Mark Templeton first taught himself to code at a small hardwood business. He wanted to figure out how to use the lumber in the factory most efficiently, and spreadsheets only got him so far.

    "I taught myself to write code to write a shop floor control and optimization system," Templeton told Business Insider. "That allowed us to grow, to run the factory 24 hours a day, all these things that grow in small business is new. As a self-taught developer, that's what launched me into the software industry."

    And now, Templeton is learning to embrace these developer roots again at DigitalOcean, a New York-based cloud computing startup. It's a smaller, venture-backed alternative to mega-clouds like Amazon Web Services, but has found its niche with individual programmers and smaller teams.

  • IBM’s Big-Ticket Purchase of Red Hat Gets a Vote of Confidence From Wall Street
  • How Monzo built a bank with open infrastructure

    When challenger bank Monzo began building its platform, the team decided it would get running with container orchestration platform Kubernetes "the hard way". The result is that the team now has visibility into outages or other problems, and Miles Bryant, platform engineer at Monzo, shared some observations at the bank at the recent Open Infrastructure Day event in London.

    Finance is, of course, a heavily regulated industry - and at the same time customer expectations are extremely exacting. If people can't access their money, they tend to get upset.

  • Kubernetes Automates Open-Source Deployment

    Whether for television broadcast and video content creation, delivery or transport of streamed media, they all share a common element, that is the technology supporting this industry is moving rapidly, consistently and definitively toward software and networking. The movement isn’t new by any means; what now seems like ages ago, in the days where every implementation required customized software on a customized hardware platform has now changed to open platforms running with open-source solution sets often developed for open architectures and collectively created using cloud-based services.

  • Using EBS and EFS as Persistent Volume in Kubernetes

    If your Kubernetes cluster is running in the cloud on Amazon Web Services (AWS), it comes with Elastic Block Storage (EBS). Or, Elastic File System (EFS) can be used for storage.

    We know pods are ephemeral and in most of the cases we need to persist the data in the pods. To facilitate this, we can mount folders into our pods that are backed by EBS volumes on AWS using AWSElasticBlockStore, a volume plugin provided by Kubernetes.

    We can also use EFS as storage by using efs-provisioner. Efs-provisioner runs as a pod in the Kubernetes cluster that has access to an AWS EFS resource.

  • Everything You Want To Know About Anthos - Google's Hybrid And Multi-Cloud Platform

    Google's big bet on Anthos will benefit the industry, open source community, and the cloud native ecosystem in accelerating the adoption of Kubernetes.

  • Raise a Stein for OpenStack: Latest release brings faster containers, cloud resource management

    The latest OpenStack release is out in the wilds. Codenamed Stein, the platform update is said to allow for much faster Kubernetes deployments, new IP and bandwidth management features, and introduces a software module focused on cloud resource management – Placement.

    In keeping with the tradition, the 19th version of the platform was named Stein after Steinstraße or "Stein Street" in Berlin, where the OpenStack design summit for the corresponding release took place in 2018.

    OpenStack is not a single piece of software, but a framework consisting of an integration engine and nearly 50 interdependent modules or projects, each serving a narrowly defined purpose, like Nova for compute, Neutron for networking and Magnum for container orchestration, all linked together using APIs.

  • OpenStack Stein launches with improved Kubernetes support

    The OpenStack project, which powers more than 75 public and thousands of private clouds, launched the 19th version of its software this week. You’d think that after 19 updates to the open-source infrastructure platform, there really isn’t all that much new the various project teams could add, given that we’re talking about a rather stable code base here. There are actually a few new features in this release, though, as well as all the usual tweaks and feature improvements you’d expect.

    While the hype around OpenStack has died down, we’re still talking about a very active open-source project. On average, there were 155 commits per day during the Stein development cycle. As far as development activity goes, that keeps OpenStack on the same level as the Linux kernel and Chromium.

  • Community pursues tighter Kubernetes integration in Openstack Stein

    The latest release of open source infrastructure platform Openstack, called 'Stein', was released today with updates to container functionality, edge computing and networking upgrades, as well as improved bare metal provisioning and tighter integration with popular container orchestration platform Kubernetes - led by super-user science facility CERN.

    It also marks roughly a year since the Openstack Foundation pivoted towards creating a more all-encompassing brand that covers under-the-bonnet open source in general, with a new umbrella organisation called the Open Infrastructure Foundation. Openstack itself had more than 65,000 code commits in 2018, with an average of 155 per day during the Stein cycle.

  • Why virtualisation remains a technology for today and tomorrow

    The world is moving from data centres to centres of data. In this distributed world, virtualisation empowers customers to secure business-critical applications and data regardless of where they sit, according to Andrew Haschka, Director, Cloud Platforms, Asia Pacific and Japan, VMware.

    “We think of server and network virtualisation as being able to enable three fundamental things: a cloud-centric networking fabric, with intrinsic security, and all of it delivered in software. This serves as a secure, consistent foundation that drives businesses forward,” said Haschka in an email interview with Networks Asia. “We believe that virtualisation offers our customers the flexibility and control to bring things together and choose which way their workloads and applications need to go – this will ultimately benefit their businesses the most.”

  • Happy 55th birthday mainframe

    7 April marked the 55th birthday of the mainframe. It was on that day in 1964 that the System/360 was announced and the modern mainframe was born. IBM’s Big Iron, as it came to be called, took a big step ahead of the rest of the BUNCH (Burroughs, UNIVAC, NCR, Control Data Corporation, and Honeywell). The big leap of imagination was to have software that was architecturally compatible across the entire System/360 line.

  • Red Hat strategy validated as open hybrid cloud goes mainstream

    “Any products, anything that would release to the market, the first filter that we run through is: Will it help our customers with their open hybrid cloud journey?” said Ranga Rangachari (pictured), vice president and general manager of storage and hyperconverged infrastructure at Red Hat.

    Rangachari spoke with Dave Vellante (@dvellante) and Stu Miniman (@stu), co-hosts of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, during the Google Cloud Next event. They discussed adoption of open hybrid cloud and how working as an ecosystem is critical for success in solving storage and infrastructure problems (see the full interview with transcript here). (* Disclosure below.)

More in Tux Machines

Ubuntu Leftovers: Blobs, Snapcraft and Arronax

  • Ubuntu 19.10 To Bundle NVIDIA's Proprietary Driver Packages As Part Of Its ISO
    For Ubuntu 19.10 the developers are adding the NVIDIA driver packages onto the ISO. The NVIDIA binary drivers won't be activated by default, but will be present on the install media to make it easier to enable post-install. The open-source NVIDIA "Nouveau" drivers will remain the default for NVIDIA graphics on new Ubuntu installations, but this change is positioning the mainline and legacy NVIDIA proprietary drivers onto the Ubuntu ISO so that they can be easily obtained locally post-install. The main driver here is allowing users to enable the NVIDIA proprietary graphics on Ubuntu even if you don't have an Internet connection. NVIDIA has already okay'ed the distribution of their driver packages with the Ubuntu ISO.
  • Snapcraft parts & plugins
    Last week, we published Introduction to snapcraft, a tutorial that provided a detailed overview of the snap build process. We touched on the concepts like snap ecosystem components, snapcraft command line, snapcraft.yaml syntax, and more. We’d like to expand on the first lesson, and today, we are going to talk about parts and plugins, used in the build process of snaps.
  • Arronax – Graphical Tool to Create Desktop Launcher in Ubuntu
    For those who want to manually create desktop shortcut launcher in Ubuntu 16.04, Ubuntu 18.04, Ubuntu 19.04, Arronax is a good choice with graphical user interface. Other than creating .desktop file via Linux command, Arronax offers a graphical interface to create (and also edit) desktop shortcut for application, executable file, or URL.

Games: Wine, IRKALLA, Vambrace: Cold Soul, ZED, and art of rally

  • Valve's Proton Pulls In Latest DXVK, Steam Networking Updates, Controller Layout Fixes
    The Valve developers maintaining their Proton fork of Wine for use by Steam Play have outed a new update, version 4.2-5.
  • Wine & Mingw-w64 Might Tighten Up Their Relationship - Possible "WineSDK"
    Developers between the Wine and Mingw-w64 projects are discussing the potential for further embracing their relationship given the overlap in trajectory and both benefiting from close collaboration. This extended relationship could also involve Mingw-w64 potentially adopting Wine's branding. While all Phoronix readers should be aware of Wine, for those not familiar with Mingw-w64 it's the off-shoot of MinGW focused on 64-bit support and other features over the original MinGW for providing an open-source development toolchain for Microsoft Windows. Mingw-w64 remains quite active in working on its GCC-based compiler toolchain support for Windows.
  • Wine and mingw-w64 cooperation
  • IRKALLA, an incredibly stylish looking pixel-art tactical-action platformer is coming to Linux
    The developers behind IRKALLA emailed in today and it grabbed my interest right away with the supremely stylish art behind it. The odd setting has my curiosity too, with mechs versus demons! According to the developer, it's a "platform-tactic game" so it has elements of an action platformer with character progression and some form of base defence building. IRKALLA has been in development for quite a few years now with their TIGForum post dating all the way back to 2013. We've been emailed today, as it seems development on it has been picked back up as they told me it's "finally coming together" and a Linux release is also confirmed of course.
  • Roguelike fantasy adventure 'Vambrace: Cold Soul' has a new feature trailer ahead of release next week
    The release of Vambrace: Cold Soul on May 28th is getting close now, it's quite an impressive looking game that I've been playing and they have a new feature trailer. I won't say too much on it myself before release but since I've had access for a while, I can say it works great on Linux.
  • Surreal adventure game 'ZED' about an artist suffering from dementia is releasing in June
    ZED, a game that will tell the story of an artist suffering from dementia from Eagre Games and Cyan Ventures now has a release date and it's quite soon. The Windows version is now scheduled in for June 4th, with the Linux (and Mac) version to be "later in June". Great to see it continue to be confirmed and although there is a delay, it's not going to be long it seems. Good thing too, as I'm damn excited for this one.
  • art of rally is bringing a stylized racing experience to Linux later this year
    Funselektor Labs, the developer of Absolute Drift has announced their latest game, art of rally. It might look stylish but it's not just a pretty face, as the developer is also focused on how the cars handle too. While we have a few racing games now like Grid Autosport, DiRT Rally/4 and some F1 games (plus a few that work with Steam Play), they're all quite serious business. art of rally looks to be taking a slightly less realistic focus while still providing a challenge, especially with the top-down view you get a better picture of what's up ahead.

Announcing Rust 1.35.0

The Rust team is happy to announce a new version of Rust, 1.35.0. Rust is a programming language that is empowering everyone to build reliable and efficient software. Read more Also: Rust 1.35 Released With Support For Empty Debug Macro, ~4x Faster ASCII Case Conversions

GNU Guile 2.9.2 (beta) released

We are delighted to announce GNU Guile 2.9.2, the second beta release in preparation for the upcoming 3.0 stable series. See the release announcement for full details and a download link. This release extends just-in-time (JIT) native code generation support to the ia32, ARMv7, and AArch64 architectures. Under the hood, we swapped out GNU Lightning for a related fork called Lightening, which was better adapted to Guile's needs. Read more