Language Selection

English French German Italian Portuguese Spanish

Servers: Hadoop, Amazon Rivals, Red Hat/IBM, Kubernetes, OpenStack and More

Filed under
Server
  • Breaking Out of the Hadoop Cocoon

    The announcement last fall that top Hadoop vendors Cloudera and Hortonworks were coming together in a $5.2 billion merger – and reports about the financial toll that their competition took on each other in the quarters leading up to the deal – revived questions that have been raised in recent years about the future of Hadoop in an era where more workloads are moving into public clouds like Amazon Web Services (AWS) that offer a growing array of services that many of the jobs that the open-source technology already does.

    Hadoop gained momentum over the past several years as an open-source platform to collect, store and analyze various types of data, arriving as data was becoming the coin of the realm in the IT industry, something that has only steadily grown since. As we’ve noted here at The Next Platform, Hadoop has evolved over the years, with such capabilities as Spark in-memory processing and machine learning being added. But in recent years more workloads and data have moved to the cloud, and the top cloud providers, including Amazon Web Services (AWS), Microsoft Azure and Google Cloud Platform all offer their own managed services, such as AWS’ Elastic Map Reduce (EMR). Being in the cloud, these services also offer lower storage costs and easier management – the management of the infrastructure is done by the cloud provider themselves.

  • A guide for database as a service providers: How to stand your ground against AWS – or any other cloud

    NoSQL database platform MongoDB followed suit in October 2018 announcing a Server Side Public License (SSPL) to protect “open source innovation” and stop “cloud vendors who have not developed the software to capture all of the value while contributing little back to the community.” Event streaming company, Confluent issued its own Community License in December 2018 to make sure cloud providers could no longer “bake it into the cloud offering, and put all their own investments into differentiated proprietary offerings.”

  • The CEO of DigitalOcean explains how its 'cult following' helped it grow a $225 million business even under the shadow of Amazon Web Services

    DigitalOcean CEO Mark Templeton first taught himself to code at a small hardwood business. He wanted to figure out how to use the lumber in the factory most efficiently, and spreadsheets only got him so far.

    "I taught myself to write code to write a shop floor control and optimization system," Templeton told Business Insider. "That allowed us to grow, to run the factory 24 hours a day, all these things that grow in small business is new. As a self-taught developer, that's what launched me into the software industry."

    And now, Templeton is learning to embrace these developer roots again at DigitalOcean, a New York-based cloud computing startup. It's a smaller, venture-backed alternative to mega-clouds like Amazon Web Services, but has found its niche with individual programmers and smaller teams.

  • IBM’s Big-Ticket Purchase of Red Hat Gets a Vote of Confidence From Wall Street
  • How Monzo built a bank with open infrastructure

    When challenger bank Monzo began building its platform, the team decided it would get running with container orchestration platform Kubernetes "the hard way". The result is that the team now has visibility into outages or other problems, and Miles Bryant, platform engineer at Monzo, shared some observations at the bank at the recent Open Infrastructure Day event in London.

    Finance is, of course, a heavily regulated industry - and at the same time customer expectations are extremely exacting. If people can't access their money, they tend to get upset.

  • Kubernetes Automates Open-Source Deployment

    Whether for television broadcast and video content creation, delivery or transport of streamed media, they all share a common element, that is the technology supporting this industry is moving rapidly, consistently and definitively toward software and networking. The movement isn’t new by any means; what now seems like ages ago, in the days where every implementation required customized software on a customized hardware platform has now changed to open platforms running with open-source solution sets often developed for open architectures and collectively created using cloud-based services.

  • Using EBS and EFS as Persistent Volume in Kubernetes

    If your Kubernetes cluster is running in the cloud on Amazon Web Services (AWS), it comes with Elastic Block Storage (EBS). Or, Elastic File System (EFS) can be used for storage.

    We know pods are ephemeral and in most of the cases we need to persist the data in the pods. To facilitate this, we can mount folders into our pods that are backed by EBS volumes on AWS using AWSElasticBlockStore, a volume plugin provided by Kubernetes.

    We can also use EFS as storage by using efs-provisioner. Efs-provisioner runs as a pod in the Kubernetes cluster that has access to an AWS EFS resource.

  • Everything You Want To Know About Anthos - Google's Hybrid And Multi-Cloud Platform

    Google's big bet on Anthos will benefit the industry, open source community, and the cloud native ecosystem in accelerating the adoption of Kubernetes.

  • Raise a Stein for OpenStack: Latest release brings faster containers, cloud resource management

    The latest OpenStack release is out in the wilds. Codenamed Stein, the platform update is said to allow for much faster Kubernetes deployments, new IP and bandwidth management features, and introduces a software module focused on cloud resource management – Placement.

    In keeping with the tradition, the 19th version of the platform was named Stein after Steinstraße or "Stein Street" in Berlin, where the OpenStack design summit for the corresponding release took place in 2018.

    OpenStack is not a single piece of software, but a framework consisting of an integration engine and nearly 50 interdependent modules or projects, each serving a narrowly defined purpose, like Nova for compute, Neutron for networking and Magnum for container orchestration, all linked together using APIs.

  • OpenStack Stein launches with improved Kubernetes support

    The OpenStack project, which powers more than 75 public and thousands of private clouds, launched the 19th version of its software this week. You’d think that after 19 updates to the open-source infrastructure platform, there really isn’t all that much new the various project teams could add, given that we’re talking about a rather stable code base here. There are actually a few new features in this release, though, as well as all the usual tweaks and feature improvements you’d expect.

    While the hype around OpenStack has died down, we’re still talking about a very active open-source project. On average, there were 155 commits per day during the Stein development cycle. As far as development activity goes, that keeps OpenStack on the same level as the Linux kernel and Chromium.

  • Community pursues tighter Kubernetes integration in Openstack Stein

    The latest release of open source infrastructure platform Openstack, called 'Stein', was released today with updates to container functionality, edge computing and networking upgrades, as well as improved bare metal provisioning and tighter integration with popular container orchestration platform Kubernetes - led by super-user science facility CERN.

    It also marks roughly a year since the Openstack Foundation pivoted towards creating a more all-encompassing brand that covers under-the-bonnet open source in general, with a new umbrella organisation called the Open Infrastructure Foundation. Openstack itself had more than 65,000 code commits in 2018, with an average of 155 per day during the Stein cycle.

  • Why virtualisation remains a technology for today and tomorrow

    The world is moving from data centres to centres of data. In this distributed world, virtualisation empowers customers to secure business-critical applications and data regardless of where they sit, according to Andrew Haschka, Director, Cloud Platforms, Asia Pacific and Japan, VMware.

    “We think of server and network virtualisation as being able to enable three fundamental things: a cloud-centric networking fabric, with intrinsic security, and all of it delivered in software. This serves as a secure, consistent foundation that drives businesses forward,” said Haschka in an email interview with Networks Asia. “We believe that virtualisation offers our customers the flexibility and control to bring things together and choose which way their workloads and applications need to go – this will ultimately benefit their businesses the most.”

  • Happy 55th birthday mainframe

    7 April marked the 55th birthday of the mainframe. It was on that day in 1964 that the System/360 was announced and the modern mainframe was born. IBM’s Big Iron, as it came to be called, took a big step ahead of the rest of the BUNCH (Burroughs, UNIVAC, NCR, Control Data Corporation, and Honeywell). The big leap of imagination was to have software that was architecturally compatible across the entire System/360 line.

  • Red Hat strategy validated as open hybrid cloud goes mainstream

    “Any products, anything that would release to the market, the first filter that we run through is: Will it help our customers with their open hybrid cloud journey?” said Ranga Rangachari (pictured), vice president and general manager of storage and hyperconverged infrastructure at Red Hat.

    Rangachari spoke with Dave Vellante (@dvellante) and Stu Miniman (@stu), co-hosts of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, during the Google Cloud Next event. They discussed adoption of open hybrid cloud and how working as an ecosystem is critical for success in solving storage and infrastructure problems (see the full interview with transcript here). (* Disclosure below.)

More in Tux Machines

GNU/Linux Rising (Latest News)

  • The Envelope Please.......
    Those who have followed Reglue.org over the years know that we place a strong emphasis on STEM topics and education. "STEM" is the given acronym for science, technology, engineering and mathematics. Linux is superbly well-tooled for these purposes and every computer we place with a financially disadvantaged student is Linux-powered. Now, that might sound like a steroid-fueled buzzkill to most, but in researching the online STEM subject matter, we found that we could actually make it fun. Yeah. Science....go figure. [...] Just so you know the dynamics involved in presenting these topics to the Reglue kid, we enabled the bookmark bar under the URL bar in Chromium or Firefox. We offer both browsers and allow the student to choose the default. Within that bookmark bar, we place the links to the subject matter we choose for that student, depending on age and aptitude. Our pool of choices is vast, so narrowing it down took a good bit of time, years actually. With feedback from 388 students, we were able to draw down the most popular websites and personalities within the STEM subject matter we wished to provide.
  • Govt Schools In Kerala To Use Linux-Based Free OS, Saving Rs 3000 Cr
    Kerala, the first 100% literate Indian state is not only known for its beautiful backwaters but also for its education policy which benefits everyone and not just one sector. And now, undertaking one of the most progressive educational reforms, this South-Indian state has declared to welcome open source in a huge way. As per a report by The Hindu, more than 2 lakh computers in schools across the state will soon be powered by the latest version of the Linux-based free Operating System called as [...] that provides a variety of applications for educational and general purposes. The state-owned Kerala Infrastructure and Technology for Education (KITE) has rolled out this new version which is based on the Ubuntu OS LTS edition and includes numerous free applications customised as per the state school curriculum such as DTP (Desktop Publishing) graphics, 3D animation packages, language input tools, video editing, Geographical Information System, image editing software, sound recording, database applications, open source office suite, and various others.
  • Google Extinguishes 'Campfire' Dual-Booting Windows 10 on Chromebooks
    Evidence from last year showed that Google was working on dual-booting Chrome OS alongside “AltOS,” a codename believed to be referring to Windows 10.
  • South Korea Thinks Of Switching From Windows To Linux Platform
    The government has opted for Linux instead of Windows 10 to save a significant amount of money Windows is a paid OS whereas Linux is a free, open-source operating system. It would cost around 780 billion won or 655 million dollars for switching to Linus platform and buying new PCs. Another reason for this change is that the Linux platform has lesser security risks compared to Windows. This is the main factor that most of the enterprise networks around the world uses Linux based OS to run their machines.
  • South Korea Government prefer Linux to Windows 10 [Ed: Microsoft boosters have begun smearing or belittling Korea's plan to move to GNU/Linux]
    A report from the Korean Herald  stated, “Before the government-wide adoption, the ministry said it would test if the system could be run on private networked devices without security risks and if compatibility could be achieved with existing websites and software which have been built to run on Windows.” It is not exactly clear which Linux distribution the South Korean Government are eyeing.
  • Government Planning to Replace Windows 7 with Linux, Not Windows 10 [Ed: Longtime Microsoft propagandists such as  Bogdan Popa will have a dilemma; maintain the lie/perception "Microsoft loves Linux" or viciously attack Linux (which Microsoft bribes governments to reject or, failing that, dump)?]
    While specifics on what Linux distro they want to embrace are not available, it looks like the first step towards this migration to the open-source world is a security audit that should help the government determine if their data is protected or not.
  • Meditations on First ThinkPad: How Lenovo adapts to changes in the PC industry
    Linux and ThinkPads go together, but not at the factory ThinkPads are often the laptop of choice for Linux users, as Lenovo does certify some ThinkPad models for Linux use. Unfortunately, buyers are typically subject to the Windows Tax, resulting in purchased, though unused, licenses. The question of getting Linux installed from the factory "comes up over and over with some of our very important customers, and it is taken very seriously," Paradise noted, adding that Lenovo "provides drivers and a BIOS that is compatible," reiterating that "we get that request a lot."
  • Red Hat CTO: Scalability, usability key RHEL 8 components
    As data center infrastructure grows beyond on-premises facilities, admins and developers need ways to effectively manage hardware through software. With Linux as the standard for many data centers, organizations must find new techniques to use the OS beyond server deployments.

Security: BSDcan, Ransom and Exploits

  • ssh in https

    The wifi network at BSDcan, really the UOttawa network, blocks a bunch of ports. This makes it difficult to connect to outside machines using “exotic” protocols, basically anything except http or https. There are many ways to resolve this, here’s what I did.

  • These firms promise high-tech ransomware solutions—but typically just pay hackers [iophk: “Windows continues to enable entire cottage industries around grifting”]

    Proven Data promised to help ransomware victims by unlocking their data with the “latest technology,” according to company emails and former clients. Instead, it obtained decryption tools from cyberattackers by paying ransoms, according to Storfer and an FBI affidavit obtained by ProPublica.

    Another US company, Florida-based MonsterCloud, also professes to use its own data recovery methods but instead pays ransoms, sometimes without informing victims such as local law enforcement agencies, ProPublica has found. The firms are alike in other ways. Both charge victims substantial fees on top of the ransom amounts. They also offer other services, such as sealing breaches to protect against future attacks. Both firms have used aliases for their workers, rather than real names, in communicating with victims.

  • Google Starts Tracking Zero-Days Exploited in the Wild

    The new project, named 0Day ‘In the Wild’, is basically a spreadsheet that Project Zero uses to track vulnerabilities exploited before they became known to the public or the vendor.

    The spreadsheet currently lists over 100 vulnerabilities exploited in the wild since 2014. The table includes the flaw’s CVE identifier, impacted vendor, impacted product, the type of vulnerability, a brief description, the date of its discovery, the date when a patch was released, a link to the official advisory, a link to a resource analyzing the flaw, and information on attribution.

Top Linux Server Vendors

This article offers a 2019 update on several of the world’s top Linux server vendors, a very important but often mysterious section of the IT world that many people know little or nothing about. This is because Linux and its various flavors, called “distros” (for distributions), are underlying operating systems that run applications on servers and PCs and aren’t adjusted or changed by users as a matter of routine. For public internet servers, Linux is dominant, powering about twice the number of hosts as Windows Server, which is trailed by many smaller players, including traditional mainframe OSes. The supercomputer field is completely dominated by Linux, with 100% of the TOP500 now running on various versions. Internet-based servers' market share can be measured with statistical surveys of publicly accessible servers, such as web servers, mail servers or DNS servers on the Internet: the operating systems powering such servers are found by inspecting raw response messages. This method gives insight only into market share of operating systems that are publicly accessible on the Internet. The Linux OS started out as being exclusive to regular x86 desktop PCs, but it has since found its way into everything from Android phones to Google Chromebooks to those powerful super-servers mentioned above. IT decision-makers in the market for Linux servers should know that the very best Linux distros are tailored to specific types of users. Ubuntu, for instance, is very easy to use, because it’s designed for newbies. On the other hand, Red Hat Enterprise Linux, openSUSE, CentOS and others designed for the data center require a lot more expertise. Read more Also: Red Hat's Jim Whitehurst on the IBM Merger, SUSE and Ubuntu

Games: Deadly Days, Gaming Performance, Creating Evscaperoom

  • Deadly Days, the strategic zombie group-survival rogue-lite keeps on improving
    I'm really starting to like what Deadly Days is turning into. It's an Early Access game about directing a group of survivors through a Zombie apocalypse and it's really taking shape now. I've tested this one on and off since sometime around March last year, back then it was nothing but a shell. An interesting idea but it didn't really go anywhere. Pixelsplit now seem to have firmly found their feet, with each update making parts of the game make more sense, become bigger and more interesting. It's now actually more of a survival game and not just a town exploration game with zombies.
  • Gaming Performance Only Faintly Touched By MDS / Zombie Load Mitigations
    Yesterday I published some initial MDS/Zombieload mitigation impact benchmarks while coming out still later today is much more data looking at the CPU/system performance impact... But is the gaming performance impaired by this latest set of CPU side-channel vulnerabilities? With the Spectre/Meltdown mitigations, the gaming performance fortunately wasn't impaired by those mitigations. In fact, it was pretty much dead flat. With my testing thus far of the MDS/Zombieload mitigations on Linux, there does appear to be a slight difference in the rather CPU-bound scenarios compared to Spectre/Meltdown, but still it should be negligible for gamers. Well, that is at least with the higher-end hardware tested thus far, over the weekend I'll be running some gaming tests on some low-end processors/GPUs.
  • Creating Evscaperoom, part 1
    Over the last month (April-May 2019) I have taken part in the Mud Coder's Guild Game Jam "Enter the (Multi-User) Dungeon". This year the theme for the jam was One Room. The result was Evscaperoom, an text-based multi-player "escape-room" written in Python using the Evennia MU* creation system. You can play it from that link in your browser or MU*-client of choice. If you are so inclined, you can also vote for it here in the jam (don't forget to check out the other entries while you're at it). This little series of (likely two) dev-blog entries will try to recount the planning and technical aspects of the Evscaperoom. This is also for myself - I'd better write stuff down now while it's still fresh in my mind!