Language Selection

English French German Italian Portuguese Spanish

Servers: Hadoop, Amazon Rivals, Red Hat/IBM, Kubernetes, OpenStack and More

Filed under
Server
  • Breaking Out of the Hadoop Cocoon

    The announcement last fall that top Hadoop vendors Cloudera and Hortonworks were coming together in a $5.2 billion merger – and reports about the financial toll that their competition took on each other in the quarters leading up to the deal – revived questions that have been raised in recent years about the future of Hadoop in an era where more workloads are moving into public clouds like Amazon Web Services (AWS) that offer a growing array of services that many of the jobs that the open-source technology already does.

    Hadoop gained momentum over the past several years as an open-source platform to collect, store and analyze various types of data, arriving as data was becoming the coin of the realm in the IT industry, something that has only steadily grown since. As we’ve noted here at The Next Platform, Hadoop has evolved over the years, with such capabilities as Spark in-memory processing and machine learning being added. But in recent years more workloads and data have moved to the cloud, and the top cloud providers, including Amazon Web Services (AWS), Microsoft Azure and Google Cloud Platform all offer their own managed services, such as AWS’ Elastic Map Reduce (EMR). Being in the cloud, these services also offer lower storage costs and easier management – the management of the infrastructure is done by the cloud provider themselves.

  • A guide for database as a service providers: How to stand your ground against AWS – or any other cloud

    NoSQL database platform MongoDB followed suit in October 2018 announcing a Server Side Public License (SSPL) to protect “open source innovation” and stop “cloud vendors who have not developed the software to capture all of the value while contributing little back to the community.” Event streaming company, Confluent issued its own Community License in December 2018 to make sure cloud providers could no longer “bake it into the cloud offering, and put all their own investments into differentiated proprietary offerings.”

  • The CEO of DigitalOcean explains how its 'cult following' helped it grow a $225 million business even under the shadow of Amazon Web Services

    DigitalOcean CEO Mark Templeton first taught himself to code at a small hardwood business. He wanted to figure out how to use the lumber in the factory most efficiently, and spreadsheets only got him so far.

    "I taught myself to write code to write a shop floor control and optimization system," Templeton told Business Insider. "That allowed us to grow, to run the factory 24 hours a day, all these things that grow in small business is new. As a self-taught developer, that's what launched me into the software industry."

    And now, Templeton is learning to embrace these developer roots again at DigitalOcean, a New York-based cloud computing startup. It's a smaller, venture-backed alternative to mega-clouds like Amazon Web Services, but has found its niche with individual programmers and smaller teams.

  • IBM’s Big-Ticket Purchase of Red Hat Gets a Vote of Confidence From Wall Street
  • How Monzo built a bank with open infrastructure

    When challenger bank Monzo began building its platform, the team decided it would get running with container orchestration platform Kubernetes "the hard way". The result is that the team now has visibility into outages or other problems, and Miles Bryant, platform engineer at Monzo, shared some observations at the bank at the recent Open Infrastructure Day event in London.

    Finance is, of course, a heavily regulated industry - and at the same time customer expectations are extremely exacting. If people can't access their money, they tend to get upset.

  • Kubernetes Automates Open-Source Deployment

    Whether for television broadcast and video content creation, delivery or transport of streamed media, they all share a common element, that is the technology supporting this industry is moving rapidly, consistently and definitively toward software and networking. The movement isn’t new by any means; what now seems like ages ago, in the days where every implementation required customized software on a customized hardware platform has now changed to open platforms running with open-source solution sets often developed for open architectures and collectively created using cloud-based services.

  • Using EBS and EFS as Persistent Volume in Kubernetes

    If your Kubernetes cluster is running in the cloud on Amazon Web Services (AWS), it comes with Elastic Block Storage (EBS). Or, Elastic File System (EFS) can be used for storage.

    We know pods are ephemeral and in most of the cases we need to persist the data in the pods. To facilitate this, we can mount folders into our pods that are backed by EBS volumes on AWS using AWSElasticBlockStore, a volume plugin provided by Kubernetes.

    We can also use EFS as storage by using efs-provisioner. Efs-provisioner runs as a pod in the Kubernetes cluster that has access to an AWS EFS resource.

  • Everything You Want To Know About Anthos - Google's Hybrid And Multi-Cloud Platform

    Google's big bet on Anthos will benefit the industry, open source community, and the cloud native ecosystem in accelerating the adoption of Kubernetes.

  • Raise a Stein for OpenStack: Latest release brings faster containers, cloud resource management

    The latest OpenStack release is out in the wilds. Codenamed Stein, the platform update is said to allow for much faster Kubernetes deployments, new IP and bandwidth management features, and introduces a software module focused on cloud resource management – Placement.

    In keeping with the tradition, the 19th version of the platform was named Stein after Steinstraße or "Stein Street" in Berlin, where the OpenStack design summit for the corresponding release took place in 2018.

    OpenStack is not a single piece of software, but a framework consisting of an integration engine and nearly 50 interdependent modules or projects, each serving a narrowly defined purpose, like Nova for compute, Neutron for networking and Magnum for container orchestration, all linked together using APIs.

  • OpenStack Stein launches with improved Kubernetes support

    The OpenStack project, which powers more than 75 public and thousands of private clouds, launched the 19th version of its software this week. You’d think that after 19 updates to the open-source infrastructure platform, there really isn’t all that much new the various project teams could add, given that we’re talking about a rather stable code base here. There are actually a few new features in this release, though, as well as all the usual tweaks and feature improvements you’d expect.

    While the hype around OpenStack has died down, we’re still talking about a very active open-source project. On average, there were 155 commits per day during the Stein development cycle. As far as development activity goes, that keeps OpenStack on the same level as the Linux kernel and Chromium.

  • Community pursues tighter Kubernetes integration in Openstack Stein

    The latest release of open source infrastructure platform Openstack, called 'Stein', was released today with updates to container functionality, edge computing and networking upgrades, as well as improved bare metal provisioning and tighter integration with popular container orchestration platform Kubernetes - led by super-user science facility CERN.

    It also marks roughly a year since the Openstack Foundation pivoted towards creating a more all-encompassing brand that covers under-the-bonnet open source in general, with a new umbrella organisation called the Open Infrastructure Foundation. Openstack itself had more than 65,000 code commits in 2018, with an average of 155 per day during the Stein cycle.

  • Why virtualisation remains a technology for today and tomorrow

    The world is moving from data centres to centres of data. In this distributed world, virtualisation empowers customers to secure business-critical applications and data regardless of where they sit, according to Andrew Haschka, Director, Cloud Platforms, Asia Pacific and Japan, VMware.

    “We think of server and network virtualisation as being able to enable three fundamental things: a cloud-centric networking fabric, with intrinsic security, and all of it delivered in software. This serves as a secure, consistent foundation that drives businesses forward,” said Haschka in an email interview with Networks Asia. “We believe that virtualisation offers our customers the flexibility and control to bring things together and choose which way their workloads and applications need to go – this will ultimately benefit their businesses the most.”

  • Happy 55th birthday mainframe

    7 April marked the 55th birthday of the mainframe. It was on that day in 1964 that the System/360 was announced and the modern mainframe was born. IBM’s Big Iron, as it came to be called, took a big step ahead of the rest of the BUNCH (Burroughs, UNIVAC, NCR, Control Data Corporation, and Honeywell). The big leap of imagination was to have software that was architecturally compatible across the entire System/360 line.

  • Red Hat strategy validated as open hybrid cloud goes mainstream

    “Any products, anything that would release to the market, the first filter that we run through is: Will it help our customers with their open hybrid cloud journey?” said Ranga Rangachari (pictured), vice president and general manager of storage and hyperconverged infrastructure at Red Hat.

    Rangachari spoke with Dave Vellante (@dvellante) and Stu Miniman (@stu), co-hosts of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, during the Google Cloud Next event. They discussed adoption of open hybrid cloud and how working as an ecosystem is critical for success in solving storage and infrastructure problems (see the full interview with transcript here). (* Disclosure below.)

More in Tux Machines

Events: Linux Fest Northwest and OSCON, Intel's OSTS, LibreOffice Hackfests and Debian at ICFP 2019

  • GNOME on the Road: Linux Fest Northwest and OSCON

    Linux Fest Northwest took place back in April, and we were there! Sri Ramkrishna and I hung out in Bellingham, Washington (USA), meeting GNOMEies, free software contributors, and open source enthusiasts.

  • Intel Shares Highlights From Their 2019 Open-Source Technology Summit

    Taking place back in May at the beautiful Skamania Lodge in Washington was Intel's OSTS 2019 for their annual Open-Source Technology Summit that traditionally was internal-only but has begun opening up including allowing external participants this year. I was at OSTS 2019 and it's by far my highlight of the year with many really great sessions and a lot of useful networking at the event. Intel's open-source team has now shared some video recordings from this open-source/Linux event. 

  • Annual Report 2018: LibreOffice Hackfests

    Most LibreOffice developers are working from their home offices, so hackfests provide a unique opportunity to spend some time working shoulder-to-shoulder with their peers. In 2018, LibreOffice developers and community members met at four hackfests in Brussels, Hamburg, Tirana and Munich.

  • ICFP 2019

    ICFP 2019 in Berlin ended yesterday, and it was – as always – a great pleasure. This year was particularly noteworthy for the quite affordable conference hotel and the absolutely amazing food during the coffee breaks.

OSS Leftovers

  • How open source is benefitting SUSE, its channel partners and customers

    Open source technology is being talked about even more rampantly today. Phillip Cockrell, Vice President of Global Channels, SUSE articulates, “More than anything, open source is the core of innovation. It is by all and for all and propelling all aspects of technology development today.” SUSE, a native open source software company, which provides reliable, software-defined infrastructure and application delivery solutions that give organisations greater control and flexibility, is a seasoned 25-year-old player in the domain.

  • What is AOSP? Android Open Source Project, the ‘Android without Google’

    AOSP is the acronym for Android Open Supply Challenge ; that’s, ‘Android Open Source Project’. So it's simply the supply code of Android, the cellular working system of the Mountain View firm. However what’s it for? Its fundamental software is by OEMs; cellular producers obtain AOSP and make their 'ROM inventory', but additionally serves as the premise for customized ROMs and forks. AOSP, or Android Open Supply Challenge, isn’t the identical as Android Inventory . Whereas AOSP is the supply code of the working system, Android Inventory is the 'pure model' with out bloatware of any sort and solely with apps and Google providers, in addition to the native launcher. AOSP, nevertheless, is the premise of Android Vanilla , which is the model that’s distributed to smartphone producers and is topic to modifications. On it, the producer's personal purposes and providers are launched, and naturally the customization layer and the variations which can be essential for particular elements to work.

  • How to Avoid Technical Debt in Open Source Projects
  • Introducing OpenDrop, an open-source implementation of Apple AirDrop written in Python

    A group of German researchers recently published a paper “A Billion Open Interfaces for Eve and Mallory: MitM, DoS, and Tracking Attacks on iOS and macOS Through Apple Wireless Direct Link”, at the 28th USENIX Security Symposium (August 14–16), USA. The paper reveals security and privacy vulnerabilities in Apple’s AirDrop file-sharing service as well as denial-of-service (DoS) attacks which leads to privacy leaks or simultaneous crashing of all neighboring devices. As part of the research, Milan Stute and Alexander Heinrich, two researchers have developed an open-source implementation of Apple AirDrop written in Python – OpenDrop. OpenDrop is like a FOSS implementation of AirDrop. It is an experimental software and is the result of reverse engineering efforts by the Open Wireless Link project (OWL). It is compatible with Apple AirDrop and used for sharing files among Apple devices such as iOS and macOS or on Linux systems running an open re-implementation of Apple Wireless Direct Link (AWDL).

  • The Top 13 Free and Open Source Storage Solutions

    In this article we will examine free and open source storage solutions by providing a brief overview of what to expect, as well as blurbs on each tool.

  • Open Source Origination Technology Platform for Online Lenders

    DigiFi was founded by Joshua Jersey and Bradley Vanderstarren in 2014. It started its life as Promise Financial, an online lender, and raised $110 million in credit capital. It built up its own proprietary tech as there was no solution provider in 2014 offering an end-to-end loan origination platform that could automate the entire process. They sold off the tech to a large lending institution in 2017 and pivoted to DigiFi, one of the world’s first open source loan origination systems (LOS) which equips the lenders with flexible and modern tools to create unique platforms and digital experiences.

  • IT favors open source networking over Cisco ACI, VMware NSX

    Companies trying to avoid or lessen the use of expensive network automation software from Cisco and VMware are turning to open source tools that are often good enough for many tasks associated with managing complex modern networks. Cisco's application-centric infrastructure (ACI) and VMware's NSX are powerful technologies for operating networks built on the vendors' respective products. But many large enterprises have data centers filled with perfectly good multivendor hardware and software that very few organizations are willing to swap for an all Cisco or VMware alternative. Therefore, companies are turning to open source networking products, such as Ansible, Chef, Puppet and SaltStack, for automating many network-related chores across as much of the data center as possible, while relegating ACI and NSX to Cisco- or VMware-only portions of the network.

  • What Attorneys Should Know About Open Source Software Licensing

    With the next waves of technological change, such as autonomous vehicles, blockchain, and IoT, newer, more complex OSS licenses may be drafted, and argued in the courts, to protect the interests of software innovators and the OSS community.

Open Data: Schlumberger and Waymo

  • Schlumberger open-sources data ecosystem, contributing to industrywide data development
  • Schlumberger Open Sources Data Ecosystem

    Oilfield services company Schlumberger said it will open source its data ecosystem and contribute to The Open Group Open Subsurface Data Universe (OSDU) Forum to accelerate the delivery of the OSDU Data Platform. The OSDU Forum is an international forum of oil and gas operators, cloud services companies, technology providers, suppliers of applications to oil and gas operators, academia and other standards organizations working together to develop an open, standards-based, data platform that will bring together exploration, development and wells data.

  • Waymo open-sources data set for autonomous vehicle multimodal sensors

    Waymo, the Alphabet subsidiary that hopes to someday pepper roads with self-driving taxis, today pulled back the curtains on a portion of the data used to train the algorithms underpinning its cars: The Waymo Open Dataset. Waymo principal scientist Dragomir Anguelov claims it’s the largest multimodal sensor sample corpus for autonomous driving released to date. “[W]e are inviting the research community to join us with the [debut] of the Waymo Open Dataset, [which is composed] of high-resolution sensor data collected by Waymo self-driving vehicles,” wrote Anguelov in a blog post published this morning. “Data is a critical ingredient for machine learning … [and] this rich and diverse set of real-world experiences has helped our engineers and researchers develop Waymo’s self-driving technology and innovative models and algorithms.”

Linux Foundation: Open Mainframe, Cloud Native Computing Foundation, IBM and More