Language Selection

English French German Italian Portuguese Spanish

Linux Foundation: The MLflow Project and Zephyr Project

Filed under
OSS
  • Databricks Donates MLflow Project To Linux Foundation

    At the Spark + AI Summit virtual event, Databricks has announced that the MLflow project is joining the Linux Foundation.

  • The MLflow Project Joins Linux Foundation
  • The MLflow Project Joins Linux Foundation
  • The MLflow Project Joins Linux Foundation

    The Linux Foundation, the nonprofit organization enabling mass innovation through open source, today announced that MLflow, an open source machine learning (ML) platform created by Databricks, will join the Linux Foundation. Since its introduction at Spark + AI Summit two years ago, MLflow has experienced impressive community engagement from over 200 contributors and is downloaded more than 2 million times per month, with a 4x annual growth rate in downloads. The Linux Foundation provides a vendor neutral home with an open governance model to broaden adoption and contributions to the MLflow project even further.

    “The steady increase in community engagement shows the commitment data teams have to building the machine learning platform of the future. The rate of adoption demonstrates the need for an open source approach to standardizing the machine learning lifecycle,” said Michael Dolan, VP of Strategic Programs at the Linux Foundation. “Our experience in working with the largest open source projects in the world shows that an open governance model allows for faster innovation and adoption through broad industry contribution and consensus building.”

  • The Zephyr Project Marks Critical Milestones for Security and Product-Ready Maturity
  • The Zephyr Project Marks Critical Milestones for Security and Product-Ready Maturity

    The Zephyr™ Project, an open source project at the Linux Foundation that builds a safe, secure and flexible real-time operating system (RTOS) for the Internet of Things (IoT) in space-constrained devices, announces continued momentum by marking critical milestones for security and product-ready maturity.

    Earlier this year, the NCC Group, a global expert in cyber security and risk mitigation, notified the Zephyr Project of a number of security issues found as part of their independent research into the security posture of Zephyr. The research, which was driven by growing interest from their clients, found Zephyr to be a mature, and a highly active and growing project with increasing market share. The May 2020 report outlines the issues discovered in detail and acknowledges the proactive work of the Zephyr Project Security Committee to fix these issues and follow-up on recommendations of the report. Priority fixes have been backported into Zephyr's Long Term Support (LTS) and a maintenance release published. Learn more about Zephyr's security assessment and response in this blog.

IDG's coverage

  • MLflow is now a Linux Foundation project

    Databricks, the company behind the commercial development of Apache Spark, is placing its machine learning lifecycle project MLflow under the stewardship of the Linux Foundation.

    MLflow provides a programmatic way to deal with all the pieces of a machine learning project through all its phases — construction, training, fine-tuning, deployment, management, and revision. It tracks and manages the the datasets, model instances, model parameters, and algorithms used in machine learning projects, so they can be versioned, stored in a central repository, and repackaged easily for reuse by other data scientists.

MLflow is now a Linux Foundation project

  • MLflow is now a Linux Foundation project

    Databricks, the company behind the commercial development of Apache Spark, is placing its machine learning lifecycle project MLflow under the stewardship of the Linux Foundation.

    MLflow provides a programmatic way to deal with all the pieces of a machine learning project through all its phases — construction, training, fine-tuning, deployment, management, and revision.

    It tracks and manages the the datasets, model instances, model parameters, and algorithms used in machine learning projects, so they can be versioned, stored in a central repository, and repackaged easily for reuse by other data scientists.

MLflow Project joins Linux Foundation

  • MLflow Project joins Linux Foundation

    What’s better than a machine learning platform? Answer: an en-to-end machine learning platform, obviously.

    What’s better than an end-to-end machine learning platform? Answer: an open source end-to-end machine learning platform, obviously, obviously.

    What’s better than an open source end-to-end machine learning platform? Answer: an open source end-to-end machine learning platform that resides under the auspices of the Linux Foundation, obviously, obviously, obviously.

    Okay enough of this, but this is what Databricks is hoping — the company has now said that its MLflow open source machine learning will join the Linux Foundation.

    The project is two-years old in 2020 and has seen engagement from somewhere over 200 contributors.

    It is downloaded more than 2 million times per month.

Databricks hands over MLFlow to Linux

  • Databricks hands over MLFlow to Linux

    Open Source MLOps framework MLFlow launched by Databricks has been moved to the Linux Foundation. The news was announced at the Spark+AI Summit by Matei Zaharia, creator of Apache Spark and MLFLow, and the co-founder of Databricks. New functionalities are added to the framework, including integration with Continuous Integration/Continuous Deployment (CI/CD) platforms like GitLab and Jenkins, new Application Programming Interfaces (API), automatic versioning and logging, etc.

MLflow has Grown Up and Left Home...

  • MLflow has Grown Up and Left Home: Machine Learning Framework Joins Linux Foundation

    “We’ve moved MLflow into the Linux Foundation as a vendor-neutral non-profit organization to manage the project long-term”

    Databricks has donated its hugely popular machine learning framework MLflow to the non-profit Linux Foundation.

    The open source tool from the US company (whose founders created analytics engine Apache Spark) sees an eye-ball popping 2.5 million downloads a month and has 200 contributors from 100 organisations.

    MLflow allows organisations to package their code for reproducible runs and execute hundreds of parallel experiments, across platforms. It integrates closely with Apache Spark, SciKit-Learn, TensorFlow and other open source ML frameworks.

Databricks moves MLflow to Linux Foundation

  • Databricks moves MLflow to Linux Foundation, introduces Delta Engine

    MLflow, the open source machine learning operations (MLOps) platform created by Databricks, is becoming a Linux Foundation project. It's also getting some new features. The move was announced by Matei Zaharia, co-founder of Databricks, and creator of both MLflow and Apache Spark, at the company's Spark + AI Summit virtual event today.

    [...]

    With that kind of growth, Zaharia explained that it's important for customers to see the project managed by a vendor-neutral organization. This protects customer investments in MLflow and eliminates any unease that the project might be dependent on Databricks' corporate direction. I still find it odd that Spark itself -- on which the Databricks platform is based -- is an Apache Software Foundation project, whereas associated projects Delta Lake and now MLflow sit under the Linux Foundation. Zaharia explained that the two foundations operate in a similar enough way that it shouldn't impact users and pointed out that Kubernetes and the Cloud Native Computing Foundation are also under the Linux Foundation umbrella, creating useful synergies for the Databricks-launched projects that have moved there.

Databricks hands MLflow to Linux Foundation

  • Databricks hands MLflow to Linux Foundation, speeds up Delta Lake, and pushes pandas on Spark forward

    Data science conference Spark+AI Summit is still in full swing. Organised by Spark experts Databricks, it naturally lent itself as a stage for some progress reports and letting the firm show off new products.

    Amongst other things, machine learning platform MLflow has found a new home at the Linux Foundation. After being in the open for two years, the move provides the Databricks project with a new vendor neutral environment in the hopes that this will lead to higher adoption rates and more outside committers.

    While this seems like a somewhat sensible thing to do, onlookers might wonder about the choice of foundation. After all, company co-founder and MLflow creator Matei Zaharia chose the Apache Software Foundation for Spark. A second glance however reveals that the Linux Foundation seems to become a bit of a default for Databricks in recent years, since the company’s Delta Lake was also handed over to the org last autumn.

IBM donates AI ethics tools to Linux Foundation

  • IBM donates AI ethics tools to Linux Foundation

    The Linux Foundation is a nonprofit technology consortium dedicated to protecting and advancing Linux, an open source operating system. The group provides support to numerous open source projects and communities. As part of the Linux Foundation, the LF AI Foundation supports open source projects in AI, machine learning and deep learning.

    Open source projects, while open to the community, are still controlled by an individual or vendor. They individual or vendor can limit who works on the project, the direction the project takes and how quickly it updates.

    With this latest move, IBM concedes control of the three AI toolkits to the vendor-neutral LF AI Foundation. Linux Foundation's open governance model, in theory, eliminates single-vendor control of open source projects, broadens the community working on them and helps accelerates their growth.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

More in Tux Machines

today's leftovers

  • Schedule for Wednesday's FESCo Meeting (2020-07-08)

    F33 System-Wide Change: Make nano the default editor https://pagure.io/fesco/issue/2426 APPROVED (+8, 0, -0)

  • Fedora Approves Of Making Nano The Default Terminal Text Editor, Other Features Accepted

    At this week's Fedora Engineering and Steering Committee (FESCo) meeting, more features were approved for the Fedora 33 release due out this fall. Most notable is the change of the default terminal text editor with Fedora 33 but other changes were also accepted. Highlights of this week's FESCo decisions include: - The change to make nano the default text editor was approved. Nano will be the new default over Vi.

  • Ingenic X2000 IoT Application Processor Combines 32-bit MIPS Xburst 2 Cores with Xburst 0 Real-time Core

    The company can provide a complete software and hardware development kit with a Linux 4.4 BSP and Halley5 development board with an X2000 SoM with a wireless module fitted to a largish carrier board with Ethernet, USB, microphone, MicroSD card slot, I/O header, buttons and so on. The other side of the board is equipped with a dual-camera board and a Full HD AMOLED display.

  •        
  • Linux 5.9 Will Finally Offer Proper Support For The ThinkPad 10 Ultrabook Keyboard

    While Lenovo recently committed to certifying more systems for Linux use and upstreaming drivers / hardware support for Linux moving forward, there remains a backlog of existing Lenovo devices that still have less than desire Linux support. But thanks to Red Hat and others, the hardware support does continue advancing.  The Lenovo ThinkPad 10 Ultrabook initially debuted in 2014 and now with Linux 5.9 debuting in late 2020 there is proper keyboard support, thanks to Red Hat's Hans de Goede who has frequently provided similar driver improvements for a range of hardware over the years. 

  • Full Circle Magazine: Full Circle Weekly News #177

    Ubuntu 20.04 Released https://www.omgubuntu.co.uk/2020/04/download-ubuntu-20-04 Ubuntu Survey Results https://ubuntu.com/blog/ubuntu-20-04-survey-results Fedora 32 Released https://fedoramagazine.org/announcing-fedora-32/ Lenovo Now Shipping Fedora on Thinkpads https://fedoramagazine.org/coming-soon-fedora-on-lenovo-laptops/ Manjaro 20 Released https://forum.manjaro.org/t/manjaro-20-0-lysia-released/138633 Bug In Git May Leak Credentials https://www.phoronix.com/scan.php?page=news_item&px=Git-Newline-Leak-Vulnerability Linux Kernel 5.7 rc4 Out https://lkml.org/lkml/2020/5/3/306 Linux Kernel 5.5 Is Now End of Life http://lkml.iu.edu/hypermail/linux/kernel/2004.2/07196.html Red Hat Enterprise Linux 8.2 Out https://www.redhat.com/archives/rhelv6-list/2020-April/msg00000.html Parrot 4.9 Out https://parrotsec.org/blog/parrot-4.9-release-notes/ IPFire 2.25 Core Update 143 Out https://blog.ipfire.org/post/ipfire-2-25-core-update-143-released Oracle Virtualbox 6.1.6 Out https://www.virtualbox.org/wiki/Changelog-6.1 LibreOffice 6.4.3 Out https://blog.documentfoundation.org/blog/2020/04/16/libreoffice-6-4-3/ Proton 5.0-6 Out https://www.gamingonlinux.com/articles/steam-play-proton-50-6-is-out-to-help-doom-eternal-rockstar-launcher-and-more-on-linux.16442 VLC 3.0.10 Out https://www.videolan.org/vlc/releases/3.0.10.html Darktable 3.0.2 Out https://www.darktable.org/2020/04/darktable-302-released/ OpenSUSE Tumbleweed for AWS Marketplace Out https://9to5linux.com/opensuse-tumbleweed-is-now-available-on-aws-marketplace KDE 20.04 Applications Out https://9to5linux.com/kde-applications-20-04-officially-released-this-is-whats-new Credits: Ubuntu “Complete” sound: Canonical Theme Music: From The Dust – Stardust

GNUnet 0.13.1 released

This is a bugfix release for gnunet and gnunet-gtk specifically. For gnunet, no changes to the source have been made. However, the default configuration had to be modified to support the changes made in 0.13.0. For gnunet-gtk, this fixes a more serious issue where the 0.13.0 tarball failed to build. Read more

Intel DG1 Graphics Card Bring-Up On Linux Continues - Latest Bits For Local Memory

Recently there have been a lot of open-source Linux patches flowing concerning Intel's bring-up of their DG1 discrete graphics card for developers. That work continued this week with the latest patches in wiring up LMEM support. Among the recent Intel DG1 patches for Linux recently have been on the media driver front, compute runtime with OpenCL and Level Zero and as part of that the IGC support, and then most importantly the necessary Linux kernel changes building off the existing Gen12/Xe graphics support. Read more Also: Intel AMX Support Lands In The GNU Assembler

Programming: GStreamer, Drat, RasPi, Python