Language Selection

English French German Italian Portuguese Spanish

Custom scripting gives users a safe-du

Filed under
HowTos

My company has a Linux cluster with a terabyte of attached storage. Over time we noticed the head node was becoming more overloaded. Inspection of the system showed that users were starting dozens of copies of the du utility to determine disk space usage. This was a natural thing for them to do, because they had a need to know how much disk space was available. A lack of disk space would cause their software builds and tests to fail. The problem was that it takes five to seven hours for a du of the entire shared filesystem. Thus, when the filesystem was nearly full (as it of course usually was), the number of du processes would increase almost exponentially.

To address this problem, we first set up automated nightly disk space reports, so that users could check the status without running du. This still did not solve the problem, as the amount of used space could fluctuate dramatically over the course of 24 hours. Users still wanted and needed to run their own du processes throughout the workday.

While adding more disk space would have solved the problem, we are using a large disk array that is already filled to maximum capacity. In general, users tend to fill up all available disk space anyway, no matter how much you give them.

We then developed a policy: users could run du on any directory they owned. In addition, user du processes would be allowed to run for a maximum of one hour of wall time. Users in the wheel group would be exempt from these restrictions.

I was given the task of developing a tool to implement this policy. Some sort of wrapper around the existing du seemed like an obvious choice: the script could validate the input, abort if an invalid path was given, and terminate the du process if it ran too long.

I wrote a basic bash script in perhaps an hour's time. Then I thought about how to run it, and that is where I ran into trouble. I had thought that I would make the script set user id (setuid) or set group id (setgid) root, i.e. when run by any user it would actually run in the root group. Then, I could change the permissions on the real du so that only root could run it. The result would be that normal users could only access the real du through the wrapper script.

Of course that would make a pretty boring article, and in reality it didn't turn out to be that simple:

Full Story.

More in Tux Machines

European Unified Patent Court goes Open Source

Using Private Cloud and Drupal as a starting point together with small expert partners and agile management the new platform for the European UPC has been shaped to the exact requirements and quickly adapted while more needs surfaced. The only ready to use Open Source tool used has been Zarafa Collaboration Platform which integrated with the Case Management System will provide secure email, instant messaging, file sharing and video conferencing to the platform's users. The result is that, thanks to Open Source based platform and by working with SMEs, the UK IPO team has been able to deliver to the Unified Patent Court team the project earlier than planned and under budget. Read more

Linux Foundation: Open Source Programming and DevOps Jobs Plentiful

Open source can help you make money, especially if you have skills in programming or DevOps, which is emerging as one of the hottest areas of interest for hiring managers seeking open source admins and developers. That's according to the latest Open Source Jobs Report from the Linux Foundation, which is out this week. Read more Also: The 2016 Open Source Jobs Report: Companies Hungry for Professional Open Source Talent

Basho Open Sources Some Bits

Leftovers: Ubuntu

  • The Simply Ubuntu Desktop
    Over on Flickr, fosco_ submitted this simple Ubuntu desktop, with just a few things tweaked for a cleaner experience. Like we’ve said, sometimes less is more, and this desktop makes good use of a few widgets to make a great UI even better.
  • HP Linux Imaging and Printing 3.16.5 Supports Ubuntu 16.04 LTS and Debian 8.4
    The team of developers behind the HPLIP (short for HP Linux Imaging and Printing) project, announced a few moments ago the availability of the fifth maintenance build in the 3.16 stable series of the software. For those of you who are not in the loop, HP Linux Imaging and Printing is an open-source initiative to bring the latest HP (Hewlett-Packard) printer drivers to GNU/Linux operating systems. The software has a pretty active development team working behind it, releasing maintenance builds at least once a month.
  • Convergence delayed: Unity 8 won’t be the default desktop in Ubuntu 16.10
    Canonical’s vision of convergence—a single, highly adaptive environment that spans mobile and desktop uses—has been delayed yet again. The Unity 8 desktop and Mir display server, which are key to that vision, won’t be used by default in Ubuntu 16.10, according to discussion in the Ubuntu Online Summit.
  • Questions and answers: Ubuntu bq tablet
    After Jack Wallen's recent review of the bq Aquaris M10 tablet, he was hit with a number of questions about the tablet. Jack addresses some of those questions to help you decide if the Ubuntu tablet is a worthy investment.