Language Selection

English French German Italian Portuguese Spanish

Custom scripting gives users a safe-du

Filed under

My company has a Linux cluster with a terabyte of attached storage. Over time we noticed the head node was becoming more overloaded. Inspection of the system showed that users were starting dozens of copies of the du utility to determine disk space usage. This was a natural thing for them to do, because they had a need to know how much disk space was available. A lack of disk space would cause their software builds and tests to fail. The problem was that it takes five to seven hours for a du of the entire shared filesystem. Thus, when the filesystem was nearly full (as it of course usually was), the number of du processes would increase almost exponentially.

To address this problem, we first set up automated nightly disk space reports, so that users could check the status without running du. This still did not solve the problem, as the amount of used space could fluctuate dramatically over the course of 24 hours. Users still wanted and needed to run their own du processes throughout the workday.

While adding more disk space would have solved the problem, we are using a large disk array that is already filled to maximum capacity. In general, users tend to fill up all available disk space anyway, no matter how much you give them.

We then developed a policy: users could run du on any directory they owned. In addition, user du processes would be allowed to run for a maximum of one hour of wall time. Users in the wheel group would be exempt from these restrictions.

I was given the task of developing a tool to implement this policy. Some sort of wrapper around the existing du seemed like an obvious choice: the script could validate the input, abort if an invalid path was given, and terminate the du process if it ran too long.

I wrote a basic bash script in perhaps an hour's time. Then I thought about how to run it, and that is where I ran into trouble. I had thought that I would make the script set user id (setuid) or set group id (setgid) root, i.e. when run by any user it would actually run in the root group. Then, I could change the permissions on the real du so that only root could run it. The result would be that normal users could only access the real du through the wrapper script.

Of course that would make a pretty boring article, and in reality it didn't turn out to be that simple:

Full Story.

More in Tux Machines

FPGA add-on boards support Raspberry Pi, BeagleBone Black

Newark Element14’s new ValentFX Logi-Pi and Logi-Bone FPGA add-on boards for the Raspberry Pi and BeagleBone Black feature Arduino and PMOD hooks. We first covered the Logi-Pi and Logi-Bone Logi-Boards back in Sept. 2013 when ValentFX showed off prototypes at the New York Maker Faire. The Logi-Boards, which integrate Xilinx SPARTAN-6 XC6SLX9 FPGAs, and plug into the Linux-based Raspberry Pi or BeagleBone Black hacker boards, respectively, have now reached market, thanks to a partnership with Newark Element14. ValentFX and Newark have also launched a $45.48 Logi-Edu educational board add-on that purports to teach everyday hackers the mysteries of FPGA. Read more

AT&T to begin selling LG G Pad F 8.0 Android tablet on May 29

After releasing its own branded 8-inch Android tablet a mere two weeks ago, AT&T is giving itself some fresh competition. The mobile carrier has announced that it's bringing the LG G Pad F 8.0 to its customers starting on May 29. What's Hot on ZDNet The new model should not be confused with the LG G Pad 8.3, which, while being an older tablet, offers a slightly larger, higher-resolution screen and a faster processor. Rather, it's more of a bigger sibling to the LG G Pad 7.0 that was released late last year, coming with the same 1.2GHz quad-core Qualcomm Snapdragon 400 processor (compared to the 1.7GHz Snapdragon 600 inside the G Pad 8.3). Read more

Review: Kubuntu 15.04 "Vivid Vervet"

This month has been quite busy for me with classes. Now that the semester is finally over, I have a little more time, and that means I have enough time to do a review. It has been a few years since I've reviewed Kubuntu, the officially-supported variant of Ubuntu that uses KDE. Moreover, Kubuntu now features KDE 5 (I know the KDE naming and numbering system has become a lot more complicated, so this is, as a physicist might say, an intentional abuse of notation) as stable for the first time, so I figured I should try this version. I tried it as a live USB made with UnetBootin. Follow the jump to see what it's like. (It should become progressively clearer through this review why there are no pictures.) Read more

Open source data integration with Karma

Karma is a free, an open source data integration tool that makes it easy to convert data from a variety of formats into linked data. I recently attended a half-day workshop on Karma with Pedro Szekely, our instructor. He started by warning us that he knows very little about libraries, but a ton about data. The files we needed for the workshop were on GitHub, if you’re interested in checking it out. You can follow the tutorial steps on the Wiki, and, of course, you can find Karma itself on GitHub. Read more