Floating Point Math in Bash, Part 2 (Wait for System Load)
If you run scripts that require a lot of execution time it's a good idea to try to avoid letting them overload your system. You can run them via nice, but if for example your script is sending a bunch of emails your email daemon isn't running via nice and it may itself get out of control. One way to deal with this is by using the values in /proc/loadavg to pause when your system load gets too high.
The contents of /proc/loadavg look something like this:
$ cat /proc/loadavg 0.05 0.14 0.09 1/243 12667The first three numbers are the load average over the last 1, 5, and 15 minutes. Load average being a measure of how busy the system is, the higher the load average the busier the system is. Specifically, load average is the number of processes in the system's run queue averaged over some time period, here 1, 5, or 15 minutes.
One slight problem that you'll notice is that the load average values are floating point values. This is where the floating point functions for bash that I wrote about come into play.
To wait for the load then we only need to extract the relevant value from /proc/loadavg then use float_cond described in the post I mentioned earlier to check if the load is above a certain point and pause if it is. We'll package this all up into its own file wait-for-load.sh so that it can be called from other scripts.
The command expects three command line arguments:
- The load average to pause at, as a floating point value
- The load average to restart at, as a floating point value
- The time, in seconds, to pause between load checks
The source for the script follows:
#!/bin/bash
source float.sh
if [[ $# -ne 3 ]]; then
echo "Usage: $0 STOP-AT-LOAD RESTART-AT-LOAD PAUSE-SECONDS"
exit 1
fi
stop_at=$1
restart_at=$2
pause_seconds=$3
##############################################################
function get_load()
{
local loadavg=$(cat /proc/loadavg | cut -d ' ' -f 1)
echo $loadavg
}
##############################################################
load=$(get_load)
if float_cond "$load >= $stop_at"; then
echo -n "Load is $load, pausing"
n=0
while float_cond "$load >= $restart_at"
do
sleep $pause_seconds
echo -n .
load=$(get_load)
let n++
if [[ $n -eq 10 ]]; then
echo -n $load
n=0
fi
done
echo
fi
# vim: tabstop=4: shiftwidth=4: noexpandtab:
# kate: tab-width 4; indent-width 4; replace-tabs false;
A sample run of the script follows:
$ sh wait-for-load.sh 2.0 1.0 10 Load is 5.06, pausing..........1.49... $
Mitch Frazier is an Associate Editor for Linux Journal.
Realizing the promise of Apache® Hadoop® requires the effective deployment of compute, memory, storage and networking to achieve optimal results. With its flexibility and multitude of options, it is easy to over or under provision the server infrastructure, resulting in poor performance and high TCO. Join us for an in depth, technical discussion with industry experts from leading Hadoop and server companies who will provide insights into the key considerations for designing and deploying an optimal Hadoop cluster.
Sponsored by AMD
If you already use virtualized infrastructure, you are well on your way to leveraging the power of the cloud. Virtualization offers the promise of limitless resources, but how do you manage that scalability when your DevOps team doesn’t scale? In today’s hypercompetitive markets, fast results can make a difference between leading the pack vs. obsolescence. Organizations need more benefits from cloud computing than just raw resources. They need agility, flexibility, convenience, ROI, and control.
Stackato private Platform-as-a-Service technology from ActiveState extends your private cloud infrastructure by creating a private PaaS to provide on-demand availability, flexibility, control, and ultimately, faster time-to-market for your enterprise.
Sponsored by ActiveState
| Non-Linux FOSS: libnotify, OS X Style | Jun 18, 2013 |
| Containers—Not Virtual Machines—Are the Future Cloud | Jun 17, 2013 |
| Lock-Free Multi-Producer Multi-Consumer Queue on Ring Buffer | Jun 12, 2013 |
| Weechat, Irssi's Little Brother | Jun 11, 2013 |
| One Tail Just Isn't Enough | Jun 07, 2013 |
| Introduction to MapReduce with Hadoop on Linux | Jun 05, 2013 |
- Containers—Not Virtual Machines—Are the Future Cloud
- Non-Linux FOSS: libnotify, OS X Style
- Linux Systems Administrator
- Validate an E-Mail Address with PHP, the Right Way
- Lock-Free Multi-Producer Multi-Consumer Queue on Ring Buffer
- Senior Perl Developer
- Technical Support Rep
- UX Designer
- Introduction to MapReduce with Hadoop on Linux
- RSS Feeds
Featured Jobs
| Linux Systems Administrator | Houston and Austin, Texas | Host Gator |
| Senior Perl Developer | Austin, Texas | Host Gator |
| Technical Support Rep | Houston and Austin, Texas | Host Gator |
| UX Designer | Austin, Texas | Host Gator |
| Web & UI Developer (JavaScript & j Query) | Austin, Texas | Host Gator |
Free Webinar: Hadoop
How to Build an Optimal Hadoop Cluster to Store and Maintain Unlimited Amounts of Data Using Microservers
Realizing the promise of Apache® Hadoop® requires the effective deployment of compute, memory, storage and networking to achieve optimal results. With its flexibility and multitude of options, it is easy to over or under provision the server infrastructure, resulting in poor performance and high TCO. Join us for an in depth, technical discussion with industry experts from leading Hadoop and server companies who will provide insights into the key considerations for designing and deploying an optimal Hadoop cluster.
Some of key questions to be discussed are:
- What is the “typical” Hadoop cluster and what should be installed on the different machine types?
- Why should you consider the typical workload patterns when making your hardware decisions?
- Are all microservers created equal for Hadoop deployments?
- How do I plan for expansion if I require more compute, memory, storage or networking?



2 hours 54 min ago
4 hours 20 min ago
8 hours 31 min ago
9 hours 16 min ago
9 hours 26 min ago
9 hours 31 min ago
11 hours 41 min ago
11 hours 42 min ago
12 hours 28 min ago
13 hours 16 min ago