Saturday, July 4, 2015

10 Xargs Command Examples in Linux / UNIX


The xargs command is extremely useful when we combine it with other commands.
This tutorials explains the usage of xargs command using few simple examples.
These example will help you understand the basics of how xargs command works. But, once you understand these concepts, you can come-up with your own clever examples of xargs to solve various command line problems.
Syntax of xargs (from the man page):
xargs [-0prtx] [-E eof-str] [-e[eof-str]] [–eof[=eof-str]] [–null] [-d delimiter] [–delimiter delimiter] [-I replace-str] [-i[replace-str]] [–replace[=replace-str]] [-l[max-lines]] [-L max-lines] [–max-lines[=max-lines]] [-n max-args] [–max-args=max-args] [-s max-chars] [–max-chars=max-chars] [-P max-procs] [–max-procs=max-procs] [–interactive] [–verbose] [–exit] [–no-run-if-empty] [–arg-file=file] [–show-limits] [–version] [–help] [command [initial-arguments]]

1. Xargs Basic Example

The xargs command (by default) expects the input from stdin, and executes /bin/echo command over the input. The following is what happens when you execute xargs without any argument, or when you execute it without combining with any other commands.
When you type xargs without any argument, it will prompt you to enter the input through stdin:
$ xargs
Hi,
Welcome to TGS.
After you type something, press ctrl+d, which will echo the string back to you on stdout as shown below.
$ xargs
Hi,
Welcome to TGS.Hi, Welcome to TGS.

2. Specify Delimiter Using -d option

Delimiters can be applied so that each character in the input is taken literally using -d option in xargs.
In the previous example, even though the input contained a \n (newline) after ‘Hi,’ but the echoed output did not contain the newline ‘\n’ . So, the output in the previous example was combined into a single line.
In the following example, when you use the -d\n, it will preserve newline delimiter in the output, and display the output exactly as it was typed.
$ xargs -d\n
Hi,
Welcome to TGS.
After you type the above, press ctrl+d, which will echo the string back to you on stdout as shown below. But, this time it will preserve the newline.
$ xargs -d\n
Hi,
Welcome to TGS.Hi, 
Welcome to TGS.

3. Limit Output Per Line Using -n Option

By default as explained earlier, xargs displays whatever comes to its stdin as shown below.
$ echo a b c d e f| xargs
a b c d e f
But, the output of the xargs command can be split into multiple lines using -n option.
In the following example, we used -n 3, which will display only 3 items per line in the xargs output.
$ echo a b c d e f| xargs -n 3
a b c
d e f
In the same way, you can also split the output with 2 items per line as shown below using -n 2.
$ echo a b c d e f| xargs -n 2
a b
c d
e f

4. Prompt User Before Execution using -p option

Using option -p, you can confirm the execution of the xargs command from the user.
Considering the previous example, if we want to confirm each execution of the /bin/echo command by the user, use the -p option along with -n option as shown below.
$ echo a b c d e f| xargs -p -n 3
/bin/echo a b c ?...y
/bin/echo d e f ?...a b c
y
d e f
In the following output, I said “n” to all the echo output. So, xargs did not execute anything.
$ echo a b c d e f| xargs -p -n 3
/bin/echo a b c ?...n
/bin/echo d e f ?...n
/bin/echo ?...n
Note: This is helpful when you are combining xargs with commands that are disruptive like rm. In those cases, you may want to see what xargs does.

5. Avoid Default /bin/echo for Blank Input Using -r Option

When there is a blank input (i.e no input was given to xargs command), it will execute a /bin/echo command which will display a new line as shown below.
$ xargs -p
Press ctrl-d after typing “xargs -p”, which will indicate that it executed a /bin/echo as shown below.
$ xargs -p
                      /bin/echo ?...y

$

6. Print the Command Along with Output Using -t Option

In the following example, type “abcd” as the input for the xargs -t command.
$ xargs -t
abcd
Press ctrl-d to complete the above xargs -t command, which will display the command that xargs really executes before displaying the output. In this case, the command that xargs executes is “/bin/echo abcd”, which is displayed here.
$ xargs -t
abcd
/bin/echo abcd
abcd

7. Combine Xargs with Find Command

It is one of the most important usage of xargs command. When you need to find certain type of files and perform certain actions on them (most popular being the delete action).
The xargs command is very effective when we combine with other commands.
In the following example, we took the output of the find command, and passed it as input to the xargs command. But, instead of executing the default /bin/echo command, we are instructing xargs command to execute the rm -rm command on the input.
So, in this example, the output of the find command is all the files with *.c extension, which is given as input to the xargs command, which in-turn execute “rm -rf” command on all the *.c files.
$ ls
one.c  one.h  two.c  two.h

$ find . -name "*.c" | xargs rm -rf

$ ls
one.h  two.h

8. Delete Files that has White-space in the Filename

So we see that despite of running the rm command on the .c files in this directory, the file ‘The Geek Stuff.c’ was not deleted. This is because this file contains white space characters in its name.
As shown in the following example, it deleted all the files with the *.c extension except one. i.e the file that has white space in the filename (i.e “The Geek Stuff.c”) was not deleted by the rm command.
$ touch "The Geek Stuff.c"

$ ls
one.c  one.h  two.c  two.h The Geek Stuff.c

$ find . -name "*.c" | xargs rm -rf

$ ls
one.h  two.h  The Geek Stuff.c
In this situation, use the -print0 option with find command and -0 option with xargs command to delete files including those that has space in the filenames as shown below.
$ ls
one.c  one.h  two.c  two.h The Geek Stuff.c

$ find . -name "*.c" -print0 | xargs -0 rm -rf

$ ls
one.h  two.h

9. Display System Limits on xargs using –show-limits option

See the example below:
The following example displays all the limits set by the OS that will have an impact on the way how xargs command works.
$ xargs --show-limits
Your environment variables take up 1203 bytes
POSIX upper limit on argument length (this system): 2093901
POSIX smallest allowable upper limit on argument length (all systems): 4096
Maximum length of command we could actually use: 2092698
Size of command buffer we are actually using: 131072

Execution of xargs will continue now, and it will try to read its input and 
run commands; if this is not what you wanted to happen, please type the 
end-of-file keystroke.

Warning: /bin/echo will be run at least once.  If you do not want that to happen, 
then press the interrupt keystroke

10. Combine Xargs with Grep command

The xargs command can be combined with grep command to filter particular files from the search results of the find command.
In the following example, find command provided all the .c files as input to xargs.
The xargs command executes the grep command to find all the files (among the files provided by find command) that contained a string ‘stdlib.h’.
$ find . -name '*.c' | xargs grep 'stdlib.h'
./tgsthreads.c:#include
./valgrind.c:#include
./direntry.c:#include
./xvirus.c:#include
./temp.c:#include
...
...
...

No comments: