How do I write stderr to a file while using “tee” with a pipe?

I’m assuming you want to still see STDERR and STDOUT on the terminal. You could go for Josh Kelley’s answer, but I find keeping a tail around in the background which outputs your log file very hackish and cludgy. Notice how you need to keep an exra FD and do cleanup afterward by killing it and technically should be doing that in a trap '...' EXIT.

There is a better way to do this, and you’ve already discovered it: tee.

Only, instead of just using it for your stdout, have a tee for stdout and one for stderr. How will you accomplish this? Process substitution and file redirection:

command > >(tee -a stdout.log) 2> >(tee -a stderr.log >&2)

Let’s split it up and explain:

> >(..)

>(...) (process substitution) creates a FIFO and lets tee listen on it. Then, it uses > (file redirection) to redirect the STDOUT of command to the FIFO that your first tee is listening on.

Same thing for the second:

2> >(tee -a stderr.log >&2)

We use process substitution again to make a tee process that reads from STDIN and dumps it into stderr.log. tee outputs its input back on STDOUT, but since its input is our STDERR, we want to redirect tee‘s STDOUT to our STDERR again. Then we use file redirection to redirect command‘s STDERR to the FIFO’s input (tee‘s STDIN).

See http://mywiki.wooledge.org/BashGuide/InputAndOutput

Process substitution is one of those really lovely things you get as a bonus of choosing bash as your shell as opposed to sh (POSIX or Bourne).

In sh, you’d have to do things manually:

out="${TMPDIR:-/tmp}/out.$$" err="${TMPDIR:-/tmp}/err.$$"
mkfifo "$out" "$err"
trap 'rm "$out" "$err"' EXIT
tee -a stdout.log < "$out" &
tee -a stderr.log < "$err" >&2 &
command >"$out" 2>"$err"

Related Posts:

  1. How do I use grep to search the current directory for all files having the a string “hello” yet display only .h and .cc files?
  2. Extract file basename without path and extension in bash
  3. Given two directory trees, how can I find out which files differ by content?
  4. What is the difference between “#!/usr/bin/env bash” and “#!/usr/bin/bash”?
  5. What does `set -x` do?
  6. How to get pid of just started process
  7. Can you have more than one ~/.ssh/config file?
  8. How do I deal with a filename that starts with the hyphen (-) character?
  9. Bash: No such file or directory?
  10. How do I grep recursively?
  11. How do I grep recursively?
  12. Why do you need to put #!/bin/bash at the beginning of a script file?
  13. “Couldn’t find a file descriptor referring to the console” on Ubuntu bash on Windows
  14. gzip: stdin: not in gzip format tar: Child returned status 1 tar: Error is not recoverable: exiting now
  15. How do I grep recursively?
  16. Pass a password to ssh in pure bash
  17. -bash: syntax error near unexpected token `newline’ for display command
  18. SSH using python script
  19. How can I exclude directories from grep -R?
  20. “sed” command in bash
  21. How can I exclude directories from grep -R?
  22. Argument list too long error for rm, cp, mv commands
  23. Difference between using “chmod a+x” and “chmod 755”
  24. Explaining the ‘find -mtime’ command
  25. How does “cat << EOF" work in bash?
  26. Pseudo-terminal will not be allocated because stdin is not a terminal
  27. How to cat <> a file containing code?
  28. mv: cannot stat error : No such file or directory error
  29. Diff command along with Grep gives “Binary file (standard input) matches”
  30. Pseudo-terminal will not be allocated because stdin is not a terminal
  31. ./configure : /bin/sh^M : bad interpreter
  32. How to download a file from server using SSH?
  33. Trying to use bash on Windows and got no installed distributions message
  34. -bash: fork: Cannot allocate memory
  35. Is there a “goto” statement in bash?
  36. Bash script: bad interpreter
  37. How to count lines in a document?
  38. Command to change the default home directory of a user
  39. How to get the process ID to kill a nohup process?
  40. Writing a simple shell in C using fork/execvp
  41. chmod: changing permissions of ‘my_script.sh’: Operation not permitted
  42. Using ls to list directories and their total sizes
  43. What does “&” at the end of a linux command mean?
  44. Can’t remove a directory in Unix
  45. tar: add all files and directories in current directory INCLUDING .svn and so on
  46. What does set -e mean in a bash script?
  47. What does set -e mean in a bash script?
  48. Syntax error near unexpected token ‘then’
  49. C fopen vs open
  50. “find: paths must precede expression:” How do I specify a recursive search that also finds files in the current directory?
  51. Bash script prints “Command Not Found” on empty lines
  52. Pipe to/from the clipboard in a Bash script
  53. Linux Bash: Move multiple different files into same directory
  54. Restarting cron after changing crontab file?
  55. How to include file in a bash shell script
  56. cd into directory without having permission
  57. How to enable Bash in Windows 10 developer preview?
  58. What does ‘bash -c’ do?
  59. bash sh – command not found 
  60. How do I know the script file name in a Bash script?
  61. How can I sort du -h output by size
  62. Copying a large directory tree locally? cp or rsync?
  63. What are the functional differences between .profile .bash_profile and .bashrc
  64. Can I nohup/screen an already-started process?
  65. Environment variables of a running process on Unix?
  66. How to run a command multiple times, using bash shell?
  67. In my /etc/hosts/ file on Linux/OSX, how do I do a wildcard subdomain?
  68. When does /tmp get cleared?
  69. How do I prevent accidental rm -rf /*?
  70. SSL Certificate Location on UNIX/Linux
  71. How do I sleep for a millisecond in bash or ksh
  72. Is it possible to detach a process from its terminal? (Or, “I should have used screen!”) [duplicate]
  73. What is “-bash: !”: event not found”
  74. What does ‘set -e’ do, and why might it be considered dangerous?
  75. What’s the best way to check if a volume is mounted in a Bash script?
  76. Keeping a linux process running after I logout
  77. What useful things can one add to one’s .bashrc? [closed]
  78. Meaning of directories on Unix and Unix like systems
  79. How to add a timestamp to bash script log?
  80. How to remove empty/blank lines from a file in Unix (including spaces)?
  81. How to forcibly close a socket in TIME_WAIT?
  82. Colors in bash after piping through less?
  83. How can I rename a Unix user?
  84. Linux command line best practices and tips?
  85. How to run command as user who has /usr/sbin/nologin as Shell?
  86. How to disable everything in crontab -l?
  87. SSH from A through B to C, using private key on B [closed]
  88. How can I fully log all bash scripts actions?
  89. How to sort ps output by process start time?
  90. How to apply a filter to real time output of `tail -f `?
  91. How to remove invalid characters from filenames?
  92. zcat/gzcat works in linux, not on osx. general linux/osx compatibility
  93. What’s a .sh file?
  94. How to prevent a user from login in, but allow “su – user” in Linux?
  95. I have a keypair. How do I determine the key length?
  96. Why drop caches in Linux?
  97. swap partition vs file for performance?
  98. Best way to disable swap in Linux
  99. How can I zip/compress a symlink?
  100. How to find the physical volume(s) that hold a logical volume in LVM

Leave a Comment