Readit News logoReadit News
lucb1e · 12 years ago
> Extract tar.gz in new directory: tar zxvf package.tar.gz -C new_dir

For quick reference, since it seems to be hard[1], these are the flags you'll most need in tar:

    c = create
    x = extract
    v = verbose
    z = gzipped; compressed.
    f = file
So for example `tar xf example.tar` will extract that tar file. Or `tar cf example.tar .` will pack all files in the current directory to example.tar. For compression and verbosity, it would be `tar zvcf example.tar.gz .`. The .gz at the end is optional, but now others can see what kind of archive it is. Extract .tar.gz files with `tar xzf example.tar.gz`.

For bonus points, here is a poor man's version of scp/rsync:

    # sending computer
    tar czf - . | openssl aes-128-cbc -k 'secret' | nc -l 1
    # receiving computer
    nc 192.168.1.102 1 | openssl aes-128-cbc -d -k 'secret' | tar xf -
[1] Obligatory xkcd https://xkcd.com/1168/

Edit: replaced all asterisks with a period (.) since it would become italics. Tar is recursive by default, so it should work the same.

fit2rule · 12 years ago
Cheese note: I still do the ol' pipe dance when de-compressing archives, like this:

    gunzip -c somefile.tar.gz | tar xvf - 
The reason? Well, its like this: I learned it that way on machines that had, typically, about 4 megs available. So it used to be, back in the ol' days, that if you tried to do it like:

    tar xvzf somefile.tar.gz
.. you'd run out of RAM, get into swapfile sadness, and so on.

Piping it through the console first, used the tty-buffers, which blocked whenever exhaustion occurs, but nevertheless: recovered a lot smoother than when heavy swap was involved ..

Dunno if its still 'true' (could be a mythos I'm passing on from the old, drunk sysadmin I learned the rule from) but it aways bugs me when I forget to do it 'the new way' ..

bediger4000 · 12 years ago
This is at least sometimes still true in corporate Linux environments. Giant, Immoral MegaCorps apparently can't be bothered to spring for big disks, so doing "tar xzf" or gunzipping something before un-tarring often fills up the filesystem. Embarassing, but true, given that you can hoof it to Office Depot and buy terabytes for a couple hundred, if they'd just let you.
jlgaddis · 12 years ago
> I still do the ol' pipe dance when de-compressing archives, like this:

Same here. Old habits die hard, I suppose.

parennoob · 12 years ago
Just use dtrx (do the right extraction) via `pip install dtrx`. Makes life much easier.
voltagex_ · 12 years ago
GNU tar seems to have gained the a switch which will detect the right decompressor.

e.g.

tar axf linux.tar.gz

tar axf linux.tar.bz2

tar axf linux.tar.xz

will all work, assuming you have gzip, bzip2 and xz installed.

sobering · 12 years ago
I'd also add `-j' to that list.

j = bzip2

I find a lot of packages with the `.tar.bz2' extension. Just replace `z' with `j' in your tar command and you're good.

lucb1e · 12 years ago
Can't edit my post anymore, but good tip! As dmd commented though, it seems tar automatically detects compression on files because of the file extension.
dmd · 12 years ago
And the 'z' flag is unnecessary; gnu tar is smart enough to figure that out on its own.
lucb1e · 12 years ago
Yesterday I got an error 'error: tar archive is compressed. Aborting' or something along those lines. When reading a file it might detect it because of the filename, but with stdin you need to specify the flag it seems.

Deleted Comment

weland · 12 years ago
> I’m using Linux shell on daily basis, but I often forgot some useful command or shell tip.

I hate to be overly pedantic, but what shell would that be? There is no such thing as the Linux shell.

dredmorbius · 12 years ago
Well, the default Linux shell is /bin/bash on most systems.

I'd say more about the article itself and what it should and/or does say on this, but at present, I suspect the author is looking up "Webserver and Database Scalability and Availability Tips & Tricks":

"Error establishing a database connection"

weland · 12 years ago
I'm well-aware that bash is a (if not the) popular choice on desktops and servers, but my terse and somewhat snarky answer was motivated by two other factors:

1. Not only do distributions like Debian or Ubuntu use dash, but various other shells are becoming more relevant to programmers due to their inclusion in special-purpose systems, such as devices running with a Busybox-userspace (which includes pretty much every Android phone, for instance).

2. If the article claims to have any educative value, it should definitely mention that this is something about a particular shell. Assuming the author isn't lying about his use of nix systems (since the diversity of shells is common knowledge to anyone seriously using Unices), the other logical choice is that saying bash instead of Linux isn't as cool in terms of SEO. The WWW is cluttered enough with every marketing drone hiring cheap labour on freelancer.com to fill it with bad spinoffs just to promote their semi-scam business, making any kind of legitimate information so hard to find you'd think it's 1998 again for some topics; it itches me on a personal* level when I see programmers doing that. We should know better.

profquail · 12 years ago
A number of Linux distributions have moved to the BSD-licensed dash[1] for running their system initialization scripts, as it's noticeably faster than bash (resulting in faster boot times). Ubuntu made this change back in 2006 [2][3], and Debian switched to dash for Debian Squeeze.

Bash is still the default user shell on those systems, though.

[1]: https://en.wikipedia.org/wiki/Debian_Almquist_shell

[2]: http://lwn.net/Articles/343924/

[3]: https://wiki.ubuntu.com/DashAsBinSh

emilw · 12 years ago
I don't think your being overly pedantic. The differences between sh/bash/csh/tcsh/ksh/zsh alone are enough to make your head spin.
olog-hai · 12 years ago
This is incorrect and misleading right off the bat. Ctrl+Z does not "send process to background." You will almost always need to use the bg command for that after suspending the running program.
njharman · 12 years ago
Came here to say that and to add. Long list of commands with no explanation or details is minimally useful.

I challenge you to read a man page a week. Use that command every day that week. Find away to use it with two or three other commands you know. Breakdown tasks into units the size of commands you know. Fill in missing pieces with bash or scripting language of choice.

girvo · 12 years ago
I've been using Linux since 2006... And only this year did I finally type 'man' into my terminal. I no longer use google for finding those sorts of things out.
voltagex_ · 12 years ago
Hey cool, I never knew there was bg to go with fg.

Ctrl Z is stop/suspend, unless the application has handling for that signal (e.g. lftp)

Now off to learn about disown, dtatch and nohup

teddyh · 12 years ago
SIGTSTP (which Ctrl-Z sends) is not the same as SIGSTOP (which always stops/suspends processes). There is always more to learn.
jlgaddis · 12 years ago
> Hey cool, I never knew there was bg to go with fg.

`jobs` might be useful to you as well, in that case.

yeukhon · 12 years ago
I also recommend http://explainshell.com/. It does its best to break down what a shell command like tar vxf file.gz does.
clarry · 12 years ago
So, a random assortment of commands, most of which have nothing to do with Linux.

I'm sure somebody will find something useful here though.

hpaavola · 12 years ago
"Error establishing a database connection" :(

Here's a Google Cache link: http://webcache.googleusercontent.com/search?q=cache:5z9gUWv...

Content is typical blog style content and even comments come from Disqus, so ther should not be any reason to connect to a database with every request.

yeukhon · 12 years ago
"Copyright © 2013 - Alen Komljen - Hosted on OpenShift "

Maybe author is using a free edition which has limit?

rtpg · 12 years ago
Nice list of stuff, especially for people relatively new to command line stuff

there's a cool twitter account called "Command Line Magic" (https://twitter.com/climagic) that does some fun stuff, and is pretty shell-agnostic.

Also, for those willing to, I'd strongly suggest checking out fish. it's not bash-compatible, but there's a lot of good usability aspects to it (especially compared to vanilla bash), I love it.

Out of curiosity though, this command : tar zxvf package.tar.gz -C new_dir

it's always intrigued me that the tar command (I imagine it is mainly used to "unzip" things) does not make it very simple to do this. I've started to memorize the 4-letter combo but for a while I had to google it everytime (man pages are not useful for learning things for a lot of unix cl tools).

elteto · 12 years ago
tar is not a compression program per se, but a file archiving tool. It is used because it preserves file system information such as permissions, owner and group, which would otherwise be lost if you used zip/gzip/bzip alone. Each letter has a meaning, x is for extract, f is file, v is verbose (print details to screen) and f is for file. So the cryptic four letters are really easy to rememeber: eXtract the Zip File Verbosely. Change the x for a c (Create) and you can make a new file.
clarry · 12 years ago
I was going to ask what is wrong with the man page (because in my experience they do a mighty fine job of explaining most traditional unix tools). But then I checked the manuals for two variants of tar (gnu and obsd), and I can see how they might appear less than helpful for a new user who has never dealt with gzip before.

I am surprised the xz(v)f invocation isn't in the examples. I could've sworn it's there...

rtpg · 12 years ago
I almost always try info instead of man because that's where I'll find common use cases of tools (when the info page exists).

man is obviously useful when you want to know what one switch does, but there are a lot of tools that could use an introductory "how to use"

brennen · 12 years ago
> it's always intrigued me that the tar command (I imagine it is mainly used to "unzip" things) does not make it very simple to do this.

It helps to remember that tar stands for Tape ARchiver (or Tape ARchive, or something, depending on who you ask), and that its interface really does date from the era when dealing with tape was a common task for pretty much any sysadmin.

rich90usa · 12 years ago
The mnemonic that I've ran across that has been helpful for this is feigning a horrible German accent and saying "eXtract Ze File!"
elteto · 12 years ago
That's funny! i just remember it as eXtract gZip File, no accents necessary!
WizzleKake · 12 years ago
Any discussion of Linux shell tricks/tips is incomplete without a mention of the readline shortcuts: http://www.bigsmoke.us/readline/shortcuts
derwiki · 12 years ago
I just told myself that learning all of these would be time well spent. Thanks for posting!
tomsthumb · 12 years ago
Knowing all of those means you basically get movement in emacs for free.