Comments on: UNIX Recursive file renaming based on patterns

Question: UNIX Recursive file renaming based on patterns

turaho — Thu, 17 Mar 2005 07:34:54 -0800

Unix folks: How can I recursively find all files with a certain string in their filename, replace that string with another string, and rename them with the new filename?

For example, I'd like to find all the files in all subfolders that contain "category040" and change them to "category080". So category04021.gif gets renamed to category08021.gif.

I'm relatively ignorant about UNIX, so forgive me if this is a no-brainer...

By: andrew cooke

andrew cooke — Thu, 17 Mar 2005 07:44:01 -0800

it's probably possible with just find, but life's too short to work out how (or i'm too stupid). what i do is use find to produce a list of files in a temp file, then emacs (which you can "program") to turn that list into a list of "mv" commands.

so, in this case, it would be something like:
find . -name "*80*" -print > tmp
emacs tmp
*stuff involve ^X^(... *
source tmp

of course, if the emacs stuff above is gibberish, this won't help. sorry.

By: splice

splice — Thu, 17 Mar 2005 07:55:33 -0800

I always use perl for these things... You'll need the File::Find module installed for this application. I could eschew that and use the find command and interpret the output, but I'm lazy.



perl -e '

use File::Find;



my $dir = "/top/level/directory/here";

find(\&rename_files, $dir);



sub rename_files {

  if ($File::Find::name =~ /category040/) {

    $oldfile = $File::Find::name;

    $File::Find::name =~ s/category040/category080/;

    `mv $oldfile $File::Find::name`;

  }

}'

This should do the trick. Untested, but if you know a smidgen of perl, you can hack it to work easily, right? Same with error checking, otherwise make sure you have backups before running this blindly. And of course, this is on the command-line (perl -e), remove the appropriate parts (perl -e and backticks) to put into a script, and we should be using strict mode. Again, I'm just lazy :)

By: togdon

togdon — Thu, 17 Mar 2005 07:56:32 -0800

In bash:

#!/bin/bash
for file in *;do
newfile=$(echo $file | sed s/category040/category080/g)
test "$file" != "$newfile" && mv "$file" $newfile
done

By: splice

splice — Thu, 17 Mar 2005 07:59:40 -0800

Eh... Dunno what I was smoking, but I dout File::Find::name is modifiable, so store that puppy in $newfile before doing the regexp replace and do the replace on $newfile instead, like so:



# Store $File::Find::name in both $oldfile and $newfile

$oldfile = $newfile = $File::Find::name;

$newfile =~ s/category040/category080/;

`mv $oldfile $newfile`;

That would probably work better. Course, I overuse perl way too much in these cases, instead of doing bash scripting and using sed, like togdon above. Probably easier. But I like perl.

By: casu marzu

casu marzu — Thu, 17 Mar 2005 08:00:36 -0800

find . *category040* | grep category040 | perl -p -e 's/^(.*)(category040)(.*$)/mv $1$2$3 $1category080$3/' | sh

By: andrew cooke

andrew cooke — Thu, 17 Mar 2005 08:05:07 -0800

why doesn't
find . -name "*80" -exec mv {} `echo {} \| sed s/80/40/` \;
work?

By: grouse

grouse — Thu, 17 Mar 2005 08:11:04 -0800

I got sick of the various alternatives for this so I wrote my own in Python. The nice thing about it is that it has a --dry-run option that lets me list all the changes I'm



$ renamer --help
usage: renamer [OPTION]... [FILE]...

options:
  --version             show program's version number and exit
  -h, --help            show this help message and exit

  Filename modifications:
    -R STR, --remove=STR
                        remove STR
    -F OLD NEW, --fixed-string=OLD NEW
                        change OLD to NEW
    -P PATTERN NEW, --perl-regexp=PATTERN NEW
                        change regexp /PATTERN/ to NEW

  Miscellaneous:
    -r, --recursive     recurse through subdirectories
    -d, --directories   rename directories as well
    -n, --dry-run       don't actually do anything

If you have Python 2.4 and will use it, I'll package it up and put it on the web for you.

Oops, just noticed I never implemented the regexp option, but fixed-string replacement is good enough for you.

By: grouse

grouse — Thu, 17 Mar 2005 08:12:17 -0800

Ahem. The nice thing about it is that it has a --dry-run option that lets me list all the changes I'm about to make before I make them. Of course it's easy enough to do that with the find alternatives by sticking echo in front of the mv, I just got sick of find+sed for something I do so often.

By: plinth

plinth — Thu, 17 Mar 2005 08:19:09 -0800

Andrew it should - although, you might want to add the -n flag to mv so that it won't inadvertendly overrite an existing file, or better yet, write a script to test before doing the move and write any failures to stdout or stderr so it can be logged. The other issue you'll have is that that it will change the first pattern it finds, you if you have a path that has an 80 in it, it will rename that and not the file. On top of that, it will rename directories too. Don't forget, the goal is to rename 040 to 080
How about:
find . -t f -name "category04*" -exec mv -n {} `echo {} \| sed s/category040/category080` \;

By: andrew cooke

andrew cooke — Thu, 17 Mar 2005 08:26:27 -0800

find . -name "*80*" -exec bash -c "mv \$1 \`echo \$1 | sed s/80/40/\`" -- {} \;

on preview - i don't know why, but i need to invoke bash again (what i posted didn't work for me with cygwin bash)

By: grouse

grouse — Thu, 17 Mar 2005 09:01:15 -0800

See how much simpler renamer --recursive --fixed-string 80 40 is? ;)

By: felix

felix — Thu, 17 Mar 2005 09:02:20 -0800

find . | perl -ne'chomp; next unless -e; $oldname = $_; s/aaa/bbb/; next if -e; rename $oldname, $_'

"Please give me a list of all file names from here down. Perl, take each member of that list, take off any trailing whitespace that find may have generated, and as long as that file exists, save the old name, change any occurrence of 'aaa' to 'bbb' in that name, and unless the new name already exists, rename the file to that. Repeat until done."

No need for perl modules, and *especially* no need for python... :)

By: grouse

grouse — Thu, 17 Mar 2005 10:25:07 -0800

felix's one-liner will not get the expected results if you have any directories with the pattern in it, so beware. Also it renames only the first occurrence of 'aaa', not "any" of them. And you will get nasty results if you have any files with a newline in the name, althought that was asking for trouble in the first place.

By: 445supermag

445supermag — Thu, 17 Mar 2005 10:48:28 -0800

Doesn't anyone use Awk anymore? Manual is online, should be a couple line program.

By: Zed_Lopez

Zed_Lopez — Thu, 17 Mar 2005 11:47:27 -0800

Nope, no one uses awk anymore.

perl -MFile::Find -e 'find(sub {if (-f  and /category040/) { $old = $_; s/category040/category080/g; rename $old, $_}}, ".")'

Doesn't affect symbolic links, which I'm considering a feature. If it's not, replace -f $_ with (-f or -l).

By: turaho

turaho — Thu, 17 Mar 2005 12:25:33 -0800

Wow, there are a lot of great answers here--I'd check mark all of you if I didn't think it would make this thread look silly.

Anyway, I only needed a quick and dirty solution for a one-time problem with very defined parameters, so the suggestions of andrew cooke, plinth and felix were good enough for me. But I'm definitely bookmarking this thread for future reference in case massive filenaming becomes part of my job and I need a more robust solution.

Thanks again, everyone.

By: fvw

fvw — Thu, 17 Mar 2005 13:17:53 -0800

andrew cooke: It needs to be passed through a shell for tokenisation because you're passing the entire command to find as a single string. Try passing each element of ARGV (ie the command and its parameters) as a separate parameter.

By: andrew cooke

andrew cooke — Thu, 17 Mar 2005 13:27:57 -0800

eh? this is what didn't work. i can't see how Try passing each element of ARGV (ie the command and its parameters) as a separate parameter applies to that. can you explain more? (i'm not sure if i'm confused or you, but my second version with bash in the exec does work).

By: sfenders

sfenders — Thu, 17 Mar 2005 15:42:39 -0800

One more nifty thing you can do in bash:

for i in `find .` ; do mv $i ${i/gory080/gory040}; done