Script to Copy Files Conditionally

Hi i need a short script to copy files from one drive to an archive drive. Have been using cmds like cp -pfR from one drive to another, but it would be more efficient if the copy were conditional on the date / time difference between source / destination file. Have been looknig for a way to do this, but am no script expert and any pointers to relevant commands or examples would be appreciated... Chris ---------------------- Greenfield Designs Ltd Electronic and Embedded System Design Oxford, England (44) 1865 750 681

On Wed, 04 Apr 2007 16:21:08 GMT ChrisQuayle <nospam@devnul.co.uk> wrote: > i need a short script to copy files from one drive to an archive > drive. Have been using cmds like cp -pfR from one drive to another, > but it would be more efficient if the copy were conditional on the > date / time difference between source / destination file. > > Have been looknig for a way to do this, but am no script expert and > any pointers to relevant commands or examples would be appreciated... rsync

Frank Cusack wrote: > On Wed, 04 Apr 2007 16:21:08 GMT ChrisQuayle <nospam@devnul.co.uk> wrote: > >>i need a short script to copy files from one drive to an archive >>drive. Have been using cmds like cp -pfR from one drive to another, >>but it would be more efficient if the copy were conditional on the >>date / time difference between source / destination file. >> >>Have been looknig for a way to do this, but am no script expert and >>any pointers to relevant commands or examples would be appreciated... > > > rsync Thanks. Just looked at that and will probably build and have a look, but really only need to mirror files on the same machine. A cron driven script would be more appropriate in this case... Chris -- ---------------------- Greenfield Designs Ltd Electronic and Embedded System Design Oxford, England (44) 1865 750 681

On Wed, 04 Apr 2007 17:15:39 GMT ChrisQuayle <nospam@devnul.co.uk> wrote: > Frank Cusack wrote: >> On Wed, 04 Apr 2007 16:21:08 GMT ChrisQuayle <nospam@devnul.co.uk> wrote: >> >>>i need a short script to copy files from one drive to an archive >>>drive. Have been using cmds like cp -pfR from one drive to another, >>>but it would be more efficient if the copy were conditional on the >>>date / time difference between source / destination file. >>> >>>Have been looknig for a way to do this, but am no script expert and >>>any pointers to relevant commands or examples would be appreciated... >> >> >> rsync > > Thanks. Just looked at that and will probably build and have a look, > but really only need to mirror files on the same machine. A cron > driven script would be more appropriate in this case... 0 0 * * * rsync src dst -frank

Frank Cusack wrote: > On Wed, 04 Apr 2007 17:15:39 GMT ChrisQuayle <nospam@devnul.co.uk> wrote: > >>Frank Cusack wrote: >> >>>On Wed, 04 Apr 2007 16:21:08 GMT ChrisQuayle <nospam@devnul.co.uk> wrote: >>> >>> >>>>i need a short script to copy files from one drive to an archive >>>>drive. Have been using cmds like cp -pfR from one drive to another, >>>>but it would be more efficient if the copy were conditional on the >>>>date / time difference between source / destination file. >>>> >>>>Have been looknig for a way to do this, but am no script expert and >>>>any pointers to relevant commands or examples would be appreciated... >>> >>> >>>rsync >> >>Thanks. Just looked at that and will probably build and have a look, >>but really only need to mirror files on the same machine. A cron >>driven script would be more appropriate in this case... > > > 0 0 * * * rsync src dst > > -frank Thanks, but it's still overkill, when a one or two line script would probably get the job done just as well :-). What happened to all the arcane skills of unix, a single tool to do a single job well, specialisation over generalisation etc, or has it all morphed into the bloatware that is modern Linux ?... Chris -- ---------------------- Greenfield Designs Ltd Electronic and Embedded System Design Oxford, England (44) 1865 750 681

On Wed, 04 Apr 2007 18:14:56 GMT ChrisQuayle <nospam@devnul.co.uk> wrote: > Frank Cusack wrote: >> On Wed, 04 Apr 2007 17:15:39 GMT ChrisQuayle <nospam@devnul.co.uk> wrote: >> >>>Frank Cusack wrote: >>> >>>>On Wed, 04 Apr 2007 16:21:08 GMT ChrisQuayle <nospam@devnul.co.uk> wrote: >>>> >>>> >>>>>i need a short script to copy files from one drive to an archive >>>>>drive. Have been using cmds like cp -pfR from one drive to another, >>>>>but it would be more efficient if the copy were conditional on the >>>>>date / time difference between source / destination file. >>>>> >>>>>Have been looknig for a way to do this, but am no script expert and >>>>>any pointers to relevant commands or examples would be appreciated... >>>> >>>> >>>>rsync >>> >>>Thanks. Just looked at that and will probably build and have a look, >>>but really only need to mirror files on the same machine. A cron >>>driven script would be more appropriate in this case... >> >> >> 0 0 * * * rsync src dst >> >> -frank > > Thanks, but it's still overkill, when a one or two line script would > probably get the job done just as well :-). You may have lost me here. How is a 1 or 2 line script LESS work or LESS overkill than a single line cron entry. Here's your one line script: --8<--- #!/bin/sh rsync $1 $2 --8<--- Or does the smiley indicate you are joking? > What happened to all the arcane skills of unix, a single tool to do a > single job well, specialisation over generalisation etc, or has it all > morphed into the bloatware that is modern Linux ?... You've really lost me there. rsync is a single tool that does its single highly specialized job quite well. -frank

Frank Cusack wrote: > > You've really lost me there. rsync is a single tool that does its > single highly specialized job quite well. > > -frank Not a windup, just the gut feeling that Solaris probably already has scriptable commands that would do such a simple job. Just looking for a solution that doesn't involve installing yet more software with attendant demons etc. If there isn't such a solution, then rsync does look like the way forward... Chris ---------------------- Greenfield Designs Ltd Electronic and Embedded System Design Oxford, England (44) 1865 750 681

On Wed, 04 Apr 2007 21:41:41 GMT ChrisQuayle <nospam@devnul.co.uk> wrote: > Frank Cusack wrote: > >> >> You've really lost me there. rsync is a single tool that does its >> single highly specialized job quite well. >> >> -frank > > Not a windup, just the gut feeling that Solaris probably already has > scriptable commands that would do such a simple job. It does. I was just giving you the easiest possible method. > Just looking for a solution that doesn't involve installing yet more > software with attendant demons etc. rsync doesn't need any daemon, etc., but I agree installing ever more and more software is a PITA for smaller shops. rsync is a standard tool, Solaris is deficient for not having it by default. > If there isn't such a solution, then rsync does look like the way forward... rsync is much easier, and much more efficient than any other method. One example of how to do it with the built-in tools: (cd src && find . -depth) | cpio -pdm dst but then you have to do some moderate post-processing (on the output from cpio) to exclude error messages about not copying files that are already newer (while still reporting other errors). If you have GNU tar (same problem with rsync though, you need addt'l software), you can use the --newer option to get pretty close to what rsync would do. -frank

On 2007-04-04 22:41:41 +0100, ChrisQuayle <nospam@devnul.co.uk> said: > Not a windup, just the gut feeling that Solaris probably already has > scriptable commands that would do such a simple job. Just looking for a > solution that doesn't involve installing yet more software with > attendant demons etc. rsync ships as a package on the Solaris 10 software companion. I'm not sure about earlier releases, but if it's not on the companion CDs there are undoubtedly packages at sunfreeware. There's no daemon (you can run rsync as a daemon but you don't need to and no daemon is set up by default). > > If there isn't such a solution, then rsync does look like the way forward... It's a fantastically useful tool for mirroring things.

On 2007-04-05, Tim Bradshaw <tfb@tfeb.org> wrote: > On 2007-04-04 22:41:41 +0100, ChrisQuayle <nospam@devnul.co.uk> said: > >> Not a windup, just the gut feeling that Solaris probably already has >> scriptable commands that would do such a simple job. Just looking for a >> solution that doesn't involve installing yet more software with >> attendant demons etc. man find Look at the time related, -exec & -cpio options. > > rsync ships as a package on the Solaris 10 software companion. I'm not > sure about earlier releases, but if it's not on the companion CDs there > are undoubtedly packages at sunfreeware. pkg-get install rsync Not hard ... -- Ignorance more frequently begets confidence than does knowledge: it is those who know little, not those who know much, who so positively assert that this or that problem will never be solved by science. [email me at huge {at} huge (dot) org <dot> uk]

On Apr 5, 10:49 am, Huge <H...@nowhere.much.invalid> wrote: > On 2007-04-05, Tim Bradshaw <t...@tfeb.org> wrote: > pkg-get install rsync > > Not hard ... I live in absolute terror of pkg-get (at least the blastwave one). 3 times out of 10 it will do what you want, 6 times out of 10 it will install a new version of gnome and/or libc which it will take a day to excise from the machin, once out of 10 you will need an exorcist, bleach and a flamethrower. --tim (yes, I know, it's not really that bad and what it's trying to do makes sense in context.)

On 2007-04-05, Tim Bradshaw <tfb+google@tfeb.org> wrote: > On Apr 5, 10:49 am, Huge <H...@nowhere.much.invalid> wrote: >> On 2007-04-05, Tim Bradshaw <t...@tfeb.org> wrote: > >> pkg-get install rsync >> >> Not hard ... > > I live in absolute terror of pkg-get (at least the blastwave one). 3 > times out of 10 it will do what you want, 6 times out of 10 it will > install a new version of gnome and/or libc which it will take a day to > excise from the machin, once out of 10 you will need an exorcist, > bleach and a flamethrower. It does have a habit of installing 200Gb of stuff when all you wanted was a new version of "less", I admit, but it's never broken anything here, and since it uses its own libraries and directory trees, it's easy enough to remove. -- Ignorance more frequently begets confidence than does knowledge: it is those who know little, not those who know much, who so positively assert that this or that problem will never be solved by science. [email me at huge {at} huge (dot) org <dot> uk]

Huge wrote: > On 2007-04-05, Tim Bradshaw <tfb+google@tfeb.org> wrote: > >>On Apr 5, 10:49 am, Huge <H...@nowhere.much.invalid> wrote: >> >>>On 2007-04-05, Tim Bradshaw <t...@tfeb.org> wrote: >> >>>pkg-get install rsync >>> >>>Not hard ... >> >>I live in absolute terror of pkg-get (at least the blastwave one). 3 >>times out of 10 it will do what you want, 6 times out of 10 it will >>install a new version of gnome and/or libc which it will take a day to >>excise from the machin, once out of 10 you will need an exorcist, >>bleach and a flamethrower. > > > It does have a habit of installing 200Gb of stuff when all you wanted > was a new version of "less", I admit, but it's never broken anything > here, and since it uses its own libraries and directory trees, it's > easy enough to remove. > Took your advice and built rsync. Couldn't find a binary for sol8, so downloaded the source and it built (only one warning !) and was running in about 15 minutes. It appears to copy the whole tree on the first run through identical src/dst trees, but nothing on a second run. Still thinking about the script though - puzzle. find $1 -newer $2 > files will pull out the differences, but still work to do building the args to cp. The systems here need very little sysadmin, so never really spend enough time to get up to speed on scripting. Have Kernighan and Pike, sed & awk and the man pages and that's about it, so a good book on scripting wouldn't be a bad idea... Chris -- ---------------------- Greenfield Designs Ltd Electronic and Embedded System Design Oxford, England (44) 1865 750 681

On 2007-04-05 23:15:23 +0100, ChrisQuayle <nospam@devnul.co.uk> said: > Took your advice and built rsync. Couldn't find a binary for sol8, so > downloaded the source and it built (only one warning !) and was running > in about 15 minutes. http://www.sunfreeware.com/programlistsparc8.html#rsync > It appears to copy the whole tree on the first run through identical > src/dst trees, but nothing on a second run. That's what it should do.

Tim Bradshaw wrote: > On 2007-04-05 23:15:23 +0100, ChrisQuayle <nospam@devnul.co.uk> said: > >> Took your advice and built rsync. Couldn't find a binary for sol8, so >> downloaded the source and it built (only one warning !) and was >> running in about 15 minutes. > > > http://www.sunfreeware.com/programlistsparc8.html#rsync > >> It appears to copy the whole tree on the first run through identical >> src/dst trees, but nothing on a second run. > > > That's what it should do. > There was a binary listed, but there were dependencies which looked like a hassle. Often download, then use pkgadd, but It takes so little time to do a build from source. It's easier to see what's going on and what gets put where from a Makefile. As for copy the whole tree, that's fine - some files didn't get copied. Msg was: chown failed, invalid arg 22, probably ro files, but will find out. Approx 13 gbytes rsync ran overnight at 648 K bytes per second from local drive to local A5100 on Disksuite. The speed hit is probably due to software raid, which seems to peak at around 1.5 Mbytes second flat out. Overall, good stuff & many thanks... Chris -- ---------------------- Greenfield Designs Ltd Electronic and Embedded System Design Oxford, England (44) 1865 750 681

Similiar Articles:

Exclude one file from copy folder - comp.unix.admin
Exclude one file from copy folder - comp.unix.admin single line command to remove a nonempty folder - comp.unix ... Script to Copy Files Conditionally - comp.sys.sun.admin ...

how to source a file in a script - comp.unix.programmer
... comp.lang.c++.moderated how to source a file in a script - comp.unix.programmer Break up a Large Source File - comp.lang.c++.moderated Script to Copy Files Conditionally ...

Simple shell Script to copy file from one location to another ...
Simple shell Script to copy file from one location to another ... Simple shell Script to copy file from one location to another ... > server. The simplest way is to use ...

How to copy a file and force overwirte in perl - comp.lang.perl ...
I have to write a perl script to copy and overwrite a file, I tried to use file::copy but it seems no options for force overwrite the destination file...

How to copy missing files only? - comp.unix.solaris
Bash Script: How Do I Copy The Missing Files, Directories Alone ... copy only missing files script to copy files from one server to another unix scp “copy from server ...

Problems with Using CutePDF Writer to copy the text in a script ...
[Changed the subject line to reflect the actual discussion topic.] For those of you new to this dicussion, here is a summary: - I cannot copy the co...

copy files from multiple directories - comp.soft-sys.matlab ...
Simple shell Script to copy file from one location to another ... copy files from multiple directories - comp.soft-sys.matlab ... Simple shell Script to copy file from one ...

Script to check files in adirectory older than X hours - comp.unix ...
hi guys , I need to develop a script to check for all files in a directory that are older ... than an hour - comp.unix ... DEL (erase a file or directory), COPY (copy files ...

Copying a file into another directory - comp.lang.java.programmer ...
Copy Layout to another File - comp.databases.filemaker Simple shell Script to copy file from one location to another ... Copying a file into another directory - comp.lang ...

copy a file while it is actively being written - comp.os.linux ...
Simple shell Script to copy file from one location to another ... copy a file while it is actively being written - comp.os.linux ..... copy a file while it is actively ...

Copy field info to another field automaticly - comp.databases ...
Groups posts, so any reply may be automatically ... Simple shell Script to copy file from one location to another ... > server. ... pdf").ToString ' SETUP A NEW COPY FIELD ...

multiple scp using xargs - comp.unix.shell
I have a lot of files I need to copy to another server using scp (secure copy). ... > You could use xargs to call a script or function that takes the destination ...

Quickest way to bulk copy many files from one disk cluster to ...
Copying files through a soft link - comp.unix.solaris Simple shell Script to copy file from one location to another ... Copying files ... Quickest way to bulk copy many ...

Copying one file to different destinations. - comp.unix.programmer ...
It doesn't copy one file to multiple destinations. I want to do something like this ... If I wanted to read the disk twice, I would make a bash-script. How can this be ...

Tar transfer and delete files - comp.unix.solaris
... once a given file is already placed in the remote host, the script must delete the source file. ... parts its creating you should then be able to use a simple script to copy ...

Script To Copy Files From One Location To Another
So do you want the script to just copy the *.txt files everytime it is run or do you want it to ask you for input and you tell it which files to copy every time it is run?

Script to Copy Files/Folders to All the User Profiles on the ...
Also keeping with the same theme of the script just copy an individual file with a replace if exists option. That could be a user input, or I can set it to Y or N in the ...

7/14/2012 3:46:15 AM