Home › Forums › Linux Support › Programming ›

wget question

Jul 28, 2009  By lmcdougall
 in

I will like to get a list of the files in the directory of an ftp site.
can I use wget to do it?

if yes, the how?

any other method that I can easily implement in bash script is welcome also.

Thanks

‹ Need some help with the sed command php script --> MSSQL error. Why? See details below ›

You could also do this using

Anonymous's picture
Submitted by Anonymous (not verified) on Tue, 11/10/2009 - 09:52.

You could also do this using perl's Net::FTP module:

#!/usr/bin/perl
use strict;
use warnings;
use Net::FTP;

#Change your.ftp-host.com to your ftp domain
my $ftp = Net::FTP->new("your.ftp-host.com", Debug => 0)
        or die "Can not connect: $@";
#Change UserName and PassWord to your login information
$ftp->login("UserName",'PassWord')
        or die "Can not log in: ", $ftp->message;
#If you want to list your root directory you can comment this out
#Or change public_html to where you want to get a file list
$ftp->cwd("public_html");

my @list = $ftp->ls($ftp->pwd);
my $listing = "list.txt";

open(LISTING, ">$listing");

foreach my $line (@list) {
        print LISTING $line . "\n";
}

close(LISTING)

Use "ftp"

Mitch Frazier's picture
Submitted by Mitch Frazier on Wed, 07/29/2009 - 13:47.

Use the ftp command. For example, to get the items in /pub/lj/listings from the LJ  ftp server: 

ftp ftp://ftp.linuxjournal.com <<EOF
dir /pub/lj/listings filelist.tmp
y
EOF
sed -e 's/.* //' <filelist.tmp >filelist.txt

This will put the names into filelist.txt. Note that the sed command will produce incorrect results if any of the file names contain blanks. In that case you'll have to use a different method of extracting the file names from the raw results file (filelist.tmp).

Mitch Frazier is an Associate Editor for Linux Journal.

Webcast
More Resources
How to Build an Optimal Hadoop Cluster to Store and Maintain Unlimited Amounts of Data Using Microservers

Realizing the promise of Apache® Hadoop® requires the effective deployment of compute, memory, storage and networking to achieve optimal results. With its flexibility and multitude of options, it is easy to over or under provision the server infrastructure, resulting in poor performance and high TCO. Join us for an in depth, technical discussion with industry experts from leading Hadoop and server companies who will provide insights into the key considerations for designing and deploying an optimal Hadoop cluster.

Learn More

Sponsored by AMD

White Paper
More Resources
Red Hat White Paper: Using an Open Source Framework to Catch the Bad Guy

Built-in forensics, incident response, and security with Red Hat Enterprise Linux 6

Every security policy provides guidance and requirements for ensuring adequate protection of information and data, as well as high-level technical and administrative security requirements for a system in a given environment. Traditionally, providing security for a system focuses on the confidentiality of the information on it. However, protecting the data integrity and system and data availability is just as important. For example, when processing United States intelligence information, there are three attributes that require protection: confidentiality, integrity, and availability.

Learn more about catching the bad guy in this free white paper.

Learn More

Sponsored by DLT Solutions