{"id":196,"date":"2016-01-12T15:34:27","date_gmt":"2016-01-12T15:34:27","guid":{"rendered":"http:\/\/wp-p3d2tsa2xh.pairsite.com\/?p=196"},"modified":"2025-05-21T14:47:33","modified_gmt":"2025-05-21T18:47:33","slug":"paircloud-downloading-files-with-curl","status":"publish","type":"ht_kb","link":"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/","title":{"rendered":"Downloading files with curl"},"content":{"rendered":"

Shared<\/p><\/a>

VPS<\/p><\/a>

Dedicated<\/p><\/a> 

WP Professional<\/p><\/a>

WP Professional Plus<\/p><\/a><\/span><\/p>\n

cURL is both a library and a command line utility written to handle the transfer of data using many different protocols. It is scriptable and extremely versatile but this makes it quite complicated.<\/p>\n

If you are looking for a utility to download a file then please see wget. We would recommend reading our wget tutorial first and checking out man wget<\/code> before using curl as wget is more user-friendly in most cases. However, for more complex operations you cannot beat cURL. It has over 100 different command line options many of which can be used in combinations. It is very powerful and can even handle cookies, forms and ssl. However it can also be used for some very simple tasks that you will find useful. In this tutorial we will concentrate on the things that cURL can do that wget can\u2019t.<\/p>\n

The Basics<\/h3>\n

At its most basic you can use cURL to download a file from a remote server. To download the homepage of example.com<\/code> you would use curl example.com<\/code>. cURL can use many different protocols but defaults to HTTP if none is provided. It will, however, try other protocols as well and it can intelligently guess which protocol to use if hints are given. For instance, if you use curl ftp.example.com<\/code> it will automatically try the FTP:\/\/ protocol.<\/p>\n

If however you want to help cURL to choose the right protocol then prefix the url with the protocol such as curl http:\/\/example.com<\/code> or curl ftp:\/\/example.com<\/code>.<\/p>\n

Setting the output file<\/h3>\n

If you want to give the downloaded file a different name you would use the -o option. For example.curl -o filename.tar.gz http:\/\/filename-4.0.1.tar.gz<\/code><\/p>\n

If you don\u2019t set the output file it will display it to the console.<\/p>\n

Viewing the complete request and response<\/h3>\n

Quite often when learning curl you will either get an unexpected output or no output at all. The -v<\/code> option is very useful in these situations. The -v<\/code> option displays all the information in the request sent to the remote server and the response it receives.<\/p>\n

Saving a 301-redirected file<\/h3>\n

If a site has WordPress\u00ae installed for example and they are using 301 redirects you will by default download the redirect response only. To ensure you follow the redirects and get the final file you will need to use the -L option. If you try curl google.com<\/code> you will just get the redirect page, if you now try curl -L google.com<\/code> you will get the page you were after.<\/p>\n

\n

Nothing returned<\/h4>\n

If you use curl and don\u2019t get any return or an error you can try the -v option. This will show all the headers. The header may have a 301 redirect code in it but no body to display. If this is the case you can use the -L option to follow the redirect.<\/p>\n<\/div>\n

Those are the basics of cURL. We will now move on to the intermediate levels of cURL usage.<\/p>\n

Viewing only the response headers for debugging<\/h3>\n

When you are writing a script using cURL sometimes you will want to view the response headers only without seeing the data or the request. Having a clean view of what is happening, without all the data to obscure things, can be helpful with debugging. To do this you would use the -I<\/code> option. For instance in the previous example with Google\u00ae we could use curl -I google.com<\/code><\/p>\n

Skipping SSL checks<\/h3>\n

When connecting to a remote server that has a self signed certificate you will want to skip the ssl checks. To do this use the -k<\/code> option. For example curl -k https:\/\/google.com<\/code><\/p>\n

Setting the user agent<\/h3>\n

The -A<\/code> option allows you to set the user agent. For example curl -A \"Mozilla\/5.0 (Windows NT 6.3; WOW64; rv:40.0) Gecko\/20100101 Firefox\/40.0\" -L google.com<\/code>.<\/p>\n

Rate Limiting<\/h3>\n

To avoid hitting the remote server hard you can limit the download rate you will use. The command to do this is --limit-rate<\/code> and use like this --limit-rate 100k<\/code>.<\/p>\n

FTP Login<\/h3>\n

To set the username and password you can use the \u2013user username:password option.<\/p>\n

FTP upload and download<\/h3>\n

To download you just need to use the basic curl command but add your username and password like this curl --user username:password -o filename.tar.gz ftp:\/\/domain.com\/directory\/filename.tar.gz <\/code>.<\/p>\n

To upload you need to use both the \u2013user option and the -T option as follows.
\ncurl --user username:password -T filename.tar.g ftp:\/\/domain.com\/directory\/ <\/code><\/p>\n

To delete a file from the remote server.
\ncurl --user username:password -X 'DELE filename.tar.gz' ftp:\/\/domain.com\/ <\/code><\/p>\n

For details on the -X<\/code> option please see the next section.<\/p>\n

Sending POST requests and different FTP Commands<\/h3>\n

The -X command allows you to send custom commands to the receiving server. For HTTP this could be a POST request or WebDAV\u2019s copy or move. For FTP you can use the -X<\/code> option to send other commands instead of the default file LIST, like in the previous section's example of using -X<\/code> to send the DELE command to an FTP server. However, this can also be used to send full POST data to an HTTP server.<\/p>\n

If the page you wanted to POST to had a form like this:<\/p>\n

<form action=\"test.php\" method=\"POST\">\n  <input name=\"Name\" type=\"text\" \/> \n  <input name=\"button1\" type=\"submit\" value=\"OK\" \/>\n<\/form><\/pre>\n
you could submit the form request using curl -X POST --data \"name=barrym&button1=OK\" http:\/\/www.example.com\/test.php<\/code>.<\/p>\n
Using Cookies<\/h3>\n
If the server you are connecting to requires a cookie then you can send it using curl -b cookiefile.txt http:\/\/example.com<\/code><\/p>\n
Sending custom headers<\/h3>\n
If you need to send a custom header to the server you would use the -H<\/code> option like this
\ncurl -H \"Accept: text\/html\" http:\/\/domain.com<\/code>. Which would set the content type to text\/html.<\/p>\n
Verifying an SSL Certificate<\/h3>\n
If you want to verify that your SSL cert is valid without using your browser and run into potential caching issues then use curl --cacert mycert.crt https:\/\/domain.com<\/code>. This is also useful if you need to validate the connection to ensure that you are connecting to the right server.<\/p>\n
The certificate must be in PEM format. If the optional password is not specified, it will be queried for on the terminal. Note that this option assumes a \u201ccertificate\u201d file that is the private key and the private certificate concatenated.<\/p>\n
Limiting the connection timeout time<\/h3>\n
Sometimes you will want the connection to time out quickly if it can\u2019t make the connection within a certain time frame. The option to use to do this is \u2013connect-timeout. This only affects the connection time so once you are connected it no longer applies. curl --connect-timeout 5 http:\/\/domain.com<\/code><\/p>\n
Finding out more<\/h3>\n
As stated in the introduction there are over 100 command line options for cURL so we have just covered some of the most commonly used ones in our experiences. cURL can do a lot more than described above and man curl<\/code> is a good place to start to find out more. If you prefer a web-based reference then http:\/\/curl.haxx.se\/docs\/faq.html<\/a> is the authoritative one.<\/p>\n","protected":false},"excerpt":{"rendered":"
  cURL is both a library and a command line utility written to handle the transfer of data using many different protocols. It is scriptable and extremely versatile but this makes it quite complicated. If you are looking for a utility to download a file then please see wget. We…<\/p>\n","protected":false},"author":12,"comment_status":"closed","ping_status":"open","template":"","format":"standard","meta":[],"ht-kb-category":[13],"ht-kb-tag":[],"yoast_head":"\ncURL Download | Downloading Files With cURL | cURL FTP<\/title>\n<meta name=\"description\" content=\"cURL is a library and a command line utility that transfers data using different protocols. Use the cURL command to download a file with username and password.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"cURL Download | Downloading Files With cURL | cURL FTP\" \/>\n<meta property=\"og:description\" content=\"cURL is a library and a command line utility that transfers data using different protocols. Use the cURL command to download a file with username and password.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/\" \/>\n<meta property=\"og:site_name\" content=\"Knowledge Base - Pair Networks\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/pairnetworks\/\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-21T18:47:33+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@pairNetworks\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/\",\"url\":\"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/\",\"name\":\"cURL Download | Downloading Files With cURL | cURL FTP\",\"isPartOf\":{\"@id\":\"https:\/\/www.pair.com\/support\/kb\/#website\"},\"datePublished\":\"2016-01-12T15:34:27+00:00\",\"dateModified\":\"2025-05-21T18:47:33+00:00\",\"description\":\"cURL is a library and a command line utility that transfers data using different protocols. Use the cURL command to download a file with username and password.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.pair.com\/support\/kb\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Downloading files with curl\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.pair.com\/support\/kb\/#website\",\"url\":\"https:\/\/www.pair.com\/support\/kb\/\",\"name\":\"Knowledge Base - Pair Networks\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.pair.com\/support\/kb\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.pair.com\/support\/kb\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.pair.com\/support\/kb\/#organization\",\"name\":\"Pair Networks\",\"url\":\"https:\/\/www.pair.com\/support\/kb\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.pair.com\/support\/kb\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.pair.com\/support\/kb\/wp-content\/uploads\/2022\/02\/Gb_TUkUE_400x400.jpeg\",\"contentUrl\":\"https:\/\/www.pair.com\/support\/kb\/wp-content\/uploads\/2022\/02\/Gb_TUkUE_400x400.jpeg\",\"width\":360,\"height\":360,\"caption\":\"Pair Networks\"},\"image\":{\"@id\":\"https:\/\/www.pair.com\/support\/kb\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/pairnetworks\/\",\"https:\/\/twitter.com\/pairNetworks\",\"https:\/\/www.instagram.com\/pairnetworks\/\",\"https:\/\/www.linkedin.com\/company\/2269676\/\",\"https:\/\/www.pinterest.com\/pairnetworksinc\/pins\/\",\"https:\/\/www.youtube.com\/user\/pairnetworks\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"cURL Download | Downloading Files With cURL | cURL FTP","description":"cURL is a library and a command line utility that transfers data using different protocols. Use the cURL command to download a file with username and password.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/","og_locale":"en_US","og_type":"article","og_title":"cURL Download | Downloading Files With cURL | cURL FTP","og_description":"cURL is a library and a command line utility that transfers data using different protocols. Use the cURL command to download a file with username and password.","og_url":"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/","og_site_name":"Knowledge Base - Pair Networks","article_publisher":"https:\/\/www.facebook.com\/pairnetworks\/","article_modified_time":"2025-05-21T18:47:33+00:00","twitter_card":"summary_large_image","twitter_site":"@pairNetworks","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/","url":"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/","name":"cURL Download | Downloading Files With cURL | cURL FTP","isPartOf":{"@id":"https:\/\/www.pair.com\/support\/kb\/#website"},"datePublished":"2016-01-12T15:34:27+00:00","dateModified":"2025-05-21T18:47:33+00:00","description":"cURL is a library and a command line utility that transfers data using different protocols. Use the cURL command to download a file with username and password.","breadcrumb":{"@id":"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.pair.com\/support\/kb\/paircloud-downloading-files-with-curl\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.pair.com\/support\/kb\/"},{"@type":"ListItem","position":2,"name":"Downloading files with curl"}]},{"@type":"WebSite","@id":"https:\/\/www.pair.com\/support\/kb\/#website","url":"https:\/\/www.pair.com\/support\/kb\/","name":"Knowledge Base - Pair Networks","description":"","publisher":{"@id":"https:\/\/www.pair.com\/support\/kb\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.pair.com\/support\/kb\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.pair.com\/support\/kb\/#organization","name":"Pair Networks","url":"https:\/\/www.pair.com\/support\/kb\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.pair.com\/support\/kb\/#\/schema\/logo\/image\/","url":"https:\/\/www.pair.com\/support\/kb\/wp-content\/uploads\/2022\/02\/Gb_TUkUE_400x400.jpeg","contentUrl":"https:\/\/www.pair.com\/support\/kb\/wp-content\/uploads\/2022\/02\/Gb_TUkUE_400x400.jpeg","width":360,"height":360,"caption":"Pair Networks"},"image":{"@id":"https:\/\/www.pair.com\/support\/kb\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/pairnetworks\/","https:\/\/twitter.com\/pairNetworks","https:\/\/www.instagram.com\/pairnetworks\/","https:\/\/www.linkedin.com\/company\/2269676\/","https:\/\/www.pinterest.com\/pairnetworksinc\/pins\/","https:\/\/www.youtube.com\/user\/pairnetworks"]}]}},"_links":{"self":[{"href":"https:\/\/www.pair.com\/support\/kb\/wp-json\/wp\/v2\/ht-kb\/196"}],"collection":[{"href":"https:\/\/www.pair.com\/support\/kb\/wp-json\/wp\/v2\/ht-kb"}],"about":[{"href":"https:\/\/www.pair.com\/support\/kb\/wp-json\/wp\/v2\/types\/ht_kb"}],"author":[{"embeddable":true,"href":"https:\/\/www.pair.com\/support\/kb\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.pair.com\/support\/kb\/wp-json\/wp\/v2\/comments?post=196"}],"version-history":[{"count":5,"href":"https:\/\/www.pair.com\/support\/kb\/wp-json\/wp\/v2\/ht-kb\/196\/revisions"}],"predecessor-version":[{"id":9802,"href":"https:\/\/www.pair.com\/support\/kb\/wp-json\/wp\/v2\/ht-kb\/196\/revisions\/9802"}],"wp:attachment":[{"href":"https:\/\/www.pair.com\/support\/kb\/wp-json\/wp\/v2\/media?parent=196"}],"wp:term":[{"taxonomy":"ht_kb_category","embeddable":true,"href":"https:\/\/www.pair.com\/support\/kb\/wp-json\/wp\/v2\/ht-kb-category?post=196"},{"taxonomy":"ht_kb_tag","embeddable":true,"href":"https:\/\/www.pair.com\/support\/kb\/wp-json\/wp\/v2\/ht-kb-tag?post=196"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}