Score:0

How do I use wget to download from this website?

jp flag

I am trying to download the dataset from this website https://motion-database.humanoids.kit.edu/list/motions/ but the website only allows me to download the folders one at a time by clicking on the download all files.

enter image description here

Below is my login ID and password that I try with wget but it still does not work.

wget --user kong --password helpmedownloadpls https://motion-database.humanoids.kit.edu/file_download_archive/motions/3127/
Score:2
cn flag
raj

--user and --password parameters to wget will not work here.

They are intended to use only with HTTP Basic authentication method which almost no website uses today.

This website (and hundreds of others) uses authentication based on cookies. When you fill in the login and password on the login form, a session cookie is generated and sent to your browser, and the browser sends this cookie in the subsequent requests as a proof that you are authenticated.

You have to write a script that first fills in the login form using wget with --post-data parameter to send the login and password and --save-cookies and --keep-session-cookies parameters to store the cookies you received upon successful login, and then downloads files using wget with --load-cookies parameter to use previously stored cookies.

mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.