This is a sub that aims at bringing data hoarders together to share their passion with like minded people.
Access to ATK...scrape all the recipes?
Question?
So I went for the America's Test Kitchen special of $! for 3 months access to their sites. Provides access to all their recipes. I want to see if I can get them all . They all seem to start with https://www.americastestkitchen.com/recipes/####-name-of-the-recipe . Im on linux, so what would be the easiest way to scrape them?
Archived post. New comments cannot be posted and votes cannot be cast.
Sort by:
Best
Open comment sort options
Best
Top
New
Controversial
Old
Q&A
the content to dl is html yes?
this sounds like a job for wget
*edit
thank you for setting me on the path of wget. Googling has provided me the ability to log in, to get past paywalls, mirroring the entire site, and output to specific directories. Still a few things to figure out, like getting videos, but well on the way.
Again, thank you.
Is there a directory structure you can see?
Off of the url, it seems to be everything after /recipes/
Any updates? Where you able to scrape all the recipes?