Build a Web Scraper in TypeScript
Build a web scraper from scratch in TypeScript. It's an SEO analytics tool that reports on the internal linking profile of any website. Also available in:
Also available in:
Author
Lane Wagner
Lane is a back-end engineer and the lead instructor of Boot.dev. He has taught over one million students worldwide, on Boot.dev, FreeCodeCamp, YouTube and the Backend Banter podcast. Lane worked as a backend engineer writing Go, Python and TypeScript, then moved into engineering management and a couple of years later left to build Boot.dev full-time.
Allan
Maintainer
Dan
Maintainer
Matt
Maintainer
Hunter
Maintainer
6 Hours
of content
14 Addicting
lessons
Earn a certificate
of completion
Learn online
at your pace
What will you learn?
Use TypeScript to build a web crawler that scrapes pages. It's a tool that any SEO expert would be happy to have. You'll make HTTP requests and parse HTML to generate reports that can easily marshaled to standard output or a file. If you're interested in getting a job using Node.js, this project will teach you how Node can be used to build a command-line application.
Chapter List
Join 907 students in the Build a Web Scraper in TypeScript course
Read reviews of their learning experiences
Great lesson, super clear.
han jiwoong
Jeju, KR 대한민국, 제주특별자치도
This lesson exceeded my expectations. I went in thinking I knew the basics, but the deeper dives into trade-offs and edge cases were exactly what I needed. The instructor didn’t just show ‘happy path’ solutions: they demonstrated how to think about failure modes, performance bottlenecks, and future extensibility. The capstone project, while optional, gave me the perfect sandbox to experiment and get feedback.
Brandon Jaus
Fort Worth, TX
The real-world context made the concepts click for me.
Prashant Dwivedi
Navi Mumbai
Appreciated the tips on common pitfalls and debugging.
Don Noska
Denton, Texas
Great lesson, super clear.
Connor Teague
Fort Worth, TX
Could use more exercises, but solid overall.
Thien Nguyen
Vietnam
Great lesson, super clear.
Sergey
Moscow, Russia
I appreciated how the instructor broke down the core concepts into digestible steps. The examples were practical and mirrored what I encounter in my day-to-day work. In particular, the section on error handling and observability tied everything together. If I had a minor nitpick, it would be that the pacing sped up in the last module, but the accompanying notes and code samples made it easy to revisit and cement the ideas.
Innocent Chukwuemeka
Nigeria
I appreciated how the instructor broke down the core concepts into digestible steps. The examples were practical and mirrored what I encounter in my day-to-day work. In particular, the section on error handling and observability tied everything together. If I had a minor nitpick, it would be that the pacing sped up in the last module, but the accompanying notes and code samples made it easy to revisit and cement the ideas.
Mike Unruh
Munich
Showing 1-9 of 10
Mediocrity doesn't cut it anymore
The only way to become a great developer is to write a lot of code
Avoid tutorial hell
by writing a ton of code
Stay motivated with
a game-like curriculum
Build portfolio projects
to prove your skills
Delve deeper
into foundational concepts
Learn flexibly online
without interrupting your life
For 1% the price of college
to minimize your financial risk
Frequently asked Questions
Got questions? We've got answers
Yes! It's free to create an account and start learning. You'll get all the immersive and interactive features for free for a few chapters. After that, if you still haven't paid for a membership, you'll be in read-only (content only) mode.
Platform
Languages
Subjects
Support
Pricing
Community
