Blog
> Web Scraping (NodeJS)
April 01, 2021
Overview
Project Information
Web Scraping
Progress
- Learned web scraping with NodeJS (Axios, Cheerio, Puppeteer)
Project Links
- Github - Code
Scratch Notes
- For static websites, use axios and cheerios. For dynamic websites, use puppeteer.
- npm - node package manager
- nodejs - used for non-blocking, event-driven servers, due to its single-threaded nature.
- axios - promise based HTTP client. Makes it easy to send asynchronous HTTP requests to REST endpoints and perform CRUD operations.
- cheerio - enables developers to find/specify, interpret, and analyze web pages using a JQuery-like syntax.
- puppeteer - control a headless browser.