Blog

> Web Scraping

April 01, 2021

Overview

Project Information
Web Scraping

Progress

  • Learned web scraping with NodeJS (Axios, Cheerio, Puppeteer)

Project Links

Scratch Notes

  1. For static websites, use axios and cheerios. For dynamic websites, use puppeteer.
  2. npm - node package manager
  3. nodejs - used for non-blocking, event-driven servers, due to its single-threaded nature.
  4. axios - promise based HTTP client. Makes it easy to send asynchronous HTTP requests to REST endpoints and perform CRUD operations.
  5. cheerio - enables developers to find/specify, interpret, and analyze web pages using a JQuery-like syntax.
  6. puppeteer - control a headless browser.
Happy April's Fools Day! -- I got fooled by three different people today; it was a great day :))))