2 Star 0 Fork 0

mirrors_taoqf/node-html-parser

加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
克隆/下载
贡献代码
同步代码
取消
提示: 由于 Git 不支持空文件夾,创建文件夹后会生成空的 .keep 文件
Loading...
README
MIT

Fast HTML Parser NPM version Build Status

Fast HTML Parser is a very fast HTML parser. Which will generate a simplified DOM tree, with element query support.

Per the design, it intends to parse massive HTML files in lowest price, thus the performance is the top priority. For this reason, some malformatted HTML may not be able to parse correctly, but most usual errors are covered (eg. HTML4 style no closing <td> etc).

Install

npm install --save node-html-parser

Note: when using Fast HTML Parser in a Typescript project the minimum Typescript version supported is ^4.1.2.

Performance

-- 2022-08-10

html-parser     :24.1595 ms/file ± 18.7667
htmljs-parser   :4.72064 ms/file ± 5.67689
html-dom-parser :2.18055 ms/file ± 2.96136
html5parser     :1.69639 ms/file ± 2.17111
cheerio         :12.2122 ms/file ± 8.10916
parse5          :6.50626 ms/file ± 4.02352
htmlparser2     :2.38179 ms/file ± 3.42389
htmlparser      :17.4820 ms/file ± 128.041
high5           :3.95188 ms/file ± 2.52313
node-html-parser:2.04288 ms/file ± 1.25203
node-html-parser (last release):2.00527 ms/file ± 1.21317

Tested with htmlparser-benchmark.

Usage

import { parse } from 'node-html-parser';

const root = parse('<ul id="list"><li>Hello World</li></ul>');

console.log(root.firstChild.structure);
// ul#list
//   li
//     #text

console.log(root.querySelector('#list'));
// { tagName: 'ul',
//   rawAttrs: 'id="list"',
//   childNodes:
//    [ { tagName: 'li',
//        rawAttrs: '',
//        childNodes: [Object],
//        classNames: [] } ],
//   id: 'list',
//   classNames: [] }
console.log(root.toString());
// <ul id="list"><li>Hello World</li></ul>
root.set_content('<li>Hello World</li>');
root.toString();	// <li>Hello World</li>
var HTMLParser = require('node-html-parser');

var root = HTMLParser.parse('<ul id="list"><li>Hello World</li></ul>');

Global Methods

parse(data[, options])

Parse the data provided, and return the root of the generated DOM.

  • data, data to parse

  • options, parse options

    {
      lowerCaseTagName: false,		// convert tag name to lower case (hurts performance heavily)
      comment: false,           		// retrieve comments (hurts performance slightly)
      fixNestedATags: false,    		// fix invalid nested <a> HTML tags 
      parseNoneClosedTags: false, 	// close none closed HTML tags instead of removing them 
      voidTag: {
        tags: ['area', 'base', 'br', 'col', 'embed', 'hr', 'img', 'input', 'link', 'meta', 'param', 'source', 'track', 'wbr'],	// optional and case insensitive, default value is ['area', 'base', 'br', 'col', 'embed', 'hr', 'img', 'input', 'link', 'meta', 'param', 'source', 'track', 'wbr']
        closingSlash: true	// optional, default false. void tag serialisation, add a final slash <br/>
      },
      blockTextElements: {
        script: true,		// keep text content when parsing
        noscript: true,		// keep text content when parsing
        style: true,		// keep text content when parsing
        pre: true			// keep text content when parsing
      }
    }
    

valid(data[, options])

Parse the data provided, return true if the given data is valid, and return false if not.

Class

classDiagram direction TB class HTMLElement{ this trimRight() this removeWhitespace() Node[] querySelectorAll(string selector) Node querySelector(string selector) HTMLElement[] getElementsByTagName(string tagName) Node closest(string selector) Node appendChild(Node node) this insertAdjacentHTML('beforebegin' | 'afterbegin' | 'beforeend' | 'afterend' where, string html) this setAttribute(string key, string value) this setAttributes(Record string, string attrs) this removeAttribute(string key) string getAttribute(string key) this exchangeChild(Node oldNode, Node newNode) this removeChild(Node node) string toString() this set_content(string content) this set_content(Node content) this set_content(Node[] content) this remove() this replaceWith((string | Node)[] ...nodes) ClassList classList HTMLElement clone() HTMLElement getElementById(string id) string text string rawText string tagName string structuredText string structure Node firstChild Node lastChild Node nextSibling HTMLElement nextElementSibling Node previousSibling HTMLElement previousElementSibling string innerHTML string outerHTML string textContent Record<string, string> attributes [number, number] range } class Node{ <> string toString() Node clone() this remove() number nodeType string innerText string textContent } class ClassList{ add(string c) replace(string c1, string c2) remove(string c) toggle(string c) boolean contains(string c) number length string[] value string toString() } class CommentNode{ CommentNode clone() string toString() } class TextNode{ TextNode clone() string toString() string rawText string trimmedRawText string trimmedText string text boolean isWhitespace } Node --|> HTMLElement Node --|> CommentNode Node --|> TextNode Node ..> ClassList

HTMLElement Methods

trimRight()

Trim element from right (in block) after seeing pattern in a TextNode.

removeWhitespace()

Remove whitespaces in this sub tree.

querySelectorAll(selector)

Query CSS selector to find matching nodes.

Note: Full range of CSS3 selectors supported since v3.0.0.

querySelector(selector)

Query CSS Selector to find matching node. null if not found.

getElementsByTagName(tagName)

Get all elements with the specified tagName.

Note: Use * for all elements.

closest(selector)

Query closest element by css selector. null if not found.

before(...nodesOrStrings)

Insert one or multiple nodes or text before the current element. Does not work on root.

after(...nodesOrStrings)

Insert one or multiple nodes or text after the current element. Does not work on root.

prepend(...nodesOrStrings)

Insert one or multiple nodes or text to the first position of an element's child nodes.

append(...nodesOrStrings)

Insert one or multiple nodes or text to the last position of an element's child nodes. This is similar to appendChild, but accepts arbitrarily many nodes and converts strings to text nodes.

appendChild(node)

Append a node to an element's child nodes.

insertAdjacentHTML(where, html)

Parses the specified text as HTML and inserts the resulting nodes into the DOM tree at a specified position.

setAttribute(key: string, value: string)

Set value to key attribute.

setAttributes(attrs: Record<string, string>)

Set attributes of the element.

removeAttribute(key: string)

Remove key attribute.

getAttribute(key: string)

Get key attribute. undefined if not set.

exchangeChild(oldNode: Node, newNode: Node)

Exchanges given child with new child.

removeChild(node: Node)

Remove child node.

toString()

Same as outerHTML

set_content(content: string | Node | Node[])

Set content. Notice: Do not set content of the root node.

remove()

Remove current element.

replaceWith(...nodes: (string | Node)[])

Replace current element with other node(s).

classList

classList.add

Add class name.

classList.replace(old: string, new: string)

Replace class name with another one.

classList.remove()

Remove class name.

classList.toggle(className: string):void

Toggle class. Remove it if it is already included, otherwise add.

classList.contains(className: string): boolean

Returns true if the classname is already in the classList.

classList.value

Get class names.

clone()

Clone a node.

getElementById(id: string): HTMLElement | null

Get element by it's ID.

HTMLElement Properties

text

Get unescaped text value of current node and its children. Like innerText. (slow for the first time)

rawText

Get escaped (as-is) text value of current node and its children. May have &amp; in it. (fast)

tagName

Get or Set tag name of HTMLElement. Note that the returned value is an uppercase string.

structuredText

Get structured Text.

structure

Get DOM structure.

childNodes

Get all child nodes. A child node can be a TextNode, a CommentNode and a HTMLElement.

children

Get all child elements, so all child nodes of type HTMLELement.

firstChild

Get first child node. undefined if the node has no children.

lastChild

Get last child node. undefined if the node has no children.

firstElementChild

Get the first child of type HTMLElement. undefined if none exists.

lastElementChild

Get the first child of type HTMLElement. undefined if none exists.

childElementCount

Get the number of children that are of type HTMLElement.

innerHTML

Set or Get innerHTML.

outerHTML

Get outerHTML.

nextSibling

Returns a reference to the next child node of the current element's parent. null if not found.

nextElementSibling

Returns a reference to the next child element of the current element's parent. null if not found.

previousSibling

Returns a reference to the previous child node of the current element's parent. null if not found.

previousElementSibling

Returns a reference to the previous child element of the current element's parent. null if not found.

textContent

Get or Set textContent of current element, more efficient than set_content.

attributes

Get all attributes of current element. Notice: do not try to change the returned value.

range

Corresponding source code start and end indexes (ie [ 0, 40 ])

Copyright 2019 Tao Qiufeng Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

简介

暂无描述 展开 收起
HTML 等 3 种语言
MIT
取消

发行版

暂无发行版

贡献者

全部

近期动态

不能加载更多了
马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化
1
https://gitee.com/mirrors_taoqf/node-html-parser.git
git@gitee.com:mirrors_taoqf/node-html-parser.git
mirrors_taoqf
node-html-parser
node-html-parser
main

搜索帮助