`` and ```` that do not provide indentation in their standard - definition. This strategy is the default in ``inscript`` and many other - tools such as Lynx. If you do not want extended indentation you can use the - parameter ``indentation='standard'`` instead. +It allows modifying the interpretation of HTML-tags and setting parameters that control the rendering of anchors, +captions, images and links. -2. **Overwriting the default CSS definition:** inscriptis uses CSS definitions - that are maintained in ``inscriptis.css.CSS`` for rendering HTML tags. You can - override these definitions (and therefore change the rendering) as outlined - below: +1. **Firefox-like whitespace handling:** Use the more standard-conform `strict` CSS_PROFILE to render the page. + (``

`` and ```` do not add whitespaces in the `strict` profile. Many text-based browsers such + as Lynx and ``inscript``, add whitespaces per default to reduce the likelihood of words getting glued together). -.. code-block:: python + .. code-block:: python + + from lxml.html import fromstring + + from inscriptis import Inscriptis + from inscriptis.css_profiles import CSS_PROFILES + from inscriptis.model.config import ParserConfig + + # create a ParserConfig that uses the strict CSS rendering profile + css = CSS_PROFILES['strict'] + config = ParserConfig(css=css) + + html_tree = fromstring(html) + parser = Inscriptis(html_tree, config) + text = parser.get_text() + +2. **Firefox-like whitespace handling and fine-tuning of link handling:** Use the strict profile + together with inline links and anchor URLs. + + .. code-block:: python + + from lxml.html import fromstring + + from inscriptis import Inscriptis + from inscriptis.css_profiles import CSS_PROFILES + from inscriptis.model.config import ParserConfig + + # uses the strict CSS rendering profile and fine-tune link handling. + css = CSS_PROFILES['strict'] + config = ParserConfig(css=css, display_links=True, + display_anchors=True) + + html_tree = fromstring(html) + parser = Inscriptis(html_tree, config) + text = parser.get_text() + + +3. **Overwriting the default CSS definition:** inscriptis uses CSS definitions + that are maintained in ``inscriptis.css_profiles_CSS_PROFILES`` for + rendering HTML tags. You can override these definitions (and therefore + change the rendering) as outlined below: + + .. code-block:: python + + from lxml.html import fromstring + + from inscriptis import Inscriptis + from inscriptis.css_profiles import CSS_PROFILES + from inscriptis.html_properties import Display + from inscriptis.model.config import ParserConfig + from inscriptis.model.html_element import HtmlElement + + # Create a custom CSS based on the default style sheet and change the + # rendering of `div` and `span` elements. + css = CSS_PROFILES['strict'].copy() + css['div'] = HtmlElement(display=Display.block, padding=2) + css['span'] = HtmlElement(prefix=' ', suffix=' ') + + html_tree = fromstring(html) + # create a parser using a custom css + config = ParserConfig(css=css) + parser = Inscriptis(html_tree, config) + text = parser.get_text() + +4. **Ignore elements during parsing:** + Overwriting the default CSS profile also allows changing the rendering of selected elements. + The snippet below, for example, removes forms from the parsed text by setting the definition of the ``form`` tag to ``Display.none``. + + .. code-block:: python + + from inscriptis import get_text + from inscriptis.css_profiles import CSS_PROFILES, HtmlElement + from inscriptis.html_properties import Display + from inscriptis.model.config import ParserConfig + + # create a custom CSS based on the default style sheet and change the + # rendering of `div` and `span` elements + css = CSS_PROFILES['strict'].copy() + css['form'] = HtmlElement(display=Display.none) + + # create a parser configuration using a custom css + html = """First line. + """ + config = ParserConfig(css=css) + text = get_text(html, config) + print(text) - from lxml.html import fromstring - from inscriptis.css_profiles import CSS_PROFILES, HtmlElement - from inscriptis.html_properties import Display - from inscriptis.model.config import ParserConfig - - # create a custom CSS based on the default style sheet and change the - # rendering of `div` and `span` elements - css = CSS_PROFILES['strict'].copy() - css['div'] = HtmlElement(display=Display.block, padding=2) - css['span'] = HtmlElement(prefix=' ', suffix=' ') - - html_tree = fromstring(html) - # create a parser using a custom css - config = ParserConfig(css=css) - parser = Inscriptis(html_tree, config) - text = parser.get_text() Custom HTML tag handling @@ -570,55 +637,6 @@ The following code mitigates this problem on Unix systems by manually forcing lx return libc.malloc_trim(0) -Examples -======== - -Strict indentation handling ---------------------------- - -The following example demonstrates modifying ``ParserConfig`` for strict indentation handling. - -.. code-block:: python - - from inscriptis import get_text - from inscriptis.css_profiles import CSS_PROFILES - from inscriptis.model.config import ParserConfig - - config = ParserConfig(css=CSS_PROFILES['strict'].copy()) - text = get_text('first', config) - print(text) - -Ignore elements during parsing ------------------------------- - -Overwriting the default CSS profile also allows changing the rendering of selected elements. -The snippet below, for example, removes forms from the parsed text by setting the definition of the ``form`` tag to ``Display.none``. - -.. code-block:: python - - from inscriptis import get_text - from inscriptis.css_profiles import CSS_PROFILES, HtmlElement - from inscriptis.html_properties import Display - from inscriptis.model.config import ParserConfig - - # create a custom CSS based on the default style sheet and change the - # rendering of `div` and `span` elements - css = CSS_PROFILES['strict'].copy() - css['form'] = HtmlElement(display=Display.none) - - # create a parser configuration using a custom css - html = """First line. - """ - config = ParserConfig(css=css) - text = get_text(html, config) - print(text) - Citation ======== diff --git a/docs/index.rst b/docs/index.rst index 917b12a..b2f88de 100644 --- a/docs/index.rst +++ b/docs/index.rst @@ -16,7 +16,7 @@ Contents: Documentation benchmarking contributing - inscriptis-module-documentation + api diff --git a/docs/inscriptis-module-documentation.rst b/docs/inscriptis-module-documentation.rst deleted file mode 100644 index b25cb8f..0000000 --- a/docs/inscriptis-module-documentation.rst +++ /dev/null @@ -1,58 +0,0 @@ -=============================== -Inscriptis module documentation -=============================== - -.. automodule:: inscriptis - :members: - -Inscriptis model -================ - -Inscriptis HTML engine ----------------------- -.. automodule:: inscriptis.html_engine - :members: - -Inscriptis HTML properties --------------------------- -.. automodule:: inscriptis.html_properties - :members: - -Inscriptis CSS model --------------------- -.. automodule:: inscriptis.model.css - :members: - -Inscriptis canvas model ------------------------ -.. automodule:: inscriptis.model.canvas - :members: - -.. automodule:: inscriptis.model.canvas.block - :members: - -.. automodule:: inscriptis.model.canvas.prefix - :members: - - - -Inscriptis table model ----------------------- -.. automodule:: inscriptis.model.table - :members: - - -.. _annotations: - -Inscriptis annotations -====================== - -.. automodule:: inscriptis.annotation - :members: - - -Annotation processors ---------------------- - -.. automodule:: inscriptis.annotation.output - :members: diff --git a/pyproject.toml b/pyproject.toml index f60795f..650ec43 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -49,6 +49,7 @@ uvicorn = { version = "^0.34.0", optional = true } [tool.poetry.group.dev.dependencies] pytest = "^8.3.5" +myst_parser = "^4.0.1" [build-system] diff --git a/src/inscriptis/__init__.py b/src/inscriptis/__init__.py index 4e52312..b5dcda9 100644 --- a/src/inscriptis/__init__.py +++ b/src/inscriptis/__init__.py @@ -7,7 +7,7 @@ - annotations The following example provides the text representation of -``_. +``_ using the method :meth:`inscriptis.get_text`. .. code:: @@ -21,7 +21,7 @@ print(text) -Use the method :meth:`~inscriptis.get_annotated_text` to obtain text and +Use the method :meth:`inscriptis.get_annotated_text` to obtain text and annotations. The method requires annotation rules as described in annotations_. .. code:: @@ -116,7 +116,7 @@ def get_annotated_text( Notes: - the text is stored under the key 'text'. - annotations are provided under the key 'label' which contains a - list of :class:`Annotation`s. + list of Annotations. Examples: {"text": "EU rejects German call to boycott British lamb.", " diff --git a/src/inscriptis/annotation/output/surface.py b/src/inscriptis/annotation/output/surface.py index e4e5252..c80a078 100644 --- a/src/inscriptis/annotation/output/surface.py +++ b/src/inscriptis/annotation/output/surface.py @@ -1,4 +1,5 @@ """Surface Form Annotation Processor.""" + from typing import Dict, Any from inscriptis.annotation.output import AnnotationProcessor diff --git a/src/inscriptis/annotation/parser.py b/src/inscriptis/annotation/parser.py index a246aee..471b8ba 100644 --- a/src/inscriptis/annotation/parser.py +++ b/src/inscriptis/annotation/parser.py @@ -16,6 +16,7 @@ "#class=short-description]": ["description"] } """ + from collections import defaultdict from copy import copy from typing import Dict, Tuple, List diff --git a/src/inscriptis/css_profiles.py b/src/inscriptis/css_profiles.py index 6f680e8..8177ae6 100644 --- a/src/inscriptis/css_profiles.py +++ b/src/inscriptis/css_profiles.py @@ -1,16 +1,16 @@ #!/usr/bin/env python3 # coding: utf-8 -"""Standard CSS profiles shipped with inscriptis. +"""Standard CSS profiles shipped with Inscriptis. -- `strict`: this profile corresponds to the defaults used by Firefox -- `relaxed`: this profile is more suited for text analytics, since it ensures - that whitespaces are inserted between span and div elements - preventing cases where two words stick together. + CSS profiles are used together with + :class:`inscriptis.model.config.ParserConfig` to customize + the HTML to text conversion. """ from inscriptis.html_properties import Display, WhiteSpace from inscriptis.model.html_element import HtmlElement +#: A CSS profile that corresponds to the defaults used by the Firefox Browser STRICT_CSS_PROFILE = { "body": HtmlElement(display=Display.inline, whitespace=WhiteSpace.normal), "head": HtmlElement(display=Display.none), @@ -54,6 +54,7 @@ "plaintext": HtmlElement(display=Display.block, whitespace=WhiteSpace.pre), } +#: A relaxed CSS profile optimized for content extraction and text analytics. RELAXED_CSS_PROFILE = STRICT_CSS_PROFILE.copy() RELAXED_CSS_PROFILE["div"] = HtmlElement(display=Display.block, padding_inline=2) RELAXED_CSS_PROFILE["span"] = HtmlElement( diff --git a/src/inscriptis/model/canvas/block.py b/src/inscriptis/model/canvas/block.py index 5013233..1e2db8a 100644 --- a/src/inscriptis/model/canvas/block.py +++ b/src/inscriptis/model/canvas/block.py @@ -1,4 +1,5 @@ """Representation of a text block within the HTML canvas.""" + from __future__ import annotations from html import unescape diff --git a/src/inscriptis/model/config.py b/src/inscriptis/model/config.py index fe06897..d13f68f 100644 --- a/src/inscriptis/model/config.py +++ b/src/inscriptis/model/config.py @@ -1,5 +1,7 @@ #!/usr/bin/env python -"""Provide configuration objects for the Inscriptis HTML to text converter.""" +"""This modul provides the ParserConfig class which allows customizing + how Inscriptis converts HTML to text. +""" from __future__ import annotations from copy import deepcopy @@ -15,7 +17,45 @@ class ParserConfig: - """Encapsulate configuration options and CSS definitions.""" + """The ParserConfig class encapsulate + + - CSS definitions (from :mod:`inscriptis.css_profiles` or custom + definitions). + - configuration options for handling images, captions, links, etc. + - annotation rules, if Inscripitis is used for annotating text. + - custom html tag handlers. + + Attributes: + css: An optional custom CSS definition. + display_images: Whether to include image tiles/alt texts. + deduplicate_captions: Whether to deduplicate captions such as image + titles (many newspaper include images and video previews with + identical titles). + display_links: Whether to display link targets + (e.g. `[Python](https://www.python.org)`). + display_anchors: Whether to display anchors (e.g. `[here](#here)`). + annotation_rules: An optional dictionary of annotation rules which + specify tags and attributes to annotation. + table_cell_separator: Separator to use between table cells. + custom_html_tag_handler_mapping: An optional CustomHtmlTagHandler. + + + The following example demonstrates how ParserConfig is used to + + - enable the strict CSS profile and + - prevent links from being shown. + + .. code-block:: Python + + from inscriptis import get_text + from inscriptis.css_profiles import CSS_PROFILES + from inscriptis.model.config import ParserConfig + + css_profile = CSS_PROFILES['strict'].copy() + config = ParserConfig(css=css_profile, display_links=False) + text = get_text('first link', config) + print(text) + """ def __init__( self, @@ -65,7 +105,7 @@ def __init__( def parse_a(self) -> bool: """Indicate whether the text output should contain links or anchors. - Returns + Returns: Whether we need to parse tags. """ return self.display_links or self.display_anchors diff --git a/src/inscriptis/model/css.py b/src/inscriptis/model/css.py index f52c41b..779a20b 100644 --- a/src/inscriptis/model/css.py +++ b/src/inscriptis/model/css.py @@ -5,6 +5,7 @@ - :class:`CssParse` parses CSS specifications and translates them into the corresponding HtmlElements used by Inscriptis for rendering HTML pages. """ + from contextlib import suppress from re import compile as re_compile diff --git a/src/inscriptis/model/html_element.py b/src/inscriptis/model/html_element.py index 5c72bbc..4682e04 100644 --- a/src/inscriptis/model/html_element.py +++ b/src/inscriptis/model/html_element.py @@ -1,4 +1,12 @@ -"""Data structures for handling HTML Elements.""" +""" +The HtmlElement class controls how Inscriptis interprets HTML Elements. + +- The module :mod:`inscriptis.css_profiles` contain CSS profiles which assign + to each standard HTML tag the corresponding :class:`HtmlElement`. +- As for standard GUI browsers, CSS definitions within the parsed HTML modify + the :class:`HtmlElement` and its interpretation. +""" + from typing import Tuple from inscriptis.html_properties import ( @@ -13,23 +21,23 @@ class HtmlElement: """The HtmlElement class stores properties and metadata of HTML elements. Attributes: - - canvas: the canvas to which the HtmlElement writes its content. - - tag: tag name of the given HtmlElement. - - prefix: specifies a prefix that to insert before the tag's content. - - suffix: a suffix to append after the tag's content. - - display: :class:`~inscriptis.html_properties.Display` strategy used for - the content. - - margin_before: vertical margin before the tag's content. - - margin_after: vertical margin after the tag's content. - - padding_inline: horizontal padding_inline before the tag's content. - - whitespace: the :class:`~inscriptis.html_properties.Whitespace` handling - strategy. - - limit_whitespace_affixes: limit printing of whitespace affixes to - elements with `normal` whitespace handling. - - align: the element's horizontal alignment. - - valign: the element's vertical alignment. - - previous_margin_after: the margin after of the previous HtmlElement. - - annotation: annotations associated with the HtmlElement. + canvas: the canvas to which the HtmlElement writes its content. + tag: tag name of the given HtmlElement. + prefix: specifies a prefix that to insert before the tag's content. + suffix: a suffix to append after the tag's content. + display: :class:`~inscriptis.html_properties.Display` strategy used for + the content. + margin_before: vertical margin before the tag's content. + margin_after: vertical margin after the tag's content. + padding_inline: horizontal padding_inline before the tag's content. + whitespace: the :class:`~inscriptis.html_properties.Whitespace` handling + strategy. + limit_whitespace_affixes: limit printing of whitespace affixes to + elements with `normal` whitespace handling. + align: the element's horizontal alignment. + valign: the element's vertical alignment. + previous_margin_after: the margin after of the previous HtmlElement. + annotation: annotations associated with the HtmlElement. """ __slots__ = ( diff --git a/src/inscriptis/model/tag/__init__.py b/src/inscriptis/model/tag/__init__.py index e877f80..e02d3ae 100644 --- a/src/inscriptis/model/tag/__init__.py +++ b/src/inscriptis/model/tag/__init__.py @@ -1,4 +1,5 @@ """HTML Tag handlers and classes for designing custom HTML tag handlers.""" + from __future__ import annotations from typing import Dict, Callable, NamedTuple diff --git a/src/inscriptis/model/tag/a_tag.py b/src/inscriptis/model/tag/a_tag.py index f435377..4f3e631 100644 --- a/src/inscriptis/model/tag/a_tag.py +++ b/src/inscriptis/model/tag/a_tag.py @@ -1,4 +1,5 @@ """Handle the tag.""" + from typing import Dict from inscriptis.model.html_document_state import HtmlDocumentState diff --git a/src/inscriptis/model/tag/br_tag.py b/src/inscriptis/model/tag/br_tag.py index 6a354d1..b10bdd2 100644 --- a/src/inscriptis/model/tag/br_tag.py +++ b/src/inscriptis/model/tag/br_tag.py @@ -1,4 +1,5 @@ """Handle the
tag.""" + from typing import Dict from inscriptis.model.html_document_state import HtmlDocumentState diff --git a/src/inscriptis/model/tag/img_tag.py b/src/inscriptis/model/tag/img_tag.py index 51848af..01649ba 100644 --- a/src/inscriptis/model/tag/img_tag.py +++ b/src/inscriptis/model/tag/img_tag.py @@ -1,4 +1,5 @@ """Handle the tag.""" + from typing import Dict from inscriptis.model.html_document_state import HtmlDocumentState diff --git a/src/inscriptis/model/tag/list_tag.py b/src/inscriptis/model/tag/list_tag.py index 08fc553..04e6731 100644 --- a/src/inscriptis/model/tag/list_tag.py +++ b/src/inscriptis/model/tag/list_tag.py @@ -1,4 +1,5 @@ """Handle the

tags.""" + from typing import Dict from inscriptis.annotation import Annotation From a54b1f836a22e8873a695f17dffa3cb8205047b4 Mon Sep 17 00:00:00 2001 From: Albert Weichselbraun Date: Tue, 5 Aug 2025 11:12:27 +0200 Subject: [PATCH 02/25] fix: migration to uv. --- pyproject.toml | 2 -- 1 file changed, 2 deletions(-) diff --git a/pyproject.toml b/pyproject.toml index c65997c..0553f32 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -60,8 +60,6 @@ dev = [ "pytest-cov>=6.1.1", "safety>=3.5.1", ] ->>>>>>> feature/python3.14 - [build-system] requires = ["hatchling"] build-backend = "hatchling.build" From 2020bdca342397a6edfd75f83844c95a098183a0 Mon Sep 17 00:00:00 2001 From: Albert Weichselbraun Date: Tue, 5 Aug 2025 11:14:12 +0200 Subject: [PATCH 03/25] add: ruff formatter. --- src/inscriptis/css_profiles.py | 6 +++--- src/inscriptis/model/config.py | 3 ++- 2 files changed, 5 insertions(+), 4 deletions(-) diff --git a/src/inscriptis/css_profiles.py b/src/inscriptis/css_profiles.py index 3337834..c03aca3 100644 --- a/src/inscriptis/css_profiles.py +++ b/src/inscriptis/css_profiles.py @@ -1,9 +1,9 @@ #!/usr/bin/env python3 """Standard CSS profiles shipped with inscriptis. - CSS profiles are used together with - :class:`inscriptis.model.config.ParserConfig` to customize - the HTML to text conversion. +CSS profiles are used together with +:class:`inscriptis.model.config.ParserConfig` to customize +the HTML to text conversion. """ from inscriptis.html_properties import Display, WhiteSpace diff --git a/src/inscriptis/model/config.py b/src/inscriptis/model/config.py index 28f3d78..c8a67dd 100644 --- a/src/inscriptis/model/config.py +++ b/src/inscriptis/model/config.py @@ -1,7 +1,8 @@ #!/usr/bin/env python """This modul provides the ParserConfig class which allows customizing - how Inscriptis converts HTML to text. +how Inscriptis converts HTML to text. """ + from __future__ import annotations from copy import deepcopy From 8f8b04e3440f257a12cc74a6b04ec11837b2c63b Mon Sep 17 00:00:00 2001 From: Albert Weichselbraun Date: Tue, 5 Aug 2025 11:14:37 +0200 Subject: [PATCH 04/25] chg: set required python version. --- pyproject.toml | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/pyproject.toml b/pyproject.toml index 0553f32..ef8e306 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -4,7 +4,7 @@ version = "2.6.1" description = "inscriptis - HTML to text converter." license = "Apache-2.0" readme = "README.rst" -requires-python = ">=3.9,<3.15" +requires-python = ">=3.9,<3.14" authors = [ { name = "Albert Weichselbraun", email = "albert.weichselbraun@fhgr.ch" }, @@ -26,7 +26,6 @@ classifiers = [ "Programming Language :: Python :: 3.11", "Programming Language :: Python :: 3.12", "Programming Language :: Python :: 3.13", - "Programming Language :: Python :: 3.14", ] dependencies = [ From dcc524a7b359944b2d764850a7d9af0a1d1a3ad6 Mon Sep 17 00:00:00 2001 From: Albert Weichselbraun Date: Tue, 5 Aug 2025 11:22:15 +0200 Subject: [PATCH 05/25] chg: improved documentation. --- docs/api.rst | 76 ++++++++++++++++++++++++++++++++++ src/inscriptis/model/config.py | 6 +-- 2 files changed, 78 insertions(+), 4 deletions(-) create mode 100644 docs/api.rst diff --git a/docs/api.rst b/docs/api.rst new file mode 100644 index 0000000..9962cda --- /dev/null +++ b/docs/api.rst @@ -0,0 +1,76 @@ +=============================== +Inscriptis module documentation +=============================== + +.. automodule:: inscriptis + :members: + +Inscriptis model +================ + +Inscriptis HTML engine +---------------------- +.. automodule:: inscriptis.html_engine + :members: + +Inscriptis HTML properties +-------------------------- +.. automodule:: inscriptis.html_properties + :members: + +Inscriptis ParserConfig +----------------------- +.. automodule:: inscriptis.model.config + :members: + +Inscriptis CSS model +-------------------- +.. automodule:: inscriptis.model.css + :members: + +Inscriptis canvas model +----------------------- +.. automodule:: inscriptis.model.canvas + :members: + +.. automodule:: inscriptis.model.canvas.block + :members: + +.. automodule:: inscriptis.model.canvas.prefix + :members: + + +Inscriptis HTML Element +----------------------- +.. automodule:: inscriptis.model.html_element + :members: + + +Inscriptis table model +---------------------- +.. automodule:: inscriptis.model.table + :members: + + +.. _annotations: + +Inscriptis annotations +====================== + +.. automodule:: inscriptis.annotation + :members: + + +Annotation processors +--------------------- + +.. automodule:: inscriptis.annotation.output + :members: + +Inscriptis CSS profiles +======================= +.. automodule:: inscriptis.css_profiles + :members: + :no-value: + + diff --git a/src/inscriptis/model/config.py b/src/inscriptis/model/config.py index c8a67dd..2633e8b 100644 --- a/src/inscriptis/model/config.py +++ b/src/inscriptis/model/config.py @@ -1,7 +1,5 @@ #!/usr/bin/env python -"""This modul provides the ParserConfig class which allows customizing -how Inscriptis converts HTML to text. -""" +"""Configure Inscripits HTML rendering.""" from __future__ import annotations @@ -20,7 +18,7 @@ class ParserConfig: - """The ParserConfig class encapsulate + """The ParserConfig class allows fine-tuning the HTML rendering. - CSS definitions (from :mod:`inscriptis.css_profiles` or custom definitions). From 2a4eff674215d2b67b01f4d392b242bda6020121 Mon Sep 17 00:00:00 2001 From: Albert Weichselbraun Date: Tue, 14 Oct 2025 19:14:52 +0200 Subject: [PATCH 06/25] add: Unittest for value in an ordered list. --- tests/html/enumeration-value.html | 8 ++++++++ tests/html/enumeration-value.txt | 6 ++++++ 2 files changed, 14 insertions(+) create mode 100644 tests/html/enumeration-value.html create mode 100644 tests/html/enumeration-value.txt diff --git a/tests/html/enumeration-value.html b/tests/html/enumeration-value.html new file mode 100644 index 0000000..a159776 --- /dev/null +++ b/tests/html/enumeration-value.html @@ -0,0 +1,8 @@ +

Coffee
Tea
Milk
Water
Juice
Beer

diff --git a/tests/html/enumeration-value.txt b/tests/html/enumeration-value.txt new file mode 100644 index 0000000..df9a3d1 --- /dev/null +++ b/tests/html/enumeration-value.txt @@ -0,0 +1,6 @@ + 100. Coffee + 101. Tea + 102. Milk + 103. Water + 104. Juice + 105. Beer From 5d43159f1475fc075437f73c25fcb2e712353b0f Mon Sep 17 00:00:00 2001 From: fcasalen Date: Fri, 17 Oct 2025 17:00:54 -0300 Subject: [PATCH 07/25] chg: handling list items with value attribute --- src/inscriptis/model/tag/list_tag.py | 14 +++++++++++--- tests/test_list_div.py | 12 ++++++++++++ 2 files changed, 23 insertions(+), 3 deletions(-) diff --git a/src/inscriptis/model/tag/list_tag.py b/src/inscriptis/model/tag/list_tag.py index 61c0d3d..bf36827 100644 --- a/src/inscriptis/model/tag/list_tag.py +++ b/src/inscriptis/model/tag/list_tag.py @@ -1,4 +1,5 @@ """Handle the

tag.""" bullet = state.li_counter[-1] if state.li_counter else "* " + if tag.get('value'): + if tag.get('value').isdigit(): + bullet = int(tag.get('value')) + if not state.li_counter: + state.li_counter.append(bullet) + else: + bullet = tag.get('value') if isinstance(bullet, int): state.li_counter[-1] += 1 state.tags[-1].list_bullet = f"{bullet}. " @@ -23,7 +31,7 @@ def li_start_handler(state: HtmlDocumentState, _: dict) -> None: state.tags[-1].write("") -def ul_start_handler(state: HtmlDocumentState, _: dict) -> None: +def ul_start_handler(state: HtmlDocumentState, _: Dict) -> None: """Handle the