XPath scraper

Component ID

2888631

Component name

XPath scraper

Component type

module

Maintenance status

Development status

Component security advisory coverage

not-covered

Downloads

840

Component created

Component changed

Component body

XPath scraper allows you to scrape data from another website by parsing html using xpath.

How does it work:

  1. Download and enable XPath scraper module.
  2. Create new module that requires XPath scraper and put the configuration at {module_name}/src/Controller/ScraperConfigController.php.

Example:

kindly see xs_test which has the following files:

xs/modules/xs_test/xpath_scraper_test.info.yml
xs/modules/xs_test/xpath_scraper_test.services.yml
xs/modules/xs_test/src/Controller/ScraperConfigController.php

  • Copy example module to your custom modules folder.
  • Then rename EXAMPLE_WEBSITE with your target website.
  • Feel free to edit configuration and follow comments.
  • Add/remove fields configuration depend on content type and target website.

XPath scraper for Drupal 8:

We are in beta stages for 8.x version. We expect to cover the most common use cases and welcome everybody to use the module.

If someone tests/uses this module and provides feedback we will be very thankful.

Please use the issue queue for anything in mind, I accept all suggestions and comments. :)

This distribution is sponsored and developed by Vardot.

Vardot