Example Web Scraper

Component type

module

Maintenance status

Development status

Downloads

4336

Component created

Component changed

This example demonstrates how to build a Drupal-native web scraper. It imports events from a single month of Stanford University's calendar by navigating to the page for each day and creating a node for each event on the day's list. Each event is then queued for scraping its details.

All functionality is provided by Feeds, Feeds XPath HTML Parser, Feeds Crawler, Feeds SelfNode Processor, and Feeds Tamper. This module only includes an example configuration packaged using Features. Developers and site-builders who are interested in web scraping may find it a helpful starting point.

Block Instances

Component type

module

Maintenance status

Development status

Downloads

8450

Component created

Component changed

Blocks instances module allows users to render a block in different places when some conditions are met.

A block instance is a set of conditions that determine which block renders in a specified region. Each block instance can render a single block.

Current Features:

Static HTML Viewer

Component type

module

Maintenance status

Development status

Component created

Component changed

The idea of the Static HTML Viewer module, is to bind a static HTML web site directly into Drupal.

This is not about importing a static HTML website into Drupal (this is already well documented). Instead, we are directly binding a website into Drupal.

This is very useful if you want to expose a set of HTML pages into your website without having to create a node for each page.

Custom Migration

Component type

module

Categories

Maintenance status

Development status

Component created

Component changed

This module is for calling a PHP script (for you to define) to migrate data.

Custom Migrationjust creates a page with a button to call the script.

_You write the script._

Great starting point, avoids need to write any code other than the migration script.

Credit to Darrell Duane for creating the initial module.

***********************************************************
Features
***********************************************************

- Creates a single button, which calls a function you define.

Datasources

Component type

module

Categories

Maintenance status

Development status

Downloads

4024

Component created

Component changed

Part of Ouch project.

Goal

Datasources provides a framework to describe and manage datasource to import in Drupal.

Usage

Module can register datasources.

Once you have defined your datasources, the module provides an UI to map datasource fields against entities fields and define import policies.

You can declare sharable preprocessors to do some field level transformation.

There is a basic support for list fields.

The module manages the find/update/insert stuff.

Apps

Component type

module

Maintenance status

Development status

Downloads

346692

Component created

Component changed

First there were modules, then there were Features, and now there are Apps. Apps is the next generation of extensibility and interoperability for Drupal. They provide a much better user experience of extending your Drupal site by providing facilities to download modules and all of their dependencies in one easy step.

You can hear more about Apps at the following Drupalcon Presentations

User CSV Export

Component type

module

Categories

Maintenance status

Development status

Component created

Component changed

Abandoned.

For a much better implementation try Views Data Export

Essentially a checkbox form populated by all fields attached to the user entity type. Each field selected on the form is added into the final csv and a link is output to download it.