We have released version 2.0 of OutWit Hub with dozens of new features, dramatically enhanced scrapers and a fun built-in tutorial system. This is a major upgrade both for casual users and data addicts. It can handle very large volumes of data and offers more, simpler ways to build scrapers and apply them discriminately during automatic Web explorations.
I hope you’ll like it. We do.

We just uploaded version 1.0.7.23 of OutWit Hub and v.0.3.7.23 of Images and Docs. This is a minor update with a few fixes in scrapers and next page recognition but it does include the latest kernel update for those of you who are using Firefox Aurora.

We have started limited beta testing of the next version. As it brings enhancements to pro-only features, you need to own a license for OutWit Hub Pro if you wish to test this pre-version. Drop us a line here to receive the link.

The latest version of OutWit extensions is now compatible with versions 3.6 to 6 of Firefox. You can download it directly from outwit.com. In order to add the new features, we had to discontinue support for Firefox v3.5, as well as for versions of Mac OS before 10.6.

We will soon release v.1.1 of OutWit Hub. This major update includes a complete refactoring of whole parts of the application, particularly for managing and exporting very large datasheets. There are still volume limitations, of course, but they were pushed by a factor of more than 10 in this new version. Depending on the number of columns, the program will now handle extractions of 100,000+ rows of data. (In fact, in the latest tests, we successfully extracted 1.15 million rows straight to the catch, then exported and loaded 1,048,576 of these in Excel, as it seems to be the maximum Excel can handle.)

Version 1.0.5.8 is online for download on outwit.com with a series of fixes. This version works with the latest beta of Firefox 5.

We have received feedback from users who found that the automatic update frequency was too high. In order to be as reactive as possible to the requests or bug reports we receive, we must usually produce between two and five minor updates each month. This would obviously be too high a frequency. We are now trying to limit the periodicity of general, automatic updates to one every 30 to 45 days. In the meantime, if you wish to follow the versions more closely, you can look at the version history page on outwit.com and download the latest manually. Your outwit configuration will not be altered when you install a new version.

OutWit Hub Pro Users: we release major upgrades several times a year, like the upcoming version 1.1. If you have purchased the pro version of OutWit Hub 1.0 and if your free upgrade plan has not expired, the new version will be free for you and you will simply have to reenter your serial number to unlock it.

You may need, at times, to extract hierarchical data without loosing the structure:

In many of these cases, you will lack significant markers to distinguish the parent elements (the legs of the trip, in this case). If you just grab the time information with a simple scraper, you are likely to loose the leg they belong to. In cases like this (although we haven’t yet implemented a complete recursive/hierarchical scraping system), you can already often get the result you want using the ‘Separator’ & ‘Labels’ fields in the scraper (pro version only). Making such scrapers often requires a good understanding of complex regular expressions.

The Separator is a delimiter which you can use to split an extracted string into several data fields.
The List of Labels is the series of headers to be used respectively for each destination column, when the result is split into several fields using a Separator.

In the Separator field, you can use either a literal string like “,” or “;”, a tag like “</ul>” or a regular expression. When splitting the result with a Separator, use the List of Labels to assign a field name to each part of the data. Separate the labels with a comma.

The parent block of data is extracted between the Marker Before and the Marker After and this block is then split into several fields. This way, you will keep the data that belong together in a same row. Separator/Labels are very helpful, in general, when the strings you want to extract are not surrounded by remarkable markers.

Tutorials are better than in-line help; that’s a fact. We know this, and we are also very conscious that we’ve been promising a new set of tutorials for over a year, now. They will come (eventually and progressively) in version 1.1. In the meantime, the 50+ pages of built-in Help of OutWit Hub detail all main functions of the application.

The first time you open the help, all sections are collapsed. To expand and explore their content, you need to click on the + (or triangle) signs on the left of each section title. Don’t forget to have a look there before creating a ticket in the support system as we update the help articles regularly. If you do not find an answer in the help, of course, don’t hesitate to ask us for assistance.

Version 1.0.1.11 of OutWit Hub solves a number of issues (see history), in particular in the recognition of Next Page links in series of pages. Do not hesitate to download this version from our site if the update was not automatically proposed to you.