border top
OutWit Hub for Firefox - Version History
  • Version 5.0.1.42
    • Feature - It is now possible to use a multiple character string as the CONCAT separator.
    • Feature - Added preference to name the fields in the queries of SQL exports.
    • Feature - Added #MaxColumns# directive to limit the number of columns in the extracted data.
    • Fix - fixed stalling explorations in certain cases when the server did not answer.
    • Fix - #REQUESTED-URL# works in more casses.
    • Fixes - several fixes and optimizations in contact extractions on large lists of URLs.
    • Enhancement - Enhancements and fixes in #suspendIf# and #formatDate()#.
  • Version 5.0.1.9
    • Enhancement - Modified 'Zap Gremlins' preference for scrapers, so that it doesn't remove non-latin characters.
    • Fix - fixed export problem on columns with a % in the header.
    • Fix - made #showAlert# work even if it is the only line in scraper.
    • Fixes - Various fixes in scrapers and macros.
  • Version 5.0.0.294
    • Feature - Added a preference to set the list of fields in INSERT instructions for SQL exports.
    • Feature - Added preference "Proceed If Page Contains / Does Not Contain".
    • Feature - Now resolves generation patterns to first value when typed in address bar.
    • Feature - Automatic corrections are now performed when pasting URLs into a directory of queries.
    • Fix - Removed save dialog on command line execution with -url parameter and a MAU.
    • Fix - Corrected header problem that could occur when editing a cell in table view.
    • Fix - Corrected #showAlert# which did not execute when no other line in scraper.
    • Enhancements - Enhancements and fixes in contact recognition and extraction.
    • Enhancements - Enhanced queue performance and fast scraping on very large numbers of URLs.
    • Fixes - Many performance and security enhancements and fixes.
  • Version 5.0.0.239
    • Feature - Max number of retries can now be set in the Exploration preference panel.
    • Feature - New format, added milliseconds and some additional changes in date eval.
    • Feature - Now forcing contact column extraction if unhidden in column picker (if applicable).
    • Feature - Browse and fast contacts (all links) is implemented in all editions.
    • Feature - Added replacement functions #MACHINE-NAME# (set in the preferences) and #RANDOM-PHRASE#[adjective] [character]# to generate random strings.
    • Fix - Fixed automator selection in tutorials that could lead to editing the wrong scraper during the execution of the tutorial.
    • Fix - Corrected a rare problem which could cause the application to start in full screen mode.
    • Fix - Fixes in first name recognition (removed short ambiguous names & corrected a recent regression).
    • Fix - Fixed #DISTINCT-COUNT# which was not creating two columns.
    • Fix - Multiple fixes in contacts.
    • Fix - Fix for oversized query directories which could be truncated and rendered unusable if RAM was not large enough (could only happen in extreme cases of many hundreds of thousands or millions of items).
    • Enhancement - Now corrects URLs sent to (or pasted in) queries without protocol (adding http://).
    • Enhancement - Allowed slash character in some phone numbers (mostly for Belgian phone formats).
    • Enhancement - Fixes and enhancements in text cleaning and script/style/comment removal.
    • Enhancement - Made #ignoreErrors# work even for timeouts, unreachable, no data....
  • Version 5.0.0.127
    • Feature - Added preference to prevent link extraction in Enterprise edition (useful when loading extremely large documents into OutWit Hub).
    • Feature - Added epub format to document recognition in documents view.
    • Enhancement - Recognizes more Next Page links automatically.
    • Enhancement - Tested and enhanced upgrade/update/downgrade functions in large number of configurations.
    • Known Issue - Not signed for Firefox 43+. Can only be installed as an add-on to Firefox 43+ if the preference named xpinstall.signatures.required is set to to false.
  • Version 5.0.0.107 - Release 5.0
    • Feature - Directive library and help in the scraper editor right-click.
    • Feature - Recognition of "onclick" javascript links as Next Page links.
    • Feature - First implementation of selectors in the bottom panels.
    • Feature - 'Show in source' function from the browser. (Right-click on the page.)
    • Feature - Split directory function in the queries view. (Right-click on a directory.)
    • Feature - Script execution timeout preference.
    • Feature - FTP upload as a new destination for macro data exports in Pro and Enterprise editions.
    • Feature - User replacements on source load and on export.
    • Features - Refactoring, dozen of additional features, new scraper directives.
    • Feature - Enterprise edition: Scraper directives: #nextPageReferrer#, #skipIfIn#queryDirectory#, #deduplicateWithinPage#
    • Feature - Enterprise edition: Scraper click commands to be used in the Replace column: #CLICK-ID#nodeID#, #CLICK-SELECTOR#cssSelector#, #CLICK-SELECTOR-FIRST-NODE#cssSelector#, #CLICK-SELECTOR-LAST-NODE#cssSelector#, #CLICK-SELECTOR-FIRST-LINK#cssSelector#, #CLICK-SELECTOR-LAST-LINK#cssSelector#, #CLICK-SELECTOR-ALL#cssSelector#, #CLICK-SELECTOR-NEXT-NODE#cssSelector#, #CLICK-CLASS-ALL#cssClass#, #CLICK-CLASS#cssClass#, #CLICK-CLASS-FIRST-NODE#cssClass#, #CLICK-CLASS-LAST-NODE#cssClass#, #CLICK-CLASS-FIRST-LINK#cssClass#, #CLICK-CLASS-LAST-LINK#cssClass#, #CLICK-CLASS-NEXT-NODE#cssClass#, #CLICK-CLASS-NEXT-LINK#cssClass#
    • Enhancement - Verification of profile files and config consistency at startup and correction of known possible problems.
    • Enhancement - Handles combined Fast Dig and Browse with the 'include selected data' option on (or in macros with 'catchData').
    • Fix - Blinking scrollbars on Macintosh in the scraper manager.
    • Fix - Small fixes and enhancements throughout the code.
  • Version 4.1.2.18
    • Fix - fixed contact extractor for emails like alt=name@example.com.
    • Fix - Several minor corrections throughout the code.
    • Enhancement - Refactoring and optimization in scraper engine.
    • Enhancement - Enhanced paste links function.
  • Version 4.1.1.61
    • Feature - Added shortcut for copy cells.
    • Feature - Added #rewrapRecords# to Enterprise version (only works if same number of fields in all records).
    • Feature - Added a "Check headers" preference to the automatic exploration settings to avoid unwanted blocking dialogs.
    • Fix - Corrected a problem that could cause a freeze in "Browse & Fast Search for Contacts" on some specific URLs.
    • Fix - Fixed 'get parameters from view' in macros.
    • Fix - Fixed functions in variables used to rename downloads (Enterprise edition).
    • Fix - Fixed #DATE#... interpretation in generation patterns and download rename patterns.
    • Enhancement - Automatically setting optimal preferences and bottom panel settings before "Browse & Fast Search for Contacts" (empty on demand, in particular) and restoring original settings afterwards.
    • Enhancement - Enhanced/optimized comment colorizing in source code.
    • Enhancement - Added a few examples to scraper line library.
  • Version 4.1.1.3
    • Feature - Enterprise edition: Added possibility to click on the last node or link of a class with #CLICK-CLASS-(FIRST|LAST)-(NODE|LINK)#.
    • Feature - Enterprise edition: added #OUTSIDE# & #WITHIN# replacement variables to only scrape a URL if it belongs or doesn't belong to the same domain as the current page.
    • Feature - Added preference truncateSourceAbove to truncate source larger than 1500000 characters by default.
    • Feature - Enterprise edition: added #suspend#, #suspendIf#, #suspendIfNot#, #removeCookies# directives to instruct a scraper to pause and wait for manual intervention in case of interruptions due to server errors or captchas.
    • Fix - Scrapers - #scrollToEnd# and #scrollToString# directives were refactored and enhanced. They were tested in very different contexts but please don't hesitate to notify us if you know websites where they do not behave as they should.
    • Fix - Some recent regressions in tutorials were due to changes in the framework. These were fixed.
    • Fix - Scrapers - Several enhancements and corrections were added to the scraper function interpretation, to better allow for using variables in functions and functions in variable definition.
  • Version 4.1.0.81
    • Feature - scrapers - Added #saveQueueAsQueries# directive in Enterprise edition.
    • Feature - scrapers - Added #suspendIf#, #suspendIfNot#, #suspendAfter#n#, #removeCookies# directives in Enterprise edition, allowing you to suspend a process (and empty cookies) on certain server answers.
    • Feature - scrapers - Added #OUTSIDE#, #WITHIN# replacement functions in Enterprise edition, to filter local or external links in a scraper.
    • Fix - Fixed problem happening in certain cases with command line parameters (macros and quit after commands).
    • Fix - Several small fixes in datasheet management (coloring, sorting of selected lines) etc..
    • Fix - Fixed some glitches in the Export Preview panel
    • Fix - The "highlight series of links" option of the View menu was not persistent any more. This was fixed
    • Enhancement - Optimized URL queue and RAM management in automatic explorations and scraping (this was massively tested but please report suspect changes in periodical jobs if you notice any).
    • Enhancement - It is now possible to check/uncheck, escape/unescape several selected lines at once in the scraper editor.
    • Enhancement - scrapers - The #scrollToEnd# directive is now working in most AJAX pages where data is updated on scroll. Please notify us of cases you may find where this function can still be enhanced.
    • Enhancement - scrapers - Several additional enhancements and fixes in scraper editing and application.
  • Version 4.1.0.43
    • Feature - It is now possible to send POST queries in Fast scrape mode.
    • Feature - not alone (?) and required (!) suffixes for scraper fields are now working on a per-record basis.
    • Enhancement - Loading time and menu display time have been optimized for profiles with very large numbers of automators.
    • Fixes - Corrected unwanted replacement of partial html entities like ® in strings created by generation patterns.
    • Fixes - Corrected performance drops in some features due to the use of the irregexp library in the latest versions of the Mozilla framework.
  • Version 4.1.0.22
    • Fix - Corrected a performance issue that could generate unresponsive script alerts in earlier 4.1 versions searching for contacts in some large pages.
  • Version 4.1.0.16 - Release 4.1
    • Features - Implemented new Enterprise-only features (see Help).
    • Feature - Added Browse Links and Series of Pages in the datasheet right-click menu.
    • Feature - Added #FIRST2#, #FIRST3#... directives
    • Enhancement - Added copy & paste functions and enhanced drag & drop in the queries view.
    • Fixes - Enhancements, fixes, optimizations throughout the code.
    • Fix - Handling more possible server errors susceptible to stall automatic explorations.
    • Fix - Managing rare timer errors potentially causing periodical jobs to miss some executions.
  • Version 4.0.7.98 - Enterprise Edition Features
    • Feature - Added intercept queries function (Enterprise edition).
    • Feature - Added Dig + Fast Scrape functionality (Enterprise edition).
    • Feature - Project management functionalities and interface (Enterprise edition).
    • Feature - Jobs - possibility to execute system commands within an outwit job (Enterprise edition).
    • Feature - Added a new type of source code to apply scrapers to: All Frames concatenated (Enterprise edition).
    • Feature - Scrapers - Generation patterns can be created and used in scrapers (Enterprise edition).
    • Feature - Scrapers - It is now possible to download files and send URLs to queries from a scraper (Enterprise edition).
    • Feature - Scrapers - Added several replacement, total & concatenation functions (Enterprise edition).
    • Feature - Scrapers - Added several Enterprise edition-only scraper directives. See Help page on the scraper editor.
    • Feature - Scrapers - Added #abortAfter# directive.
    • Feature - Macros - catchData can now be used in Dig & Browse modes.
    • Feature - Scrapers - Added #ALLBUTFIRST# concatenation function.
    • Feature - Dig Depth 2 was added were relevant.
    • Feature - Added a preference to sort the automator menus alphabetically.
    • Feature - Macros - Added "Append" if file exists, in some export formats (Enterprise edition).
    • Feature - Added "Extract External/Local Links" in the right-click menu on the page (Edit>Content Edition Tools).
    • Fix - #concatSeparator# directive is working again.
    • Fix - scrapers - The #insertIf# directive is now working even if the other scraper lines return no results.
    • Enhancement - Improved Fast Search/Fast Scrape functionalities, identified and removed more possible server and connection problems while browsing through large series of pages and optimized the error management so that extraction processes do not stall in case of errors.
    • Enhancement - Importing automators (with -url "file://...") is now possible from the command line.
    • Enhancement - Copy, Paste and Select All are now working in the scraper editor.
    • Enhancement - Enhancements in contact recognition algorithms.
    • Enhancement - Several fixes and enhancements in scrapers Total/Concat functions (inclusion of variables, etc.).
    • Enhancement - Added Reset Application in File menu.
    • Enhancement - Scrapers - Keep order is now working with split fields.
    • Enhancement - Corrected a few interface glitches, like the width of the macro menu in the editor etc.
  • Version 4.0.7.10
    • Feature - Added #default# directive (Enterprise edition).
    • Feature - Date formatting in generation patterns (Enterprise edition).
    • Feature - Totals and Concat functions are now allowed in variable declarations (Enterprise edition).
    • Feature - Added #CLICKID# and #CLICKCLASS# replacement functions (Enterprise edition).
    • Feature - Added setting for datasheet text size in the View menu.
    • Feature - Added preference to filter out some contacts from searches (self, for instance).
    • Fix - Reactivated Download options in the File menu.
    • Fix - Fixed regression in the Send to Catch function of the text view.
    • Fix - Several small fixes in First/Last Name cell splitting function.
    • Fix - Fixed/enhanced scraper automatic selection when not specified by name & version in macros.
    • Enhancement - Compatible with Firefox 32.
    • Enhancement - Enhanced middle initial handling in contacts.
    • Enhancement - Reorganized preference panels.
    • Enhancement - More diacritics are allowed in label normalization and in scraper variable names.
border bottom