Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 28, 2014

• Merge pull request internetarchive#91 from adam-miller/FetchHTTP_Empty_Content_Length

  Show description for 01af800
  kngenie

  committed
  01af800

• FetchHTTP.java

  Show description for bf248f4
  adam-miller

  committed
  bf248f4

Commits on Aug 27, 2014

• Merge pull request internetarchive#90 from kngenie/wbm-recrawl

  Show description for 9e1ade3
  nlevitt

  committed
  9e1ade3

Commits on Aug 26, 2014

• suppress JUnit 4 dependency through hbase-client.

  Show description for f343ce2
  kngenie

  committed
  f343ce2

• FIX: WbmPersistLoadProcessor.requestHeaders are ignored.

  Show description for fc38175
  kngenie

  committed
  fc38175

Commits on Aug 25, 2014

• Update POMs for newly imported Wayback-dedup module.

  Show description for bb51179
  kngenie

  committed
  bb51179

• import Wayback-dedup modules from crawltools project to Heritrix3 contrib

  kngenie

  committed
  651de15

• move WbmPersistLoadProcessor to final location in the tree

  kngenie

  committed
  d88e197

• Merge pull request internetarchive#86 from nlevitt/remove-cruft

  Show description for 93dd896
  kngenie

  committed
  93dd896

• Merge pull request internetarchive#89 from kngenie/beanbrowser-fix

  Show description for b6599d3
  kngenie

  committed
  b6599d3

• Don’t let exception from property getter fail entire bean-browser.

  kngenie

  committed
  2a38fa0

Commits on Aug 24, 2014

• Update HQ modules and WBM-dedup module to match Heritrix 3.3.0.

  Show description for 3450cf3
  kngenie

  committed
  3450cf3

Commits on Aug 20, 2014

• Merge pull request internetarchive#88 from nlevitt/crawluri-compare-bug

  Show description for 6868a9e
  kngenie

  committed
  6868a9e

• fix bug in CrawlURI.compare() discovered by Kenji, add unit test CrawlURITest.testOrdering()

  nlevitt

  committed
  0492107

Commits on Aug 13, 2014

• remove unused Transform* classes

  nlevitt

  committed
  f1b0633

Commits on Jul 25, 2014

• Merge pull request internetarchive#83 from nlevitt/revisit-redux

  Show description for 4298c3d
  

  vonrosen

  committed
  4298c3d

• oops! count novel urls/bytes for hosts report, etc

  nlevitt

  committed
  e5ecde6

• Merge pull request internetarchive#82 from kris-sigur/HER-2071

  Show description for e7b034c
  nlevitt

  committed
  e7b034c

• Fix for HER-2071

  kris-sigur

  committed
  8edebc0

Commits on Jul 23, 2014

• Merge pull request internetarchive#81 from nlevitt/hbase-cdh5

  Show description for 1c6746c
  vinaygoel

  committed
  1c6746c

• Merge branch 'master' into hbase-cdh5

  Show description for 40eae4c
  nlevitt

  committed
  40eae4c

Commits on Jul 22, 2014

• Merge pull request internetarchive#78 from nlevitt/extract-html-no-mimetype

  Show description for ba48f96
  

  vonrosen

  committed
  ba48f96

Commits on Jul 21, 2014

• Merge pull request internetarchive#79 from nlevitt/revisit-redux

  Show description for d0ebd40
  

  Kristinn Sigurðsson

  committed
  d0ebd40

Commits on Jul 18, 2014

• treat content as html and extract links if it looks like html, even if mime type belies that

  nlevitt

  committed
  4b75dfa

Commits on Jul 14, 2014

• restore writeRevisitFor* settings, but issue warning in setter and ignore the value

  nlevitt

  committed
  cb6ac8b

Commits on Jul 11, 2014

• oops, fix 304 tests

  nlevitt

  committed
  da30439

• test 304 not modified revist profile in FetchHTTPTest

  nlevitt

  committed
  7749280

• remove deprecated unused stuff

  nlevitt

  committed
  2292ea9

• set revisit profile on 304 not modified

  nlevitt

  committed
  810ad91

• use RevisitProfile for tallying stats

  nlevitt

  committed
  905a98c

Commits on Jul 10, 2014

• Merge branch 'master' into revisit-redux

  Show description for d9fd668
  nlevitt

  committed
  d9fd668

• Merge pull request internetarchive#76 from nlevitt/HER-2039

  Show description for f101bba
  

  Kristinn Sigurðsson

  committed
  f101bba

Commits on Jul 9, 2014

• remove LinksScoper (deprecated since 2009) and remove recently added code only used in LinksScoper

  nlevitt

  committed
  ee52f48

Commits on Jul 8, 2014

• switch usage of Link to CrawlURI in heritrix-contrib

  nlevitt

  committed
  7bd9f3a

• only write WARC-Refers-To header when value is not null

  nlevitt

  committed
  6e9a0a4

Pagination

PreviousNext