gio at Internet Archive

Tagged: index Toggle Comment Threads | Keyboard Shortcuts

• 

  gio 10:08 pm on August 3, 2015 Permalink
  Tags: index, ol ( 6 ), reindexing, search ( 5 ), solr ( 4 )   

  OL: reindexing the Solr search 

  To reindex the OpenLibrary’s Solr search index making it consistent with the db data we can use the script:

  /openlibrary/scripts/ol-solr-indexer.py

  /openlibrary/scripts/ol-solr-indexer.py

  here you can find the source.

  Here same basic usage:

  /olsystem/bin/olenv python /opt/openlibrary/openlibrary/scripts/ol-solr-indexer.py --config /olsystem/etc/openlibrary.yml --bookmark ol-solr-indexer.bookmark --backward --days 2

  /olsystem/bin/olenv python /opt/openlibrary/openlibrary/scripts/ol-solr-indexer.py --config /olsystem/etc/openlibrary.yml --bookmark ol-solr-indexer.bookmark --backward --days 2

  where:
  /olsystem/bin/olenv is the script to load the right virtualenv.
  --config /olsystem/etc/openlibrary.yml is the OpenLibrary yml configuration file.
  --bookmark ol-solr-indexer.bookmark is the location of the last scan timestamp (YYYY-MM-DD hh:mm:ss) bookmarked.
  --backward / --forward the direction to do the reindexing
  --days the number of days to reindex.

  the script can run in daemon mode. At the moment we still using the new-solr-updater for the partial updates…