Bookscanner: Difference between revisions

From Wiki-Fou
(Copy workflow PDF to wiki page)
 
(Update version 5)
Line 1: Line 1:
__TOC__
__TOC__


There are many ways to scan books, this is how we do it. :)
There are many ways to scan, this is the current state of the art in Calafou.
 
maxigas explained the workflow a number of times to different people and decided to put together a how-to according to those conversations. There should be a biblio-graphy at the end of this document…


= Scanning =
= Scanning =
Line 22: Line 20:
<li>Push the big button on the scanner to scan.</li></ol>
<li>Push the big button on the scanner to scan.</li></ol>


* maybe you have to put your finger to the side of the plexiglass which is closer to you when it is “down”, because the plexiglass is not always exactly the same angle as the book pages
* maybe you have to put your finger to the side of the plexiglass which is closer to you when it is , because the plexiglass is not always exactly the same angle as the book pages


<ol start="3" style="list-style-type: decimal;">
<ol start="3" style="list-style-type: decimal;">
<li>Download the images from the SD cards and put the scanner to sleep.</li></ol>
<li>Download the images from the SD cards and put the scanner to sleep.</li></ol>


* from the camera on the left, copy the images to a folder called “odd”
* from the camera on the left, copy the images to a folder called  
* from the camera on the right, copy the images to a folder called “even”
* from the camera on the right, copy the images to a folder called  
* upload the two folders now to to ftp://seldon.calafou/HackTheBiblio/scanning/<math>bookname--</math>yourname/ folder
* upload the two folders now to to ftp://seldon.calafou/HackTheBiblio/scanning/<math>bookname--</math>yourname/ folder
* remember to delete the pictures from the SD cards and put them back to the cameras, and maybe put the camera batteries to charge
* remember to delete the pictures from the SD cards and put them back to the cameras, and maybe put the camera batteries to charge


= Dependencies =
Using an up-to-date Debian operating system, you can install the following programs for the postproduction steps:
* scantailor
* gprename
* pdftk
* tesseract-ocr
* tesseract-ocr-eng
* tesseract-ocr-spa
* calibre
You can install all these programs with the following invocation:
<pre>sudo apt install scantailor gprename pdftk tesseract-ocr /
        tesseract-ocr-eng tesseract-ocr-spa calibre</pre>
= Postproduction =
= Postproduction =


Line 39: Line 53:


<ol start="0" style="list-style-type: decimal;">
<ol start="0" style="list-style-type: decimal;">
<li>[program] ➔ [output]</li>
<li>[program] 1.jpg, 2.jpg, 1.tif, 2.tif, 1.pdf, 2.pdf, book.pdf</li>
<li>gprename ➔ 1.jpg, 2.jpg, …</li>
<li>calibre http://libgen.org/book/index.php?md5=B6916395FDE00D91DB4F52DCB8F069BF</li>
<li>scantailor ➔ 1.tif, 2.tif, …</li>
<li>tesseract ➔ 1.pdf, 2.pdf, …</li>
<li>pdftk ➔ book.pdf</li>
<li>calibre ➔ book.epub</li>
<li>libgen.org ➔ http://libgen.org/book/index.php?md5=B6916395FDE00D91DB4F52DCB8F069BF</li>
<li>etc.</li></ol>
<li>etc.</li></ol>


There are some bash oneliners which can be useful (on Debian based systems):
There are some bash oneliners which can be useful (on Debian based systems):


<ol start="0" style="list-style-type: decimal;">
<ol style="list-style-type: decimal;">
<li><p>Install the abovementioned programs:</p>
<li><p><code>FIXME</code> we can probably write a script to rename the files properlynumbericalfix orientation$beducational materials
<pre>sudo apt-get install gprename scantailor tesseract-ocr\
      tesseract-ocr-eng tesseract-ocr-spa pdftk calibre</pre></li>
<li><p><code>FIXME</code> we can probably write a script to rename the files properly… in gprename select the “numberical” tab, start = 1 for right-pages and 2 for left-pages, always step = 2.</p></li>
<li><p>You can rotate the images appropriately (which is called “fix orientation” in scantailor) in the left/right folders before you import them. This is faster than in scantailor I think.</p>
<pre>sudo apt-get install imagemagick
cd left
mogrify -verbose -rotate 270 *
cd ../right
mogrify -verbose -rotate 90 *</pre></li>
<li><p>Does Optical Character Recognition (OCR) on all images in folder:</p>
<pre>time for i in *tif; do b=‘basename ’$i“ .tif‘; tesseract -l spa ’$i” “$b” pdf; done</pre>
<p>for i in *.tif; do /usr/local/bin/tesseract &quot;<math>i" "`basename "</math>i&quot; .tif`&quot; -l spa pdf; done</p></li>
<li><p>Merges all the pdf files in folder into one single file:</p>
<pre>pdftk *pdf cat output book.pdf</pre></li>
<li><p>Exports the pdf metadata to a text file, to edit:</p>
<pre>pdftk book.pdf  dump_data output report.txt</pre></li>
<li><p>Imports the metadata of report.txt back on the pdf:</p>
<pre>pdftk book.pdf update_info report.txt output bookcopy.pdf</pre></li></ol>
 
= Distribution =
 
Think about how people who would be interested in this book could know about it!
 
Repositories:
 
* General “educational materials”: [https://libgen.io/ Library Genesis]
* Academic radical: [https://aaaaarg.org/ Aaaaarg]
* Artist radical: [https://monoskop.org/ Monoskop]
* Anarchist (including fanzines): [https://theanarchistlibrary.org/special/index Anarchist Library]
* There are many Zine Libraries you can find on the Internet…


You may consider spreading the word on relevant mailing lists, social media, etc.
You may consider spreading the word on relevant mailing lists, social media, etc.
Line 96: Line 75:


[http://en.flossmanuals.net/e-book-enlightenment/ Reading And Leading With One Laptop Per Child]
[http://en.flossmanuals.net/e-book-enlightenment/ Reading And Leading With One Laptop Per Child]
<div class="references">
</div>

Revision as of 04:29, 18 April 2017

There are many ways to scan, this is the current state of the art in Calafou.

Scanning

The amount of work in the postproduction phase depends on how good quality images you can make in the scanning phase!

  1. Setting up the cameras: the most important part.

Caveats:

  • camera should look at right angle on the page
  • all the page should be in the image
  • camera settings: full automatic, perhaps with manual focus
  • back up and empty the SD cards in the cameras
  • most subtle mistake: one camera sees letters bigger than the other camera
  1. Push the big button on the scanner to scan.
  • maybe you have to put your finger to the side of the plexiglass which is closer to you when it is , because the plexiglass is not always exactly the same angle as the book pages
  1. Download the images from the SD cards and put the scanner to sleep.
  • from the camera on the left, copy the images to a folder called
  • from the camera on the right, copy the images to a folder called
  • upload the two folders now to to ftp://seldon.calafou/HackTheBiblio/scanning/<math>bookname--</math>yourname/ folder
  • remember to delete the pictures from the SD cards and put them back to the cameras, and maybe put the camera batteries to charge

Dependencies

Using an up-to-date Debian operating system, you can install the following programs for the postproduction steps:

  • scantailor
  • gprename
  • pdftk
  • tesseract-ocr
  • tesseract-ocr-eng
  • tesseract-ocr-spa
  • calibre

You can install all these programs with the following invocation: 

sudo apt install scantailor gprename pdftk tesseract-ocr /
        tesseract-ocr-eng tesseract-ocr-spa calibre

Postproduction

You start with two folders with files like IMG_1234.JPG

The basic workflow is like this:

  1. [program] 1.jpg, 2.jpg, 1.tif, 2.tif, 1.pdf, 2.pdf, book.pdf
  2. calibre http://libgen.org/book/index.php?md5=B6916395FDE00D91DB4F52DCB8F069BF
  3. etc.

There are some bash oneliners which can be useful (on Debian based systems):

  1. FIXME we can probably write a script to rename the files properlynumbericalfix orientation$beducational materials You may consider spreading the word on relevant mailing lists, social media, etc.

    Biblio-graphy

    About our book scanner

    English

    Spanish

    Principal sources

    Reading And Leading With One Laptop Per Child

Retrieved from "http://wiki.calafou.org//index.php?title=Bookscanner&oldid=2716"