Thursday, November 12, 2015

Caffe install on delta (done)


  • git clone git@github.com:BVLC/caffe.git
  • Dependency installation script at https://gist.github.com/dineshj1/ad960e8361127c647194
    • CMake installation works.
    • glog installation works
    • gflags installation works
    • protobuf installation complicated: 
      • 3.0 installation failing with pthread library error. Fixed hackily.
        • Installer can't file pthread library, sets HAVE_PTHREAD to false.
        • In src/Makefile.am, around line 15, edit the if HAVE_PTHREAD, ... , else, .. endif block, to execute the code for HAVE_PTHREAD = true, without checking the condition. i.e. PTHREAD_DEF = -DHAVE_PTHREAD=1
      • protobuf 2.6.1 installation appears to work cleanly. 
    • leveldb installation works
    • snappy installation works
    • hdf5 installation works
    • opencv installation ?
    • Boost installation works following steps at: http://www.boost.org/doc/libs/1_59_0/more/getting_started/unix-variants.html#easy-build-and-install (Section 5.1)
  • Main Caffe installation
    • Using Makefile.config
      • module list output looks like: 1) cuda/7.5            2) intel/14.0.0        3) mkl/10.2.5.035      4) java/1.6.0-x86_64   5) vim/7.2             6) cmake/2.8.1         7) atlas/3.10.2
      • cp Makefile.config.example Makefile.config. Small changes, to point to anaconda etc. https://gist.github.com/dineshj1/209aecc7b753b8fa92aff82571cf0ede
      • Error when $ make runtest,  with system gflags (libgflags.so.0) getting linked to installed glog. Fixed by: /N/u/dineshj/local/$ ln -s libgflags.so.2.2 libgflags.so.0
        • bash_profile at: 
        • Works right away!
      • Using cmake
        • module list output looks like: 1) vim/7.2        2) cmake/2.8.1    3) gcc/4.8.2      4) cuda/7.5       5) atlas/3.10.2
        • Modifying various items in CMakeCache.txt: ATLAS_lapack_library, boost libraries, leveldb, protobuf, python, snappy, opencv (modified CMakeCache.txt at https://gist.github.com/dineshj1/8424162f5e67476d455d)
        • First attempt produces errors:
          • boost version already present is too old. Installation fixed this.
        • Second attempt nearly there, but produces errors:
          • Using system's original installation of opencv causes errors. Install opencv-2.4.9, then try again. 
          • make all -j works. 
          • make pycaffe -j works.
          • make runtest -j works!
        • Error with system gflags (libgflags.so.0) getting linked to installed glog. Fixed by: /N/u/dineshj/local/$ ln -s libgflags.so.2.2 libgflags.so.0
        • add ~/local/python/ to PYTHONPATH environment variable in .bash_profile.
        • make pytest fails saying, google protobuf missing. Fix by going to ~/local_pkgs/protobuf-2.6.1/python, then typing (Instructions in the README.txt file in this directory):
          • python setup.py build
          • python setup.py google_test
          • python setup.py test --cpp_implementation
          • python setup.py install --cpp_implementation
        • make pytest -j works!

    No comments:

    Post a Comment