Ecoinformatics site parent site of Partnership for Biodiversity Informatics site parent site of REAP - Home




Conference Call Notes 20100524

May 24, 2010
Participants: Anand, Barseghian, Crawl, Gallagher, Riddle, Staggs, Wang

  • james - was able to get crawler caching, stuffing things into postgres. Last crawl I did took 27 hours for 1 site, and then network crashed, and for peter's usecase we'll need to crawl 5. Need to create code to gracefully resume.

  • derik - working on 2.0, reporting 2.0 bugs, and reporting and workflow-run-manager documentation.

  • sean - workingon engineering view - adding a model type to kepler, ala FSM, for sensor workflows

  • jianwu - fixing master-slave bug. there's now a permission policy for each slave, to allow R, Matlab, python, or the external execution actor.

  • manish - created working prototype workflow for transfering data from DT to Metacat.
    • TODO fix workflow to not put data into production server, ask jing to remove submitted junk data
    • TOOD check in workflow to reap svn

  • dan - working with DataTurbine
    • looking into mirroring - rbnbAdmin is the only tool i've found to do it, and it requires a gui. I've started modifying its code to do it from cmd line. But can't currently get mirroring to work between 2 machines. Will try to mirror on the same machine to see if it's a firewall issue
    • looking into DT not keeping data around -- turns out DT only allocates 10 filesets, regardless of archive size, and every detach seals one. Emailed Mark Miller to get a patch from him to fix this

Go to top   Edit this page   More info...   Attach file...
This page last changed on 25-May-2010 17:57:10 PDT by uid=barseghian,o=NCEAS.