Wednesday, August 18, 2010

Bulk ingestion protocols, which is best?

Since PhilPapers' launch, a number of publishers have contacted us asking for some means to submit their content in bulk. We didn't have this facility until recently, partly because it took us a long time to decide what kind of system to implement. Here I report on how we've arrived at the current system.

We started off by trying to find out what kind of system is used by other big consumers of article-level metadata. The idea was that many publishers would already support it. We found out that the biggest consumer of metadata of all, PubMed, uses an XML schema defined by NLM. We also found out that a company which hosts many journals on behalf of publishers, Atypon, supports this system too (one of the first publishers to contact us was with Atypon). So we've decided to implement NLM-style feeds. On this system, we have an FTP server to receive zips of NLM XML files periodically.

This system works OK, but it turns out not to be as widely supported as we had expected. At the same time, the use of PRISM tags in RSS feeds has become fairly common since we've begun this project. Now most publishers have RSS feeds with detailed PRISM tags. So that's the system we now recommend. It's easiest both for us and for publishers. See the details here.

Of course, there's the problem that RSS feeds generally don't include historical data. But there is nothing to stop one from creating a historical RSS channel with all back issues for a journal.

253 comments:

  1. tiffany and co jewelry, http://www.tiffanyandco.in.net/
    prada handbags, http://www.pradahandbagsoutlet.co.uk/
    louis vuitton handbags, http://www.louisvuittonhandbag.us/
    tiffany jewellery, http://www.tiffanyjewelleryoutlets.co.uk/
    hermes belt, http://www.hermesbelts.us/
    ugg outlet, http://www.uggsoutlet.us.org/
    karen millen dresses, http://www.karenmillendressesoutlets.co.uk/
    replica watches, http://www.replicawatchesforsale.us.com/
    christian louboutin online, http://www.christianlouboutinonline.us.com/
    canada goose jackets, http://www.uggbootscheap.eu.com/
    gucci, http://www.borseguccioutlet.it/
    air jordan shoes, http://www.airjordanshoes.us.org/
    the north face outlet store, http://www.thenorthfaceoutletstores.org/
    louis vuitton, http://www.louisvuitton.in.net/
    ugg boots, http://www.uggbootsclearance.in.net/
    nobis outlet, http://www.wellensteyn.com.co/
    ray ban sunglasses, http://www.raybansunglassesonline.us.com/
    snow boots, http://www.wintercoats.us.com/
    lebron james shoes, http://www.lebronjames.us.com/
    beats by dr dre, http://www.beatsbydrdre-headphones.us.com/
    michael kors factory outlet, http://www.michaelkorsfactoryoutlets.in.net/
    cheap nhl jerseys, http://www.nhljerseys.us.com/
    montblanc pens, http://www.montblanc-pens.com.co/
    vans shoes, http://www.vans-shoes.cc/
    dansko outlet, http://www.dansko-shoes.us/
    2015109caihuali

    ReplyDelete
  2. Thanks for sharing in detail. Your blog is an inspiration! Apart of really useful tips, it's just really ! This post will be effectively Just about everything looks good displayed.
    --------------------
    Airconditioners

    ReplyDelete
  3. thank you very much gan , the article is very interesting that we can refer to.
    obat penyakit kuning pada orang dewasa

    ReplyDelete
  4. The information you have posted is very useful. The sites you have referred was good. Thanks for sharing..
    obat maag

    ReplyDelete
  5. Replies
    1. Menu Diet Diabetes Melitus. Diet Diabetes Melitus yang Mudah dan Gampang Dijalani. diet diabetes melitus pada saat puasa. Diet Diabetes Melitus yang Mudah dan Gampang Dijalani



      Pengobatan Hepatitis B Secara Tradisional dan Medis. Penyakit hepatitis b perawatan nya harus diperhatikan. Cara pengobatan hepatitis b. Pengobatan Hepatitis B Secara Tradisional dan Medis

      Delete
  6. nice post friend , Thank you for sharing with us, and we sincerely hope you will continue to update or post other articles
    cara jitu mengatasi vertigo kambuh mendadak

    ReplyDelete
  7. Spirit, to start a success
    Wapadai Bahaya Miom Di Rahim إن شاء الله تنجح بالتأكيد

    ReplyDelete
  8. Ciri Ciri Kelenjar Getah Bening Stadium 4,- Stadium 4 sering dikatakan pada penyakit jenis kanker ganas atau kanker yang sudah parah. Kata Stadium 4 sering menyerang pada hal yang benar-benar menakutkan. Stadium kanker adalah ukuran dari seberapa banyak kanker telah tumbuh dan menyebar.

    ReplyDelete
  9. Ciri Ciri Kelenjar Getah Bening Stadium 4,- Stadium 4 sering dikatakan pada penyakit jenis kanker ganas atau kanker yang sudah parah. Kata Stadium 4 sering menyerang pada hal yang benar-benar menakutkan. Stadium kanker adalah ukuran dari seberapa banyak kanker telah tumbuh dan menyebar.

    ReplyDelete
  10. Good afternoon, welcome to resume its activities :-)
    Cara Mengobati Maag Kronis

    ReplyDelete
  11. thank for information http://goo.gl/RHdvvB

    ReplyDelete
  12. thank for information http://goo.gl/udy0rE

    ReplyDelete


  13. افضل شركة نقل اثاث بالمدينة المنورة تساعدك على نقل اثاثك بامان فلا داعى للقلق مع افضل شركة نقل اثاث بجدة

    عزيزى العميل انت من محبى التنقل باستمرار بالتالى انت بحاجة ماسة وضروية الى الاستعانة بالمختصين في نقل العفش خاصة ارخص شركة نقل اثاث بالرياض لان الاستعانة باى من عمالة الشوارع الغير مدربة والتي لا تمتلك خبرة كافية في نقل العفش او الحفاظ علية وليس هذا فقط فقد يؤدى الاستعانة بعمالة الشوارع الى حدوث حالة فقدان وتكسير للاثاث بالتالى التاثير الضار عليك عزيزى العميل

    لا تقلق مطلقاً الان بشأن نقل اي منقولات خاصة بك طالما استعنت بشركة الاول لـ نقل الأثاث في الرياض وخارج الرياض فنحن ليس الوحيدون ولكننا متميزون عن اى مؤسسة أخرى داخل وخارج الدمام وشهرتنا كافضل شركة نقل عفش بينبع
    نقل اثاث بجدة

    ReplyDelete