[DPLAsteering] Harvesting/infrastructure proof of concept

Reese, Terry P. reese.2179 at osu.edu
Fri Dec 4 12:35:24 EST 2015


So I’m a big believer that it’s difficult to make the kind of commitments, technology decisions, metadata decisions, without trying things – it’s too easy to paint yourself into a corner when you don’t.  To that end, I’ve pulled down the code that the Penn Hub has created and got it running.  I harvested a handful of metadata collections from the Cleveland Memory Project (they are a CDM site – so it was easy) and have been looking at the results.

Now, the Penn tools use a couple of well-known technologies (and taking to the folks from NY – they are looking to switch to this approach as well), specifically Fedora, Hydra, and Blacklight.  They use old versions of each however.  So, I’ve been chatting with our devs here at OSU, and I’ll be taking some time this weekend and maybe next week, off and on, to see how difficult it would be to migrate this forward to a current version of the stack.

Here’s what I’m thinking – I’d like to get some OAI feeds from this group.  I don’t need a lot of data – but I’d like to get some OAI endpoints that I can test and aggregate.  If I can migrate this forward – I’ll likely stand up a very limited use (primarily for the steering committee and working groups) proof of concept page for folks to look at just to get an idea of one way that we could do aggregations, and also start looking at real-life metadata as represented through each institutions OAI servers.  If I can’t migrate the tool easily to the current Hydra/Fedora stack – I may still stand up what I have with the older tool, but with the caveat that I see this use of the older tool as a good deal of technical debt that would need to be overcome before I’d feel good moving in this direction.  But again, it would provide a way to evaluate what that technical debt might look at, and talk about the types of technical capacity we might need at a central hub, as well as again, see live metadata currently being served by our OAI servers.

Ideally, by our next steering committee meeting on the 18th, this is something we can talk a bit more about (or will be able to talk more comprehensively about it) if there is interest.

Best,

--tr
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.oplin.org/pipermail/dplasteering/attachments/20151204/fca74e4a/attachment.html>


More information about the DPLAsteering mailing list