We Want You in Yard!

[PeterKraus]

In this discussion, we'd like to keep tabs on upstream packages and libraries containing Extractors that we would like to see in Yard in the short-to-medium term.

Feel free to contribute ideas for packages, or let us know about your tool that you would like to register. See also the Contributing Guidelines for Yard.

One thread per package, please.

[PeterKraus]

SEM-Mapping-Tool

• https://github.com/kit-data-manager/SEM-Mapping-Tool, @reetuelzajoseph
• This is a great example as it takes a generic format (TIF), specialises it into TIF files produced by Zeiss instruments for SEM, and extracts metadata in a way that is beyond what a "casual" parser would do (OCR on the metadata in the image, rather than just reading a file) -- it also has a well-defined set of schemas already!

[PeterKraus]

ixdat

• https://github.com/ixdat/ixdat, @ScottSoren
• We have had some preliminary discussion over at Connection / contribution to the MaRDA metadata extractors registry ixdat/ixdat#152, I think now might be the time to see if we can put something together.

[PeterKraus]

Scythe

• https://github.com/materials-data-facility/scythe, @WardLT
• Some preliminary disussion, including Logan's presentation of the Scythe framework at one of our monthly meetings.

[PeterKraus]

RosettaSciIO

• https://github.com/hyperspy/rosettasciio, @CSSFrancis
• Previous discussion here.
• We have the basic Extractor implemented, but some work might be useful on adding more of the supported FileTypes.

[PeterKraus]

battery-data-toolkit

• https://github.com/ROVI-org/battery-data-toolkit, @WardLT
• Identified previously here, super interesting as it seems to cover data sources not available in the two electrochemistry parsers we have in Yard already.

[PeterKraus]

formaTAPIRest

• https://github.com/NFDI4Chem/formaTAPIRest, @SteffenBrinckmann
• Possibly good as a docker prototype.
• Is it still developed/maintained, Steffen?

[SteffenBrinckmann]

@PeterKraus, from my point of view: it was one test balloon that did not make it very far. As far as I know, nothing happened since.
It might still make sense to have something like that.

[PeterKraus]

Larch

• https://github.com/xraypy/xraylarch, @newville
• Actively developed toolkit for processing X-ray spectroscopy data, with extractors from several filetypes.
• Good candidate for a conda-based install, see: https://xraypy.github.io/xraylarch/installation.html#install-conda

[newville]

@PeterKraus perhaps it makes sense to separate "data ingester codes for tools related to X-ray absorption or other synchrotron data methods" from the code to work with those data? That might be something we are willing to do on our end -- we have a few related and overlapping discussions about on our end too.

[PeterKraus]

Project Chameleon

• https://github.com/paradimdata/project_chameleon, as @davidelbert just reminded me

[ml-evs]

https://gitlab.com/opensourcelab/scientificdata/labdatareader -- raised in the MADICES discussion today Mark Doerr (https://gitlab.com/markdoerr) (also @markdoerr on GitHub, I think?)