Forest: A language and toolkit for programming with filestores

Kathleen Fisher, Nate Foster, David Walker, Kenny Q. Zhu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Scopus citations

Abstract

A filestore is a structured collection of data files housed in a conventional hierarchical file system. Many applications use filestores as a poor-man's database, and the correct execution of these applications requires that the collection of files, directories, and symbolic links stored on disk satisfy a variety of precise invariants. Moreover, all of these structures must have acceptable ownership, permission, and timestamp attributes. Unfortunately, current programming languages do not provide support for documenting assumptions about filestores, detecting errors in them, or safely loading from and storing to them. This paper describes the design, implementation, and semantics of Forest, a new domain-specific language for describing filestores. The language uses a type-based metaphor to specify the expected structure, attributes, and invariants of filestores. Forest generates loading and storing functions that make it easy to connect data on disk to an isomorphic representation in memory that can be manipulated as if it were any other data structure. Forest also generates metadata that describes the degree to which the structures on the disk conform to the specification, making error detection easy. In a nutshell, Forest extends the rigorous discipline of typed programming languages to the untyped world of file systems. We have implemented Forest as an embedded domain-specific language in Haskell. In addition to generating infrastructure for reading, writing and checking file systems, our implementation generates type class instances that make it easy to build generic tools that operate over arbitrary filestores.We illustrate the utility of this infrastructure by building a file system visualizer, a file access checker, a generic query interface, description-directed variants of several standard UNIX shell tools and (circularly) a simple Forest description inference engine. Finally, we formalize a core fragment of Forest in a semantics inspired by classical tree logics and prove round-tripping laws showing that the loading and storing functions behave sensibly.

Original languageEnglish (US)
Title of host publicationICFP'11 - Proceedings of the 2011 ACM SIGPLAN International Conference on Functional Programming
Pages292-306
Number of pages15
DOIs
StatePublished - 2011
Event16th ACM SIGPLAN International Conference on Functional Programming, ICFP'11 - Tokyo, Japan
Duration: Sep 19 2011Sep 21 2011

Publication series

NameProceedings of the ACM SIGPLAN International Conference on Functional Programming, ICFP

Other

Other16th ACM SIGPLAN International Conference on Functional Programming, ICFP'11
CountryJapan
CityTokyo
Period9/19/119/21/11

All Science Journal Classification (ASJC) codes

  • Software

Keywords

  • Ad hoc data
  • Bidirectional transformations
  • Data description languages
  • Domain-specific languages
  • File systems
  • Filestores
  • Generic programming
  • Haskell

Fingerprint Dive into the research topics of 'Forest: A language and toolkit for programming with filestores'. Together they form a unique fingerprint.

  • Cite this

    Fisher, K., Foster, N., Walker, D., & Zhu, K. Q. (2011). Forest: A language and toolkit for programming with filestores. In ICFP'11 - Proceedings of the 2011 ACM SIGPLAN International Conference on Functional Programming (pp. 292-306). (Proceedings of the ACM SIGPLAN International Conference on Functional Programming, ICFP). https://doi.org/10.1145/2034773.2034814