The grailbio/base project includes all the packages used by many other grailbio Go packages:

• API documentation: godoc.org/github.com/grailbio/base

• Issue tracker: github.com/grailbio/base/issues

• 

• recordio: encrypted and compressed record oriented files with indexing support

• file: unified file API for the local file system and S3

• digest: common in-memory and serialized representation of digests

• data: support for measuring and displaying quantities of data

• intervalmap: fast interval tree

• limiter: concurrency limiter with context support

• traverse: concurrent and parallel slice traversal

• state: file-based state management

• syncqueue: various flavors of producer-consumer queues

• unsafe: conversion from []byte to string, etc.

• compress/libdeflate: efficient block compression/decompression

• bitset: []uintptr bitset support

• simd: fast operations on []byte

• tsv: simple and efficient TSV writer

• cloud/spotadvisor: provides an interface for fetching and utilizing AWS Spot Advisor data

• cloud/spotfeed: provides interfaces for interacting with the AWS spot data feed format for files hosted on S3