Native Python access to IPFS in Jupyter Notebooks

  In a previous post, we discussed using the new InterPlanetary File System (IPFS) protocol as a way to load data into Jupyter Notebooks. After experimenting with our previous example code for using IPFS, we decided that using IPFS would be more organic in a Notebook if you could use it from Python as a native library. The jStart team […]

Read more

To Swiftly Go: An Adventure in Terabytes

We’ve been working with the SETI Institute to analyze massive quantities of radio data generated by their telescope array. Each telescope observation generates multiple 2.5 Terabyte files in just a few hours, and they want to use cloud-based analytics tools like Apache Spark to gain insight from it. A prerequisite for using cloud analytics on a dataset is, naturally, that the data needs […]

Read more