Gain Analytics Agility on Apache Spark for IBM z Systems

  When people discuss real-time big data domains, rarely do they understand the realities of where daily transactional data occurs around the world. To give you an idea of the volumes we’re looking at, consider that for every second of the day worldwide, there are: 250 iTunes downloads 3600 Instagram photos taken 7000 Tweets sent 30000 Facebook likes 46000 YouTube […]

Read more

Native Python access to IPFS in Jupyter Notebooks

  In a previous post, we discussed using the new InterPlanetary File System (IPFS) protocol as a way to load data into Jupyter Notebooks. After experimenting with our previous example code for using IPFS, we decided that using IPFS would be more organic in a Notebook if you could use it from Python as a native library. The jStart team […]

Read more

Last Mile of Dashboard Development

In a world where “Big data is the new natural resource”, it is a must to create applications taking advantage of this new knowledge-full resource. Brave people started venturing into this unknown world, They are using new and exciting tools like Notebooks or Spark engines. However, developers are still banging their heads against a wall when time comes to build […]

Read more

Jupyter DeclarativeWidgets make data exploration easy!

Over the past year, we have built many demonstrations using declarativewidgets to create dashboards and good-enough applications in the Jupyter Notebook. We’ve discovered several patterns that are in great need of simplification. One of these patterns is data exploration. By data exploration, I mean the ability for the user to query and visualize a data set. In declarativewidgets, we make it simple to bind visual elements to […]

Read more

Visualizing Big Data with Spark and Scala

While exploring data analytics with Apache Spark, the team came to the realization that there are many Python examples, but resources for Scala are somewhat lacking. In particular, there are few data visualization examples in Scala. Python’s predominant visualization module is Matplotlib, but we struggled to find a Scala library that offered the same breadth of functionality and granularity of control. Brunel In our […]

Read more

Load Your Data Into a Jupyter Notebook

You’ve heard all the flashy statistics about big data, like how every day more than 2.5 quintillion bytes of data is created and that more data has been created in the last two years alone than every previous year combined (IBM). Here’s another one to add to the list: 99.5% of newly created data is never analyzed (MIT). Only half a […]

Read more

Using R and Declarative Widgets in Jupyter Notebooks

In previous blogs posts such as: Declarative Widget System for Jupyter Notebooks and Adding Declarative Widgets to the Jupyter Notebook we introduced what declarative widgets are, technologies involved, and walked through a use case driven by a survey on user experience conducted by the Jupyter community. The end result of our work is that practitioners in the R community are no longer limited to a static […]

Read more

InterPlanetary File System (IPFS) on Jupyter

The fundamental concept of IPFS is that instead of looking for locations, as with HTTP, you look for the content of a file.  (erisindustries) When you say Blockchain, Git, BitTorrent, I hear: Directed acyclic graphs (like git) with hashed hierarchical checkpoints (like a blockchain or merkle trees) distributed peer to peer (like bit torrent). This is literally what IPFS is, and […]

Read more

Using Remote Kernels with Jupyter Notebook Server

Jupyter Notebook uses kernels to execute code interactively. The Jupyter Notebook server runs kernels as separate processes on the same host by default. However, there are scenarios where it would be necessary or beneficial to have the Notebook server use kernels that run remotely. A good example is when you want to use notebooks to explore and analyze large data […]

Read more

Adding Declarative Widgets to the Jupyter Notebook

Web-based notebooks have proven to be an extremely popular medium for mining data and sharing valuable insights.  They combine a traditional development console with the robustness of the world-wide-web, but often fail to leverage the full web browser capabilities to provide a rich, interactive user experience. We will look at a case where the Jupyter Declarative Widget Extension was used […]

Read more
1 2 3