Big Data Solutions Through Intermediate Staging and Better Visualization

Machine learning

Big Data Solutions Through Intermediate Staging and Better Visualization

This week’s blog is the start of a Charter Global three part series focusing on how the minds of the BI/BD/Tech stakeholders can come together through visualization, specifically, through the intermediate steps. This week we start by setting the ‘stage’.


We stage a traditional business development quad chart with two visuals: a pie chart for the BD side and signal processing slides from the tech side. We show how we took a GB of information, used a trick in compressive statistics, in order to partition the data for the business group. The quad chart does not give the solution, rather, it gives the starting point to discussion and the intermediate plots are the key to enriching the takeaways for all stakeholders.


An oil company worked with the US Government and a group of educational institutions in what was called the LADC experiment. The project involved recording ambient noise in the Gulf of Mexico in the context of seismic surveying (blasting underwater) and its effect on ocean life.


The bottom rectangular blue plot represents a left to right 24 hour block of sound pressure recorded on a sonobuoy. Is this Big Data? Yes! The buoy recorded 12,000 pressure points per second, for 24 hours. Each point required two bytes of memory to store the pressure and meta-data. That equates, roughly, to 1 Gb of stored memory. Now in fact, there were actually three buoys recording at that rate, but for 30 days. Certainly, it would be difficult to listen to the whole sound recording. To look at the raw data meant looking at the bluerectangle. Rather than blindly reaching into the data set to start the analysis that would answer business directives, a series of specialized signal processing compression techniques were used to engineer a better visualization. Those results are shown in the rectangle above the blue one. The new rectangle appears with a series of contrasting vertical strips and blocks of colors. These strips and blocks were then partitioned into five groups. The five groups were presented in a pie chart to the BD/BI team. Now the horizontal line segments that separate the business side from the technology side represents an artificial, but somewhat real, division between the two groups. However, when the pie chart was handed over, there were relevant accompanying tag lines such as: stormy weather, ships passing, calm weather, pre-deployment, and seismic exploring. It began dialogue between business and technology; which partition(s) of the Giga-Bite pie offer the best ROI.




Next week, the second blog in this series, will focus on a task-solution system, again with intermediate steps. The process description will highlight when and where the stakeholders contribute their portion to the Eco-System depicted in the center; the place where understanding comes together and new ideas and directives emanate from. Finally, in the third and final part of this series we will show Big Data from another stakeholder’s point of view. A stakeholder that is yet to be truly recognized and appreciated for what it is doing: The Computer. In this blog we offer a look into how the computer ‘senses’ Big Internet Traffic internal to the human endpoints. Basically, social media for the computers. Stay tuned!


Have a question for our experts? Leave us a comment below, check out our Big Data page or contact our team directly at at

No Comments

Post a Comment


11 − seven =

Stay Updated!

Sign up to receive our latest blogs and news. Join our community to receive our content first.