Bengfort.com

Keywords Visualization v2

See the live visualization at: http://www.bengfort.com/keywords/

Version 2 of the Bengfort.com Keywords Visualization is now complete. This new update includes tool tips (hover the mouse over a node and the tool tip appears) that describe the data in plain language- in this case, how many times the keyword appears in Bengfort.com (note that multiple appearances in a single post are all counted, as opposed to the number of posts that include the keyword, I hope my grammar was clear enough to explicate this). In addition, now the strength of the links is now visually shown via color and thickness. This actually expanded the graph, so I may have to refactor so it all fits on the screen. Finally, if you click on a node, it searches Bengfort.com for the last 7 posts that include the keyword and present those posts to you!

Additionally, the graph has now been made clearer. Link strength is identified on a 5 point scale, however I have excluded strengths of 1 or 2, this immensely cleans up the graph and only shows the most relevant links. While this means some links no longer appear, other connections have suddenly become more apparent. (I’m especially fond of the link between our disciplines and technology!)

This version finalizes the tutorial on SitePoint.com with modifications made to make it work for Bengfort.com. I know this graph is still far from perfect, and I intend to continue to explore making this application more usable. To that end, any feedback from you guys would be much appreciated! For instance, tell me what you see, and if there is anything I could do to make it better. (Remember, I don’t know what you see, I only see what is on my browser). If there is any functionality you think should be included, if there are any keywords you want added, please let me know! I know that it is easy to read the post and to forget about it, but the more you think about it, the better I can make it!

Once again, the link to the visualization is: http://www.bengfort.com/keywords/ check it out!

Data visualization of frequence of Bengfort.com keywords

See the live visualization and play with the Spring-Graph structure at: http://www.bengfort.com/keywords/

I’m constantly amazed about how people can manipulate data and statistics any way they see fit to make their own point. I don’t know about you, but whenever someone gives me the “numbers” I’m very skeptical of where they came from. Just consider the fodder from our so called major news networks that John Stewart has to make fun of! I think I’m right in saying that people are all too willing to believe “numbers” just because they look science-y or there is a pretty bar graph. Even simple inspection will reveal flaws- percentages that don’t add up to 100 or whose summation far exceeds 100. Graphs that use highlighting and weighted fonts that don’t necessarily apply to a distribution, or the simple omission of keys (legends) that would prove an opposite point.

That’s why the science (and art) of data visualization so appeals to me. We have learned bar graphs, line graphs, and pie charts since we were in elementary school, but these are the tools that are so often used to mislead us: simply because they are too simple to hold the complex data that we are now used to analyzing on a daily basis. Data visualization attempts to take complex data sets and graphically represent them in a way that humans can instantly comprehend their meaning. Visual cues including size, color, shape, and difference are all used to represent some form of data. With the growth of web technologies and web databases, an ever increasing number of amazing and interesting data visualizations has appeared, and soon I believe that elementary school kids will be taught even more complex data structures.

So, when I got a tweet from Sitepoint.com concerning building a keyword visualizer with Flex- I knew that this would be perfect for our website. So I read the article and built a version of what they used for our website! (Note that at this point, I’m still awaiting the third part of this three part series, and then I will continue to make my own customizations, so stay tuned for more updates with the visualization!) Essentially what is happening is that a script goes through our blog database and picks out keywords in all the posts. Keywords that appear in the same post are considered linked. For instance, by writing science and technology in this post together, those two words will now have a link between them. In addition the script counts the occurrences of the keyword as well as the occurrences of the links. (If you’re keeping score- this is a server side PHP script that outputs the results in a JSON file format).

The visualization is handled by Adobe’s Flex framework combined with the SpringGraph API. The more a keyword appears, the larger its nodes will be- in addition, the higher the count of links between keywords, the larger the link will be. Distance is also a factor- the larger keywords are on the outside, with the lesser keywords on the inside- they “repulse” each other by the strength of their links. Now, by simple inspection we can see that Guyana linked with Recipes and Cookbook- is by far the largest part of our website. Benjamin is connected to China and Ballet (don’t know why) while cat and dog are so closely connected that they are almost touching! You can see how this provides basically a topical analysis of our blog!

I know you guys may not find this particularly interesting, but I hope you can grasp how much data has been distilled into an easily viewable graph- we have over 600 posts in our blog, each with about 700 words in them- all distilled into an easily comprehensible visual medium. As our blog changes, so will the graph. I think that in all our fields- International Relations, Political Science, Anthropology, Business, International Education, and Computer Science- this is extremely relevant, and I hope that you guys will make use of the tools that I have shown you. (speaking of those fields, I should probably add them as key words!). If you are interested in doing any sort of complex visualization- trust me, I’m your guy to develop an application for you that will do it!

See the live visualization and play with the Spring-Graph structure at: http://www.bengfort.com/keywords/