Friday, July 11, 2014

10 days for large scale recommender systems workshop (LSRS) submissions

Submission deadline is July 21. We are looking for applied submissions (either in a short paper or a presentation format):

The workshop is part of RecSys 2014, a was the largest workshop last year.

Wednesday, July 9, 2014

O'Reilly blog post about GraphLab Conference

Is here. I remind all the lazy people who did not register yet, they are welcome to use discount code: Dannysblog for getting 20% discount when registering. The event will take place on Monday July 21 at the Nikko Hotel San Francisco.

Thursday, June 26, 2014

Sunday, June 22, 2014

Interesting taxi rides dataset

I got the following from my collaborator Zach Nation. NY taxi ride dataset that was not properly anonymized and was reverse engineered to find interesting insights in the data.

For the sport, I have used GraphLab Create to load and analyze this dataset. I started with an image of some NY taxis:

 Using GraphLab Create I was able to reverse engineer the anonymizaiton and query the data based on the medallion number (for example 8J77 for the lower left taxi in the image).

I was further able to dig into personal details based on the medallion number:
And finally ask questions like how much money the taxis in the image made in a certain week?
Anyone who wants to try it out is welcome to email me, I can send you the ipython notebook to play with.

Monday, June 16, 2014

Be a detective with GraphLab create! Follow bitcoin money transactions to reveal a criminal!

Just got a note from my collaborator Brian Kent, who just related a new notebook which shows how to analyze Bitcoin money transactions using GraphLab Create. Using this notebook, Brian is trying to reveal a thief who stole 25,000$ Bitcoin money. Here is a graph of some of the thief transactions:

To learn the rest of the story you will need to read the full notebook.

Related blog posts: Graph analytics is a promising tools for fraud detection and security. Recently, Cisco announced that GraphLab is part of their security stack. PNNL is using GraphLab for its cyber security projects. Lab41 (US gov. research lab) combines Titan and GraphLab for a powerful social graph analytic tool.

Saturday, June 14, 2014

Community detection survey by Lab41

Just got my hands on the community detection survey made by Lab41. A very comprehensive overview of the popular and useful methods to know. Some of the included methods are Girwan Newman, Infomaps,  Fast Unfolding, Cesna and many more.

One of the interesting algorithms is BigClam:

Friday, June 13, 2014

Lab41 releases open source code for GraphLab + Yarn integration

Just heard from Erik Tryzlaar from Lab41, that a new github open source project called Twill is alive. The project allows for running GraphLab tasks on a Hadoop 2.0 cluster which supports Yarn.

To remind, Pivotal have also their own wrapper which allows for running GraphLab on their Hadoop cluster, as part of their HD project.

A lot of exciting activities from different parties who are helping to make Graphlab Hadoop compatible! We will also release some news from GraphLab about this direction soon.