Tuesday, July 2, 2013

2nd GraphLab workshop is over!

  • Thanks to the 570 data scientists who joined us, thanks for the great speakers and of course to our sponsors. We hope to post the talks videos online soon.



    Looking forward to next year's workshop!

    And Here are some twits about the workshop...

    "GraphLab is a graph-based, high performance, distributed computation framework written in C++."
  • Today in San Francisco: 'Graphlab "Big Learning" Workshop' @ 7:00 AM
  • It was mostly about systems such as new version of graphlab, graph builder, naiad, grappa, etc. Not many papers tho
  • Who best addresses Graph isomorphism. or , discussed this riddle with .
  • RT : I just posted my slides about Naiad from the workshop
  • It just occurred to me that wants to be another -- it asks questions we answered in Seattle in mid-2000s...
  • the evolution of technology platforms posibility -> scalability -> usability - Carlos Guestrin
  • Thanks to all that attended the 2nd Annual GraphLab Workshop! What a great success!!
  • My favorite talk: Pankaj's on Cassovary. We use and can pick it up tmrw! Just stick it all into RAM.
  • graphlab-code/graphlab .. Distributed graph computation framework .. via
  • I just posted my slides about Naiad from the workshop via
  • Walmart Labs recommendation beyond similarity. You do NOT want to recommend a similar TV right after a user purchased TYVM!
  • Great to see former twitter intern presenting right after me (on some of the work inspired by his twitter internship)
  • Predicting drug-target interactions using Latent Factor models by Murat Can Conbanoglu, Balestra, CMU 45% hit
  • Interesting, 40% as many unfollows as follows daily
  • listening to at discussing the who to follow system at twitter 400 million tweets/day
  • Naiad by . IMHO MSFT research has terrific NoSQL technologies. Shame Redmond bigwigs keep pushing SQLServer for revenue.
  • Graph overload for me. But still Hash to min algo for graphs in is the best.
  • Beyond Pregel - Disclaimer: Focus on algorithmic methods. By looking for large-scale over lapping clusters using MR and ASYMP
  • RT : Heheeheh Facebook presenter - cheeky! Love it. workshop
  • workshop talk by Dr. Avery Ching, Facebook – Graph Processing at Facebook Scale.rocking it Trillion graph edges!
  • Time for graph talk by in workshop
  • Ted Willke: is fast but getting appropriate data into shape for it is hard/slow. Nodding.
  • Any / BDAS people at today? Would love to chat about an integrated solution for ETL, exploratory, OLTP, graph processing
  • at Workshop ( ) today, stop by and talk to us during the poster session
  • Intel GraphBuilder talk, committed to open source
  • My stochastic eyeballs regressed 500 heads of hair trend black. Blonds, redheads, gray beards are outliers. Lunch!
  • Support for interactive data analysis in version 3 is an exciting direction for the startup to take. Can't wait to try it myself.
  • RT : *mind melted* Stoachastic approximation - holy smokes
  • workshop. Never occurred to me that ML can be domain blind and data schematic ignorant.
  • Python journal for : can't wait to play with it.
  • Dr. and Dan LaRocque are at 2013. Stop by to talk about the Titan/Faunus
  • 570 tickets sold! The 2nd Annual GraphLab Workshop is a great success!!
  • Lot of graph engine frameworks seem 2b taking route of parallel iterators n complex but transparent data structure
  • GL v1 Possibility | GL v2 Scalability | GL v3 Usability. opening the workshop to 500 Graphistas
  • Are you at the GraphLab workshop? I'd be glad to chat with you after this morning's talks.
  • Met buncha people from smart startups at GraphLab. Not a single person from stupid ones!
  • 'The number of people predicting the demise of Moore's law doubles every year.'
  • Be sure to check out our poster presentation today at in San Francisco! Click link for event info:
  • Graphlab 3 looks like it Is going to be awesome...
  • Python console for 3 to play around. So cool!
  • Scalability + Usability: GraphLab 2.2 is out Loving the live demo - python console, streaming graphs, & more
  • accessed using IPython notebook. Nearly seamless transition between distributed computing and numpy/matplotlib.
  • new site has an interface to spin up a EC2 cluster and access it via ipython notebook. getting a live demo now at the workshop :)
  • Graphlab 2.2 makes it extremely easy to get started using web interface. No installation needed! Will make it fun to play around
  • GraphLab 2.2 will be released today. Including a new awesome programming model (WarpGraph).
  • Not at , but hello anyway :) Hope you are well!
  • Looking forward to talking at workshop this afternoon. If you are there, please say hello.
  • I am giving short GraphChi talk at the great workshop today at 4pm.
  • Looking forward to talking about Naiad at the workshop this afternoon!
  • speaking about Adaptive User Segmentation for Recommendation at the Workshop () in Mon 7/1!
  • Time came for workshop in SF
  • At the workshop. Interesting mix of people here
  • Will be late for workshop for sure, no BART, :(
  • Beautiful day in SF! Checking into .
  • We're giving away GraphLab tee shirts away at registration.
  • I just checked in our first event attendee. The 2nd Annual GraphLab Workshop begins!! !
  • Wednesday, June 26, 2013

    Shark @ SIGMOD workshop

    Got this from my collaborator Joey Gonzalez, who attended Reynold's Shark talk at SIGMOD GRADES workshop.

    Shark is an SQL engine on top of map reduce. Shark exhibits some interesting marriage of analytics with SQL. Here is an example of logistic regression:
    And some performance numbers:


    Detailed information about experiment setup can be found in their results page. Thanks to my collaborator Chris DuBois for sharing!

    Do you want to meet Reynold Xin and ask him about Shark? Well, as you properly guessed right, Reynold will attend our GraphLab workshop Monday July 1st in SF, presenting GraphX, a graph processing system on top of Spark. 

    Sunday, June 23, 2013

    GraphLab Image Processing Toolkit - Image Stitching (CloudCV)

    We got some exciting news from Dhruv Batra from Virginia Tech:

    Dear Graphlab team,

    As most of you know, I was working on the Graphlab computer vision toolbox last summer. The motivation behind it was to provide distributed implementations of computer vision algorithms as a service. 

    In that spirit, I am happy to announce that that my students and I have a produced a first version of CloudCV. 

    -- In the first version, the only implemented algorithm is image stitching
    -- The front-end allows you to upload a collection of images, which will be stitched to create a panorama. 
    -- The back-end is a server in my lab running our local repository of graphlab
    -- We are currently running stitching in shared-memory parallel mode with ncpus = 3. 
    -- The 'terminal' in the webpage will show you familiar looking messages from graphlab. 


    Cheers,
    Dhruv
    And here are some images you can use if you want to try the image stitching software:




    Are you interested in learning more about CloudCV? Join our July 1st SF workshop, where Harsh Agrawal from Virginia Tech will present a demo of CloudCV.

    Wednesday, June 19, 2013

    Last chance registration to the 2nd GraphLab Workshop

    We are having a great demand for this year's 2nd GraphLab workshop (Monday July 1st in SF): already 378 383 467 registrations and growing quickly. Please register ASAP here: http://glw2.eventbrite.com before we are sold out!
    Some updates about the agenda. We are constantly working to include the most interesting projects in the area of big data analytics, graph processing and graph databases. Some new content that was added in the last couple of weeks:

    New demos:
    • Zach Solan from Coderbot, one of the most exciting stealth startups, will demo their autmatic machine learning robot, who automatically selects features, algorithms and tunes paramters. 
    • Francisco Martin, Poul Petersen and Adam Ashenfelter will demo bigML
    • STINGER is a streaming graph analytics package from Georgia Tech.
      Jason Riedy from Georgia Tech will demo stinger.
    • MapR demo - to be announced soon
    New posters:
    • Eriko Nurvitadhi will present a poster of GraphGen
    • Paul Hoffman from SaffronTech will present a poster about threat prediction for the Gates foundation
    • Eiko Yoneki (Universityof Cambridge); Amitabha Roy (EPFL) - Scale-up Graph Processing: A Storage-centric View 
    New talks:
    • Additional oral talk by S V N Vishwanathan, Purdue - NOMAD: Non-locking stOchastic Multi-machine algorithm for Asynchronous and Decentralized matrix factorization
    New sponsors: we would like to thanks the new additional sponsors:
    • Pandora Internet Radio
    • Quid.com
    • Reservoir Labs
    • Neo4j
    • LexisNexis will sponsor lunch!
    • Intel Labs just joined as our Platinum sponsor!!


    Friday, June 7, 2013

    Stinger project

    My colleague Ben Lorica from O'Reilly Media send me a link to the Stinger project. It is an interesting streaming graph processing framework from Georgia Tech. If you like to learn more about this project, you should attend our 2nd GraphLab workshop, as I have invited Dr. Jason Riedy to present Stinger at our workshop.

    Here are the design objectives of Stinger (taken out of their website):
    • Portability: Algorithms written for STINGER can easily be translated/ported between multiple languages and frameworks
    • Productivity: STINGER should provide a common abstract data structure such that the large graph community can quickly leverage each others' research developments. This is similar in philosophy to the numerical algorithms community implicit use of sparse and dense matrices.
    • Performance: It is recognized that no single data structure is optimal for every graph algorithm. The objective of STINGER is to configure a sensible data structure that can run most algorithms well

    Sunday, June 2, 2013

    Notable presentations at Technion TCE conference 2013: RevMiner & Boom

    I found two interesting talks at the TCE conference. 

    The first by Prof. Oren Etzioni from University of Washington on the RevMiner system. RevMiner is used for mining Seattle text restaurant reviews obtained from Yelp!. The results where published in UIST paper in 2012: http://turing.cs.washington.edu/papers/uist12-huang.pdf
    In a nutshell, they look for tokens and their relations in the text, and you can ask questions like "good sushi @ seattle" and find a recommendation based on user reviews.  They are trying to compete in Yelp! business prediction contest I wrote about here. I wonder how they system will perform. 

    They further have some nice UI which is a color bar which summarizes the level of different ratings, and for each recommendation you can understand how it was created by browsing the original reviews. 

    Another related paper of text mining twitter data: http://turing.cs.washington.edu/papers/kdd12-ritter.pdf

    The second interesting talk, by Yoram Singer from Google, is about a system called Boom. The context is classification performed on ads, to decide which ad the user will click. The binary features of the ad are from a very high dimensional space, but are very sparse. 

    Boom uses a very simple parallel coordinate descent for optimizing a cost function which is a sum of convex functions. The main trick is speeding up Nesterov method of accelerate gradients by using the fact the data is highly skewed.

    An update: just got a note from my reader Patrick Durusau, with a link to Boom video lecture. Thanks Patrick!