Turn on ye ole Javascript to add ratings in this low-budg app.

Scraping the Social Web

Event Interactive 2010
Format Panel
Organizer Philip (flip) Kromer infochimps.org
Description Call-and-response APIs give a dimestore telescope's view of the social web, but you need a detailed global perspective to see how ideas flow and communities grow. We'll show how to build your own Hubble: the practicalities of scraping and storing terabytes, exploring its structure, and visualizing the results.
Questions
Answered
  1. How to scrape efficiently, aggressively, and courteously
  2. Ten stupid data-management mistakes you shouldn't also make.
  3. Tools for processing social network graph data
  4. How do you measure social capital in a massive network?
  5. How can you cure some of the flaws with a naive pagerank approach?
  6. How do you identify community clusters in a massive network?
  7. How can you track the flow of topics across the network?
  8. How do you automatically resolve common elements in parallel social networks?
  9. How can I use machine learning techniques to extract semantic information from the content stream?
  10. What is the state of privacy, copyright and IP issues stand with respect to scraping social network data?
Level Advanced
Category Back-End Programming / Databases, Information Architecture, Social Networking