DataSift integration with Genesys Social Engagement

Here we go again … time to develop a custom application to take a DataSift stream and integrate it into Genesys Social Engagement (http://genesysguru.com/blog/blog/2011/04/08/genesys-social-engagement/).

The first step was to sign up as an alpha tester. With 24 hours I received my invite:

Image

Now time to create some custom streams!

Configuration

1. Login to DataSift e.g. http://datasift.net

Image

2. Click on “Settings” to get my API key which I will need later to access my custom streams through the API:

Image

3. Click on “My Licenses” to setup Twitter stream licensing:

Image

4. Click on “My Streams” then “Create Stream” to create a new stream. Note that here I mark the stream as private:

Image

5. Create a stream definition (filtering rules) for this Stream using CSDL (Curated Stream Definition Language). Clicking on the Code Toolbox makes this relatively easy but don’t expect a full IDE like Visual Studio!

Image

Image

When I click on Save I get some important information – the unique key that will be used to access the stream later through the API:

Image

6. Having created a custom stream I can now click on the “Live” tab and see all live Tweets that match CDSL definition that I just created:

Image

7. If I click on “Use” I can get an estimated cost to consume this stream. In this case $0.35 / hour. Also note in the screenshot below that my stream definition is versioned:

Image

8. Finally, clicking on dashboard I can see all of my streams as well as the public streams created by other users:

Image

Image

Ok, so far so good!

All of that took less than 10 minutes. The web based GUI worked fine in Firefox (unlike Gnip) and was easy and intuitive to use. What I *really* like about this GUI is that it is simple enough for Business users to create and modify stream definitions and to see the results in realtime.

Versioning means that if Mr. Cockup is at home we can recover the situation! Also, the estimated cost to consume the stream means that budgets can be kept under control.

Right, back to techie land and a bit of C# coding to consume the stream via the DataSift API.

To be completed …

27/05/2011: DataSift Twitter feed has been down for 24 hours so development work stopped for now.

04/06/2011: Integration completed. Contacts and Interactions being created automatically. Just need to hook up a strategy to test out some auto reply functionality and then finish my custom social desktop application which uses the PSDK. Will post again with a demo ASAP.

Share