View
 

UK Security Data

Page history last edited by cpatel 5 mos ago

Download the uksecurity.zip file. After the download is complete, you will need to extract the zip file to a local directory on your filesystem.

 

Assuming you have already signed up for a Sierra account, a few simple steps can be taken to push the UK Security dataset into Sierra.

First, you’ll need to grab our sample code. You can find the instructions for downloading our sample code here.

Once you have downloaded the sample code, look for the Ingest.java class (in the src/java directory). This is a command line tool that can be run from your JAVA IDE or as a compiled java application.

 

A few assumptions:

1) UK Security dataset will use the 'WS XML Raw' template. More information about templates can be found here.

2) Ingest.java is dependent on the jar files in the lib directory and JAVA SDK version 1.6

 

Ingest.java reads files from your local filesystem and wraps the data into a Resource XML  format. It then makes a REST call via an HTTP POST to create resources.

Running this application requires a few command line arguments. The sierra host name, access key and secret code should have been created when you signed up for your Sierra account.

 

required parameters:

   -shn ’sierrahostname’

   -fp  ‘filepath’ (file path/directory where you have downloaded and extracted the uksecurity.zip file e.g. “/Users/cpatel/saffronData/ukext”)

   -tn  ‘templateName’ (template which is used to translate data e.g. “WS XML Raw”)

   -sp ’spaceName’  (space where data is stored.  *If not specified ‘default’ is assumed.)

   -ak ‘accessKey’ (This is your accessKey for sierra service)

   -sc ’secretCode’ (This is your secret for sierra service)

 

optional parameter if you want to start over and clear your space first:

   -cs ’spaceName’ (Clears/deletes existing data from the specified space in Sierra)

 

Example invocation:

   java Ingest -shn my_username.saffronsierra.com -fp "/data" -tn "WS XML Raw" -ak my_sccess_key -sc my_secret_code

 

*Note: When you first start your Sierra service, the 'default' space is created automatically.  As a result, unless you need a space sith specific attribute mapping, the 'default' space will map all attributes to row/cols and the following attributes as memories:

 

                <attribute category="person" role="memory,attribute,signature"/>

                <attribute category="organization" role="memory,attribute,signature"/>

                <attribute category="city" role="memory,attribute,signature"/>

                <attribute category="state" role="memory,attribute,signature"/>

                <attribute category="country" role="memory,attribute,signature"/>

                <attribute category="company" role="memory,attribute,signature"/>

                <attribute category="facility" role="memory,attribute,signature"/>

                <attribute category="peoples" role="memory,attribute,signature"/>

                <attribute category="location" role="memory,attribute,signature"/>

                <attribute category="vehicle" role="memory,attribute,signature"/>

                <attribute category="currency" role="memory,attribute,signature"/>

 

After the program has returned successfully you can:

  1. Log into your SaffronAnalyst web application (http://my_username.saffronsierra.com:8080/analyst) to view your data (username=admin, password=saffron)
  2. Connect to http://my_username.saffronsierra.com:8080/harness to query your data via Saffron's REST tool (uses access/secret key for authentication)
  3. Write your own program to query the data

 

Typical queries with UK Security data:

  1. "london bomber"
  2. "train bombing"

 

Comments (0)

You don't have permission to comment on this page.