fr.paris.telecomParisTech.dbWEB.arcomem.wp5.appliocationAwareHelper.environmentsetting
Class DocumentLevel

java.lang.Object
  fr.paris.telecomParisTech.dbWEB.arcomem.wp5.appliocationAwareHelper.environmentsetting.DocumentLevel

public class DocumentLevel
extends Object

Sets the environment that stay alive until a given document is not processed completely.

Field Summary

static String	actiontype Current crawling action type.
static String	Applicationname Detected Web applicatoon name.
static URL	baseURL Base URL of a given Web page.
static String	cms_type Detected Content management type.
static String	crawlingaction detected crawling action.
static String	currentaction Current Crawling action.
static ArrayList	detect_level_rules web application level detection rules.
static String	detectedcms CMS Id
static String	detectedlevelexpression Web application detection pattern found in current web page.
static AugmentedDoc	doc Object of AugmentedDoc class.
static String	DocumentAsHTML Whole document as HTML.
static String	Documentlevel Level of the document.
static edu.berkeley.cs.db.yfilter.filter.EXfilterBasic	filterWALevelRules Filtering system object for detecting specific Web application level.
static String	hostURL Base URL of a given Web page.
static File	htmlFile Cleaned HTML file.
static int	levelfound 1 if level found else 0.
static ArrayList<String[]>	outLinksList Set of crawling actions (OutURL) as an arrayList that keeps anchor with text.
static ArrayList	parse_detect_rules_WA_Level parsing WA level detection rules into two parts structure and predicate.
static File	queriesFile_WA_Level Queries for Web application level detection as file.
static ArrayList	queryList_WA_Level list of Web application level detection queries.
static File	tempfile Temporary file object.
static ArrayList<String[]>	webObjectList Set of WebObjects as ArrayList.

Constructor Summary

DocumentLevel()

Method Summary

static void	cleanDocumentLevelVariables() clean the document level variables.
static String	detectWA_Level_with_NFA(File webResource) Detect the Web Application level using Yfilter filtering system that is based on NFA.
static void	loadfilteringsystem_with_WA_Level_DetectionRules() This method will load the filtering System by creating the NFA with set of Queries needs to detect level of a specific Web applicatins.
static void	parse_WA_Blog_Detection_rules() Parse detection patter for all possible level of Blog type of Web application.
static void	parse_WA_Forum_Detection_rules() Parse detection patter for all possible level of Web forum type of Web application.
static void	parse_WA_Micro_Blog_Detection_rules() Parse detection patter for all possible level of Micro Blog type of Web application.
static void	setAction(String expression) Set action and document level

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

actiontype

public static String actiontype

Current crawling action type.

Applicationname

public static String Applicationname

Detected Web applicatoon name.

baseURL

public static URL baseURL

Base URL of a given Web page.

cms_type

public static String cms_type

Detected Content management type.

crawlingaction

public static String crawlingaction

detected crawling action.

currentaction

public static String currentaction

Current Crawling action.

detect_level_rules

public static ArrayList detect_level_rules

web application level detection rules.

detectedcms

public static String detectedcms

CMS Id

detectedlevelexpression

public static String detectedlevelexpression

Web application detection pattern found in current web page.

doc

public static AugmentedDoc doc

Object of AugmentedDoc class.

DocumentAsHTML

public static String DocumentAsHTML

Whole document as HTML.

Documentlevel

public static String Documentlevel

Level of the document. e.g. list of forum, list of tweets, etc.

filterWALevelRules

public static edu.berkeley.cs.db.yfilter.filter.EXfilterBasic filterWALevelRules

Filtering system object for detecting specific Web application level.

hostURL

public static String hostURL

Base URL of a given Web page.

htmlFile

public static File htmlFile

Cleaned HTML file.

levelfound

public static int levelfound

1 if level found else 0.

outLinksList

public static ArrayList<String[]> outLinksList

Set of crawling actions (OutURL) as an arrayList that keeps anchor with text.

parse_detect_rules_WA_Level

public static ArrayList parse_detect_rules_WA_Level

parsing WA level detection rules into two parts structure and predicate.

queriesFile_WA_Level

public static File queriesFile_WA_Level

Queries for Web application level detection as file.

queryList_WA_Level

public static ArrayList queryList_WA_Level

list of Web application level detection queries.

tempfile

public static File tempfile

Temporary file object.

webObjectList

public static ArrayList<String[]> webObjectList

Set of WebObjects as ArrayList.

Constructor Detail

DocumentLevel

public DocumentLevel()

Method Detail

cleanDocumentLevelVariables

public static void cleanDocumentLevelVariables()
                                        throws IOException

clean the document level variables.

Throws:

IOException

detectWA_Level_with_NFA

public static String detectWA_Level_with_NFA(File webResource)
                                      throws IOException,
                                             XPathExpressionException,
                                             ParserConfigurationException,
                                             SAXException,
                                             org.htmlcleaner.XPatherException

Detect the Web Application level using Yfilter filtering system that is based on NFA.

Parameters:

webResource - A given Web page.

Returns:

Id of the detected Content Management System.

Throws:

IOException

XPathExpressionException

ParserConfigurationException

SAXException

org.htmlcleaner.XPatherException

loadfilteringsystem_with_WA_Level_DetectionRules

public static void loadfilteringsystem_with_WA_Level_DetectionRules()
                                                             throws IOException

This method will load the filtering System by creating the NFA with set of Queries needs to detect level of a specific Web applicatins.

Throws:

IOException

parse_WA_Blog_Detection_rules

public static void parse_WA_Blog_Detection_rules()
                                          throws XPathExpressionException,
                                                 ParserConfigurationException,
                                                 SAXException,
                                                 IOException

Parse detection patter for all possible level of Blog type of Web application.

Throws:

XPathExpressionException

ParserConfigurationException

SAXException

IOException

parse_WA_Forum_Detection_rules

public static void parse_WA_Forum_Detection_rules()
                                           throws XPathExpressionException,
                                                  ParserConfigurationException,
                                                  SAXException,
                                                  IOException

Parse detection patter for all possible level of Web forum type of Web application.

Throws:

XPathExpressionException

ParserConfigurationException

SAXException

IOException

parse_WA_Micro_Blog_Detection_rules

public static void parse_WA_Micro_Blog_Detection_rules()
                                                throws XPathExpressionException,
                                                       ParserConfigurationException,
                                                       SAXException,
                                                       IOException

Parse detection patter for all possible level of Micro Blog type of Web application.

Throws:

XPathExpressionException

ParserConfigurationException

SAXException

IOException

setAction

public static void setAction(String expression)

Set action and document level

Parameters:

expression - XPath expression