Outlier Recognition via Linguistic Aggregation of Graph Databases

Abstract

Datasets frequently contain uncertain data that, if not interpreted with care, may affect information analysis negatively. Such rare, strange, or imperfect data, here called “outliers” or “exceptions” can be ignored in further processing or, on the other hand, handled by dedicated algorithms to decide if they contain valuable, though very rare, information. There are different definitions and methods for handling outliers, and here, we are interested, in particular, in those based on linguistic quantification and fuzzy logic. In this paper, for the first time, we apply definitions of outliers and methods for recognizing them based on fuzzy sets and linguistically quantified statements to find outliers in non-relational, here graph-oriented, databases. These methods are proposed and exemplified to identify objects being outliers (e.g., to exclude them from processing). The novelty of this paper are the definitions and recognition algorithms for outliers using fuzzy logic and linguistic quantification, if traditional quantitative and/or measurable information is inaccessible, that frequently takes place in the graph nature of considered datasets.

1. Introduction

In collecting and processing information, there appear some uncertainties, mostly incomplete or imprecise data. Sources of uncertainty are usually measurements, probabilistic (stochastic uncertainty), lack of credibility, and linguistic descriptions (natural language uncertainty). To take care about such data, that, although strange, may contain valuable and exceptional information, one can consider them to be outliers . An “outlier” or “exception” (also: deviation, anomaly, aberration, etc.) means an observation that is rare, special, unique, unexampled, or infrequent. These terms mean that properties of interest possessed by outlying objects, are specific to recipients considering/processing them. Outliers are especially noticeable as highlighted or unusual observations on a background of numerous phenomena/objects similar one to another, typical, or ordinary. Unrecognized outliers in data exploration and mining, may decrease reliability of analysis, increase data imprecision and noise. In other words, outlying objects may distort or blur the final gists or meaning of collections analyzed. On the contrary, appropriately recognized outliers can bring unique information on change of activities and congestion in networks or intrusions into them, illegal use of debit/credit cards, serious damages of production lines, rapid changes of patients’ health status and parameters of medical devices, etc.

The literature enumerates various definitions of outliers, mostly subjective, intuitive, and dependent on different numerical characteristic showing “how much” considered objects are atypical for analyzed databases or sets. For example, the definition of outlier by Hawkins, the most frequently quoted, is [1] “An outlier is an observation which deviates so much from the other observations as to arouse suspicions that it was generated by a different mechanism”. Additionally, in [1], an outlier is defined as: “any object x in the space $\mathcal{X}$, which has some abnormal, unusual characteristics in comparison to other objects from $\mathcal{X}$”. Next, in [2], the authors say that outliers are “noise points outside the set which determine clusters”, or, alternatively, as “points outside the clusters but separated from the noise” . Next, according to [3,4], “a point p in a data set is an outlier with respect to parameters k and $\lambda$, if no more than k points in the data set are at a distance $\lambda$ or less from p”, with $k\in \mathbb{N},\lambda \in \mathbb{R}$. The $\lambda$ parameter can be interpreted in terms of relations between objects in $\{x_1$, …, $x_N\}$, $N\in \mathbb{N}$, not only as a metric, distance, a semantic connection (e.g., similarity as a binary fuzzy relation), etc. Moreover, another definition for outliers are worth mentioning from  [5,6,7], and global and local outliers proposed in [8,9,10]. Interesting applications and techniques as far as approaches mixing outliers detection with clustering methods are proposed in  [11,12]. Outliers in data streams (series or linear structures) are considered in [13]. Recognition of outliers is also the subject of consideration in  [3,14,15] and many other.

The most important idea on the above literature review, is that it does not provide one objective or axiomatic definition of an outlier at all. This is the specificity of this domain of research: outliers can be defined in different manners, with different characteristics and parameters, and in specific relations to particular problems, issues, datasets, etc. Thus, in this contribution, we focus on outliers defined in terms of linguistic quantification and fuzzy sets  [16,17,18,19], since no publications on outliers handled this way can be found. Recognizing outliers via fuzzy quantification and linguistic information can be useful when numerical information and traditional quantitative terms are inaccessible for a given set of objects. In such situations, the only information to detect anomalies is human experience and expert knowledge expressed linguistically (which is, in general, a common and obvious reason to apply fuzzy systems and techniques in various issues). Moreover, in our previous papers we focused on outliers in relational databases, and now, the main novelty of the paper is a successful attempt of using the methods for graph-oriented datasets. It is worth mentioning that graph datasets are frequently applied in circumstances in which relational structures are insufficient or unable to represent data and their meaning properly to the required context (e.g., in Customer Relationship Management Systems, CRM, or in social media).

The paper is organized as follows: Section 2 is a list of preliminary definitions and operations in fuzzy logic and the linguistic quantification of statements. Section 3 reminds our definitions for outliers in terms of linguistic information and, based on these definitions, algorithms for outlier detection/recognition. The specificity of preprocessing graph datasets to use fuzzy methods of recognition is illustrated in Section 4. An implemented example of outliers recognition is given to show how the proposed methods work on real graph datasets (here: a database on consumer complaints in a CRM system in a bank [20]) in Section 5. Finally, in Section 6, we discuss on future possibilities of works in the field presented.

2. Fuzzy Sets and Linguistic Quantification of Statements

In this section, we briefly review the basics of the linguistic quantification of statements in the sense of Zadeh [21]. A fuzzy set A in a finite non-empty $\mathcal{X}=\{x_1,\dots ,x_N\}$, $N\in \mathbb{N}$, is denoted as $A=\{\langle x,{\mu }_A\left(x\right)\rangle :x\in \mathcal{X}\}$, and ${\mu }_A:\mathcal{X}\to [0,1]$ is its membership function. The intersection of fuzzy sets A, B in $\mathcal{X}$ is a fuzzy set $A\cap B$ in $\mathcal{X}$:

$$\begin{array}{c}\hfill {\mu }_{A\cap B}\left(x\right)=t({\mu }_A\left(x\right),{\mu }_B\left(x\right)),\end{array}$$

(1)

where t is a triangular norm, e.g., min or product. The cardinality of A, the so-called $\Sigma$count$\left(A\right)$, sigma-count, is defined as [22]:

$$\mathrm{card}\left(A\right)=\Sigma \mathrm{count}\left(A\right){=}_{df}{\sum }_{x\in \mathcal{X}}{\mu }_A\left(x\right).$$

(2)

A relative cardinality of A with respect to a fuzzy set B is proposed:

$$\begin{array}{c}\hfill \mathrm{card}\left(A\right|B){=}_{df}\frac{\mathrm{card}(A\cap B)}{\mathrm{card}\left(B\right)}.\end{array}$$

(3)

For fuzzy set A in a continuous and uncountable universe of discourse $\mathcal{Y}$, the following counterpart of (2) is proposed:

$$\mathrm{clm}\left(A\right){=}_{df}{\int }_{y\in \mathcal{Y}}{\mu }_A\left(y\right)dy,$$

(4)

where “clm” comes from “cardinality-like measure”. Finally, the support of A in $\mathcal{X}$ is a non-fuzzy set in $\mathcal{X}$:

$$\begin{array}{c}\hfill \mathrm{supp}\left(A\right)=\{x:{\mu }_A\left(x\right)>0\}.\end{array}$$

(5)

The generalized support of A is called $\alpha$-cut, alpha-cut, and replaces the right side of inequality in Equation (5) with $\alpha \in [0,1]$: $A_{\alpha }=\{x:{\mu }_A\left(x\right)>\alpha \}$. Alpha cuts are non-fuzzy sets and they are necessary to define the convexity of fuzzy set A in $\mathcal{X}$: A is convex in $\mathcal{X}$ iff each of its alpha-cuts is convex non-fuzzy set. A in $\mathcal{X}$ is normal iff ${sup}_{x\in \mathcal{X}}{\mu }_A\left(x\right)=1$.

Assume, S, W are linguistically expressed characteristics of objects, represented by fuzzy sets in a finite $\mathcal{D}$$=\{d_1,d_2,\dots ,d_N\}$, $N\in \mathbb{N}$. Q is a relative fuzzy quantifier describing quantities of objects as ratios to a superset (usually, the universe of discourse of Q), e.g., “many of”, “about 1/3”, “less than half”, “very few”, and Q is modeled by a fuzzy set that is convex and normal in $[0,1]$ [23] (see Equations (23)–(25) as examples of relative fuzzy quantifiers). The first and the second form of linguistically quantified statements by Zadeh [21], are:

$$\begin{array}{cc}\hfill & \mathit{Q }{d}^{\prime }\mathrm{s} \mathrm{are}\mathit{ S},\end{array}$$

(6)

$$\begin{array}{cc}\hfill & \mathit{Q }{d}^{\prime }\mathrm{s}\mathrm{ being}\mathit{ W}\mathrm{ are}\mathit{ S},\end{array}$$

(7)

respectively. Their degrees of truth in terms of fuzzy logic are evaluated via Equation (3) as:

$$\begin{array}{cc}\hfill & T\left(\mathit{ Q}{\mathit{ d}}^{\prime }\mathrm{s}\mathrm{ are}\mathit{ S}\right)={\mu }_Q\left(\mathrm{card}\left(S\right|\mathcal{D}\right),\end{array}$$

(8)

$$\begin{array}{cc}\hfill & T\left(Q{\mathit{ d}}^{\prime }\mathrm{s}\mathrm{ being}\mathit{ W}\mathrm{ are}\mathit{ S}\right)={\mu }_Q\left(\mathrm{card}\left(S\right|W\right).\end{array}$$

(9)

It must be noticed that in the context of detecting outliers, only the so-called regular relative linguistic quantifier Q with the monotonically non-increasing ${\mu }_Q$ is taken into account, i.e.:

$$\begin{array}{cc}\hfill & {\mu }_Q\left(0\right)=1,{\mu }_Q\left(1\right)=0,\end{array}$$

(10)

$$\begin{array}{cc}& {\forall }_{x_1,x_2\in [0,1]}{x}_1\le x_2⟶{\mu }_Q\left(x_1\right)\ge {\mu }_Q\left(x_2\right).\end{array}$$

(11)

Moreover, quality of the fuzzy quantified statements can be additionally evaluated with the given measures of quality of fuzzy quantifier Q: $T_{\mathrm{supp}}$ and $T_{\mathrm{clm}}$ [23,24]. They are based on support (5) and on the clm measure (4), respectively, of a fuzzy set that represents the fuzzy quantifier Q:

$$\begin{array}{cc}\hfill & T_{\mathrm{supp}}\left(Q\right)=1-\left|\mathrm{supp}\left(Q\right)\right|,\end{array}$$

(12)

$$\begin{array}{cc}& T_{\mathrm{clm}}\left(Q\right)=1-\mathrm{clm}\left(Q\right).\end{array}$$

(13)

Both measures depend on the presented characteristics of Q and their meaning is: the closer to 1, the more precise quantifier Q is.

Naturally, the choice of representations for quantifier Q and characteristics (properties) S, W depends on the specificity of databases being analyzed, and, in particular, on linguistic information provided by experts. In Section 3, linguistically quantified statements (6) and (7) are essential for proposed definitions of outliers, and for detecting/recognizing outliers in graph-oriented datasets.

3. Detecting and Recognizing Outliers with Linguistic Information

3.1. Outliers in Terms of Linguistically Aggregated Information

Now, we present the definitions of outliers based on fuzzy representations of linguistic information, i.e., by linguistically quantified statements with their degrees of truth.

Definition 1

(Outlier via the first form of linguistically quantified statement). Let $\mathcal{D}=\{d_1$, …, $d_N\}$, $N\in \mathbb{N}$, be a finite non-empty set of objects. Let S be a linguistic expression characterizing objects in $\mathcal{D}$ and represented by a fuzzy set in $\mathcal{D}$. Let Q be a relative regular non-increasing linguistic quantifier (e.g., “almost none”, “very few”, “only several”, or  synonymous) represented by a fuzzy set in $[0,1]$, and $\alpha \in [0,1]$. An object $d\in \mathcal{D}$ is outlier iff:

$$T\left(\mathit{Q }{d}^{\prime }s\mathit{ a}re\mathit{ S}\right)\ge \alpha .$$

(14)

The degree of truth of (14) is evaluated via (8):

$$T\left(Q{d}^{\prime }\mathrm{s}\mathrm{ are}\mathit{ S}\right)={\mu }_Q\left({\displaystyle \frac{{\sum }_{n=1}^N{\mu }_S\left(d_n\right)}{N}}\right).$$

(15)

The definition of an outlier in terms of the second form of a linguistically quantified statement (7), i.e., taking into account two properties, S and W possessed by objects in $\mathcal{D}$, is introduced:

Definition 2

(Outlier via the second form of linguistically quantified statement). Let $\mathcal{D}$ is defined as in Definition 1, and S, W are linguistic expressions characterizing objects $d\in \mathcal{D}$ and represented by fuzzy sets in $\mathcal{D}$. Let $\alpha \in [0,1]$, and Q—a relative regular non-increasing linguistic quantifier as in Definition 1. An object $d\in \mathcal{D}$ is outlier iff:

$$T\left(Q{d}^{\prime }s\mathit{ b}eing\mathit{ W}\mathit{ a}re\mathit{ S}\right)\ge \alpha .$$

(16)

The degree of truth of (16) can be evaluated with Equation (9) as:

$$T\left(Q{d}^{\prime }s\mathrm{being}\mathit{W}\mathrm{are}\mathit{S}\right)={\mu }_Q\left(\frac{\Sigma \mathrm{count}(S\cap W)}{\Sigma \mathrm{count}\left(W\right)}\right).$$

(17)

Two algorithms for detecting outliers are now presented, related to Definitions 1 and 2, respectively. They are designed as tools for detecting outliers in datasets (anomalies, exceptional data, etc.) in circumstances when only imprecise and linguistically formulated knowledge of their specificity is available. In particular, objects d in an analyzed dataset $\mathcal{D}$ are considered to be outliers, if they are intuitively characterized by expressions such as “small”, “big”, “hot”, “very expensive” etc., represented by the S, W fuzzy sets, and the quantity of them is either not determined precisely, but linguistically expressed with statements as “very few”, “almost none”, represented by Q. Hence, the algorithms confirm that outliers exists in a dataset, iff statements “Qx’s are S” or “Qx’s being/having W are S” are of sufficiently large (larger than threshold $\alpha$) degree of truth. The common assumptions for Algorithms 1 and 2 are:

• $\mathcal{D}=\{d_1$, $d_2$, …, $d_N\}$, $N\in \mathbb{N}$—a non-empty finite dataset,
• $S,W$—linguistic labels for properties of d’s in $\mathcal{D}$, represented by fuzzy sets,
• $\{Q_1,Q_2,\dots ,Q_K\}$, $K\in \mathbb{N}$—relative regular monotonically non-increasing linguistic quantifiers, as in Definition 1, given as fuzzy sets in $[0,1]$,
• $\alpha \in [0,1]$—an arbitrarily chosen threshold for degrees of truth for (14), (16),
• Two possible results are produced: $true$ = ”THERE EXIST OUTLIERS IN $\mathcal{D}$”, $false$ = ”NO OUTLIERS IN $\mathcal{D}$”.

To detect outliers in $\mathcal{D}$ using Algorithm 1, we need the entry query in the form of:

$$How\mathit{ m}any{\mathit{ d}}^{\prime }s\mathit{ a}re\mathit{ S}?$$

(18)

to detect outliers in $\mathcal{D}$ with respect to the S property and using linguistic quantifiers $Q_1,Q_2,\dots ,Q_K$.

Algorithm 1 Detecting outliers via the first form of linguistically quantified statement.

1: for all$k=1,2,\dots ,K$do 2:     $T_k\leftarrow 0$, $r\leftarrow 0$ 3:     for all $n=1,2,\dots ,N$ do 4:         $r\leftarrow r+{\mu }_S\left(d_n\right)$ 5:     $T_k\leftarrow {\mu }_{Q_k}(r/N)$ 6: if not$T_1>\alpha$and not$T_2>\alpha$and … and not $T_K>\alpha$ then return “NO OUTLIERS IN $\mathcal{D}$” 7: else return “THERE EXIST OUTLIERS IN $\mathcal{D}$”

Comment: K linguistic expressions and their degrees of truth evaluated in Step 5:

$$Q_1{d}^{\prime }\mathrm{s} \mathrm{are}S\left[T_1\right],\dots ,Q_K{d}^{\prime }\mathrm{s} \mathrm{are}S\left[T_K\right],$$

(19)

are side effects of the algorithm, and it is important in Algorithm 3 recognizing outlying d’s (if detected) in $\mathcal{D}$, see Section 3.2.

Now, Algorithm 2 referring to Definition 2 is presented: outlying objects in $\mathcal{D}$ are here detected on the base of two, possibly overlapping, linguistic characteristics S, W. To detect outliers in $\mathcal{D}$ using Algorithm 2, the entry query is necessary:

$$How\mathit{ m}any{\mathit{ d}}^{\prime }s\mathit{ b}eing\mathit{ W} are\mathit{ S}?$$

(20)

Algorithm 2 Detecting outliers via the second form of linguistically quantified statement.

1: for all$k=1,2,\dots ,K$do 2:     $T_k\leftarrow 0$, $rn\leftarrow 0$, $rd\leftarrow 0$ 3:     for all $n=1,2,\dots ,N$ do 4:         $rn\leftarrow rn+{\mu }_{W\cap S}\left(d_n\right)$ 5:         $rd\leftarrow rd+{\mu }_W\left(d_n\right)$ 6:     $T_k\leftarrow {\mu }_{Q_k}(rn/rd)$ 7: if not$T_1>\alpha$and not$T_2>\alpha$and …and not $T_K>\alpha$ then return “NO OUTLIERS IN $\mathcal{D}$” 8: else return “THERE EXIST OUTLIERS IN $\mathcal{D}$”

As with Algorithm 1, the side effect of Algorithm 2 are K linguistically quantified statements with their degrees of truth:

$$\begin{array}{c}\hfill Q_1 d^{\prime }\mathrm{s} \mathrm{being}\mathit{ W} \mathrm{are} S\left[T_1\right],\dots ,Q_K d^{\prime s} \mathrm{being} W \mathrm{are} S\left[T_K\right]\end{array}$$

(21)

3.2. Recognizing Outliers via Linguistic Information

Here, the next two algorithms, now for recognizing and enumerating outlying observations $d\in \mathcal{D}$ possessing properties S, W, are introduced. The outlier detection tools, Algorithms 1 and 2, presented in Section 3.1, confirm only that some outliers do exist in dataset $\mathcal{D}$ ($true$) or do not exist ($false$). However, subsets of outliers ${\mathcal{D}}_{\mathrm{out}}\subset \mathcal{D}$ remain unspecified. Hence, now we deal with algorithms accomplishing the following task: recognizing and enumerating particular objects in $\mathcal{D}$ that are outliers with respect to the S, W characteristics. in other words, via the algorithms presented here, the subsets of outliers ${\mathcal{D}}_{\mathrm{out}}\subset \mathcal{D}$ with respect to S, W, are determined.

First, we take into account outliers according to Definition 1, and assumptions and symbols are as for Algorithm 1. Hence, for given dataset $\mathcal{D}=\{d_1$, $d_2$, …, $d_N\}$, $N\in \mathbb{N}$, properties S, W, linguistic quantifiers $Q_1$, $Q_2$, …, $Q_K$, $K\in \mathbb{N}$, and parameter $\alpha \in [0,1]$, Algorithm 3 is based on the query (18). Of course, Algorithm 3 is fired iff Algorithm 1 did detect anomalies in $\mathcal{D}$ (since no point to seek for objects in ${\mathcal{D}}_{\mathrm{out}}=\varnothing$, otherwise). The result of firing Algorithm 3 is the collection of outlying observations in $\mathcal{D}$ selected with the S characteristics and the query in the form of (18).

Algorithm 3 Recognizing outliers detected with Algorithm 1.

1: declare ${\mathcal{D}}_{\mathrm{out}}=\varnothing$ 2: for all$n=1,2,\dots ,N$do 3:     if ${\mu }_S\left(d_n\right)>\alpha$ then ${\mathcal{D}}_{\mathrm{out}}\leftarrow {\mathcal{D}}_{\mathrm{out}}\cup \left\{d_n\right\}$ 4: return${\mathcal{D}}_{out}$

Per analogiam, subsets containing anomalies in $\mathcal{D}$ can be determined via Definition 2, with the same assumptions as for Algorithm 2. Hence, the Algorithm 4 is proposed with the query on its input given by (20). Its result is returned as an array of indices of found anomalies $d_n\in \mathcal{D}$, $n\in \{1$, 2, …, $N\}$.

Algorithm 4 Recognizing outliers detected with Algorithm 2.

1: $i\leftarrow 0$ 2: declare $outlierIndices\left[N\right]$ 3: for all$n=1,2,\dots ,N$do 4:     if ${\mu }_{S\cap W}\left(d_n\right)>\alpha$ then $\{i\leftarrow i+1$; $outlierIndices\left[i\right]\leftarrow n\}$ 5: if$i=0$thenreturn “NO OUTLIERS IN $\mathcal{D}$” 6: else return $outliersIndices$

4. Preprocessing Graph Databases to Use Linguistically Aggregated Information

Now, we briefly explain how filtering graph database is done. The aim is to select/filter objects of given types (e.g., clients, transactions, transfers) and represent them as a one-dimensional set (e.g., sequence, collection, list). It is important to notice that objects in a resulting sequence need not to be counterparts of every single vertex of a given type, e.g., a resulting object is not necessarily related to one “complaint” vertex, but rather to a set of data combined from several vertices/edges/properties describing a particular fact, here: a complaint. Next, selected objects are inputs for the method of outlier detection via linguistically quantified statements (described in Section 3). We assume that graph database $\mathcal{D}$ is represented by directed labeled graph G in which V (or $V\left(G\right)$) is the set of vertices of G, E (or $E\left(G\right)$) is the set of edges of G, and L (or $L\left(G\right)$) is the set of labels of G. It is t is important that both vertices and edges can have labels assigned, so G can be vertex-labeled or edge-labeled, respectively. In this case, $L\left(G\right)$ can be divided into two subsets $VL\left(G\right)$ (vertices’ labels) and $EL\left(G\right)$ (edges’ labels). A label of a vertex determines its type, and a label of an edge determines relation between two vertices. Finally, $P(V,E)$ is a set of properties that can be possessed by vertices or edges, e.g., amount of transfer, date of complaint, etc. (in fact, properties are counterparts of attributes in relational data models).

The graph database of Customer Relationship Management (CRM) system taken into account in the experiment, handles complaints submitted by clients of a bank [20]. The vertices of graph G represent data on customers’ complaints submitted to CRM. G is the both edge- and vertex-labeled graph consisting of 355,371 unique vertices, $V\left(G\right)$, and 2,111,884 edges, $E\left(G\right)$. The vertices represent granules of information on complaints and are labeled with $VL\left(G\right)=\{$complaint, issue, product, subissue, zip code, response, company, submitted, tags}. The edges represent relations between data stored in vertices of different labels (types), and are labeled with $EL\left(G\right)=\{$with, about, via, to, against, in category}. Additionally, we have the set of properties possessed by vertices in the base: $P(V,E)=$ {day, disputed, id, month, name, timely, year}. The sample structure of graph G is illustrated in Figure 1.

The keypoint of transforming selected nodes to a sequence is to construct and execute the query. Notice, it is not a simple serialization or graph searching, since objects in the resulting sequence may be described by properties of several different vertices and/or edges. The structure of a single object in the resulting sequence is determined by a specific query R in the general form of:

$$R(V{L}_R,E{L}_R,P_R),$$

(22)

where $V{L}_R\subseteq VL\left(G\right)$ is the subset of vertices’ labels, $E{L}_R\subseteq EL\left(G\right)$ is the subset of edges’ labels, and $P_R\subseteq P(V,E)$ is the subset of vertices’/labels’ properties. The Neo4j database management system is used in the experiment [25], and one of queries executed to obtain selected vertices on complaints as sequence $\mathcal{D}$, is based on the MATCH clause (a counterpart of SELECT in SQL):

$R(V{L}_R,E{L}_R,P_R)$ = (“MATCH(r: Response) – [TO] – (complaint)” + “MATCH(company: Company) – [AGAINST] – (complaint)” + “MATCH(t: Tags) – [WITH] – (complaint)” + “MATCH(p: Product) – [ABOUT] – (complaint)” + “MATCH(s: Submitted) – [VIA] – (complaint)” + “RETURN complaint.id, complaint.year, complaint.day,” + “complaint.month, r.name, company.name,” + “TO.disputed, TO.timely, p.name, t.name, s.name”);

where $V{L}_R=\{$complaint, product, response, company, submitted, tags}, $E{L}_R=\{$with, about, via, to, against}, and $P_R=P(V,E)$, see (22).

As the result of executing this query on the given graph dataset, sequence $\mathcal{D}=\{d_1,\dots ,d_N\}$, $N=40,083$, of objects representing complaints is selected. Sample records of the sequence are illustrated in

Table 1. Sample records of dataset D obtained as a sequence from the graph database processed, see Section 4 and Figure 1.

ID	Company	Date Received	Sent by CFPB	Per Capita Income	Product	Zipcode
801691	STONELEIGH RECOVERY ASSOCIATES, LLC	11.04.2014	09.04.2014	$\$56,791$	debt collection	94930
801371	NATIONSTAR mortgage	11.04.2014	09.04.2014	$\$56,791$	mortgage	94947
305167	WELLS FARGO & COMPANY	07.02.2013	05.02.2013	$\$62,018$	mortgage	22206
716577	WELLS FARGO & COMPANY	20.02.2014	15.02.2014	$\$62,018$	mortgage	22203
809768	BARCLAYS BANK DELAWARE	15.04.2014	15.04.2014	$\$26,924$	credit card	87124
941562	COMERICA	17.07.2014	17.07.2014	$\$23,023$	bank account or service	48653
720703	Vision Financial Corp.	21.05.2012	21.05.2012	$\$60,929$	debt collection	75089
…	…	…	…	…	…	…

.

5. Application Example

The proposed algorithms for outlier recognition via linguistic information are now implemented on the sequence obtained (see Table 1). Because of specificity of data and possible connections/relations between them, a graph representation has been chosen for the set of complaints submitted. The general schema of the experiment is to filter (select) the vertices representing complaints themselves and represent them as the sequence of objects, the parameters of which are inputs for algorithms detecting outliers (see Section 3).

Next, properties of interest of these objects are fuzzified, which means their crisp values are assigned to labels and corresponding fuzzy sets: “date received” to {early spring, middle spring, summer, autumn, early winter, winter} in ${\mathcal{X}}_1$, “county per capita income” to {poor, middle, rich} in ${\mathcal{X}}_2$, and “time of sending complaint” to {short, average, long} in ${\mathcal{X}}_3$, see sample linguistic values of chosen properties of objects in $\mathcal{D}$ (23)–(25). $S_1$ represents label “early spring” in ${\mathcal{X}}_1=\{1,2,\dots ,366\}$—days in a year with ${\mu }_{S_1}$ given

$${\mu }_{S_1}\left(x\right)=\left\{\begin{array}{cc}\frac{x-79}{14},\hfill & 79\le x\le 93\hfill \\ \frac{-x+107}{14},\hfill & 93\le x\le 107\hfill \end{array}\right.$$

(23)

and 0 otherwise. $S_2$ represents label “rich county” in ${\mathcal{X}}_2=\{0,1,\dots ,70\}$—per capita income (in USD thousands) in the county the submission comes from, with ${\mu }_{S_2}\left(x\right)$:

$${\mu }_{S_2}\left(x\right)=\left\{\begin{array}{cc}\frac{x-52}{6},\hfill & 52\le x\le 58\hfill \\ \frac{-x+64}{6},\hfill & 58\le x\le 64\hfill \end{array}\right.$$

(24)

and 0 otherwise. $S_3$ represents label “average time” in ${\mathcal{X}}_3=\{0,1,\dots ,30\}$—numbers of days between receiving and sending the complaint to a company by CFPB (Consumer Financial Protection Bureau), with ${\mu }_{S_3}\left(x\right)$:

$${\mu }_{S_3}\left(x\right)=\left\{\begin{array}{cc}\frac{x-2}{4},\hfill & 2\le x\le 6\hfill \\ \frac{-x+10}{4},\hfill & 6\le x\in 10\hfill \end{array}\right.$$

(25)

and 0 otherwise. $S_4$ is a non-fuzzy set representing one of the labels: {Older American, Servicemember, Older American and Servicemember, none}.

The relative linguistic quantifiers proposed to be applied in Algorithm 2, according to Definition 2, are $Q_1$ = “very few”, $Q_2$ = “close to 0”, $Q_3$ = “almost none”. They are illustrated in Figure 2 and their membership functions for $r\in [0,1]\subset \mathbb{R}$ are:

$${\mu }_{Q_1}\left(r\right)=\left\{\begin{array}{cc}1\hfill & r\le 0.3\hfill \\ \frac{-r+0.7}{0.4}\hfill & 0.3\le r<0.7\hfill \\ 0\hfill & r\ge 0.7,\hfill \end{array}\right.$$

(26)

$${\mu }_{Q_2}\left(r\right)=9^{-r},$$

(27)

$${\mu }_{Q_3}\left(r\right)={\displaystyle \frac{1}{1+{\left({\displaystyle \frac{r}{0.3}}\right)}^4}}.$$

(28)

Now we use Definitions 1 and 2 to detect outliers in $\mathcal{D}$. We use S and W as non-empty combinations of $S_1$, $S_2$, $S_3$, e.g., $S_1$ AND $S_2$, $S_1$ AND $S_3$, etc. Hence, queries R in the form of (18) and (20) are needed to fire Algorithms 1 and 2, e.g.:

$$\begin{array}{c}\hfill \mathrm{How}\mathrm{many}\left(Q\right)\mathrm{complaints}\mathrm{submitted}\mathrm{in}\mathrm{spring}\left(W\right)\mathrm{come}\mathrm{from}\mathrm{rich}\mathrm{country}\left(S\right)?\end{array}$$

(29)

Finally, 49 queries are formulated, and since we operate on 3 fuzzy quantifiers $Q_1$, $Q_2$, $Q_3$ substituting Q in (29), $3\times 49=147$ linguistically quantified statements are generated see

Table 2. Linguistically quantified statements $1.$–$147.$ generated with degrees of truth T and $T_{\mathrm{supp}}$, $T_{\mathrm{clm}}$ measures (see (12) and (13)). The statements 145. and 147. that detected outliers, are bolded.

No.	Linguistically Quantified Statement	T	${\mathit{T}}_{\mathbf{supp}}$	${\mathit{T}}_{\mathbf{clm}}$
1.	Almost no complaints submitted in early spring come from rich county	0.75	0	0.33
2.	Almost no complaints submitted in middle spring come from rich county	0.19	0	0.33
42.	Almost none complaints submitted in winter are sent by CFPB in short time	0.58	0	0.33
60.	Very few complaints submitted in winter come from poor county	0.63	0.3	0.5
97.	Close to 0 complaints submitted in summer come from rich county	0.32	0	0.40
125.	Close to 0 complaints are submitted by Older American and Servicemember AND come from average county	0.25	0	0.40
…	…	…	…	…
144.	Close to 0 complaints submitted in early winter are sent by CFPB in long time	0.14	0	0.40
145.	Almost no complaints submitted in early spring come from rich county AND are sent by CFPB in an average time	0.94	0	0.33
146.	Close to 0 complaints submitted in early spring come from rich county AND are sent by CFPB in an average time	0.43	0	0.40
147.	Very few complaints submitted in winter come from rich county AND are sent by CFPB in an average time	0.92	0.3	0.5

. The $\alpha =0.9$ threshold is arbitrarily chosen to distinct statements with the largest degree of truth (see Definition 2): statements $145.$ and $147.$ are found as sufficiently true to detect some outliers (lines bolded in Table 1). In both cases Algorithm 4 is used to determine particular outlying objects in $\mathcal{D}$, because the statements are in the form of (6). Two sets of outliers are finally recognized, ${{\mathcal{D}}_{out}}_1,{{\mathcal{D}}_{out}}_2$. Objects with IDs in ${{\mathcal{D}}_{out}}_1=\{$801,691; 801,371; 375,975} are outliers detected by statement 145, and objects with IDs in ${{\mathcal{D}}_{out}}_2=\{$663,648; 210,516; 253,242; 673,669; 305,167; 716,577} are outliers detected by statement 147. These choices were checked and confirmed by experts as outlying objects.

Moreover, one interesting observation must be noticed here: in Table 2, linguistic expressions 145. and 146 have the same S (“come from rich county AND are sent by CFPB in an average time”) and W (“submitted in early spring”) properties, but different linguistic quantifiers (“almost none’’ and “close to 0’’, respectively) are used. As the result, the former is qualified as detecting possible outliers and the latter is not. Obviously, it depends on the membership functions of the quantifiers, so one may conclude that testing different fuzzy representations of expert knowledge appears crucial for final results of detection.

A Comparison to the LOF Algorithm

The $\mathcal{D}$ sequence containing 40,083 objects is now the entry for the LOF algorithm (Local Outlier Factor) for detecting outliers [26]. The Python libraries: scikit-learn [27] and pandas [28] are applied in computations. The sets of parameters for LOF and numbers of outliers detected are given in

Table 3. Parameters of the LOF algorithm and number of outliers detected in the $\mathcal{D}$ dataset.

No.	Neighbors	Leafsize	Metric	Contamination	Number of Outliers
1.	20	30	Minkovsky	auto	3206
2.	50	30	Minkovsky	auto	2989
3.	50	100	Jaccard	auto	0
4.	20	30	dice	auto	0
5.	20	30	correlation	0.0050	132
6.	20	30	correlation	0.0012	33
7.	20	30	correlation	0.0004	11
8.	20	30	correlation	0.0002	6

:

Table 3 illustrates different parameters of LOF taken into account to analyze the given sequence of data. It must be underlined that only raw numerical data are analyzed, since there is no possibility to feed LOF with linguistically expressed knowledge. As it is seen, the number of outliers found by LOF varies from 0 to over 3000. Moreover, only the correlation used as a metric and very small contamination provide numbers of outliers similar to the fuzzy algorithms proposed. However, outliers found by the LOF algorithm (that does not use fuzzy sets) are different from the outliers detected by our algorithms, and the most probable explanation is that traditional algorithms do not use linguistically expressed knowledge. The conclusion is that mutual applying both methods, traditional and the one proposed, is worth considering, to recognize all outlying objects.

6. Conclusions

In this paper, we introduce a novel method of outlier detection and recognition in graph datasets, when only linguistic and/or imprecise knowledge is available to differ suspected objects on the background of regular, typical data. The method is applicable when no quantitative or measurable information is accessible (and, thus, outlier definitions by Aggarwal, Knorr, etc. would not work), but when it is possible to create fuzzy models, i.e., fuzzy representations of expert knowledge, based on raw numerical data (which is a common practice in fuzzy computations). Specific processing of graph databases is taken into account, to make it readable for fuzzy methods. An illustrative implementation example is provided to show how graph data can be processed by fuzzy representations of linguistic information and, finally, to point at particular objects as recognized outliers. In other words, we show how the question “which objects are outliers in $\mathcal{D}$?” can be answered, and not only “are there outliers in $\mathcal{D}$ or not?”.

Algorithms 1 or 2 can confirm that outliers are present in $\mathcal{D}$, and the subsets of outlying observations ${\mathcal{D}}_{\mathrm{out}}$ in the analyzed $\mathcal{D}$ are determined by Algorithms 3 or 4 taken into account the degrees of truth of linguistically quantified statements generated by Algorithms 1 or 2 as their side effects, see (19) and (21). Finally, we would like to underline that the approach proposed to the issue of detecting and recognizing outliers in datasets, especially, its novelty based on linguistically quantified statements interpreted in terms of fuzzy sets, were not applied, up to now, to graph datasets.

Currently, our further research on recognizing outliers is in progress, mostly using multi-subject linguistic summaries, cf. [29], and analyzing other non-relational databases.