OpenResearchAlpha

Dasinya Journal for Engineering and Informatics · 13 Nov 2026

An Explainable Machine Learning Framework for Insider Threat Detection Using Behavioral Feature Engineering

Omar Sedqi Kareemh-index 3

0
Citations
no database records one yet
0
Citations in 2026
so far
3
Leading author's h-index
Omar Sedqi Kareem, in QAI's scholar index
21
References
works it cites, from open citation data

Citations by database

Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.

  • OpenCitations0
  • Crossref0

Citations per year

The current year is still counting.

  • 2026 so far0

Abstract

Insider threat detection remains one of the most challenging problems in cybersecurity because malicious activities are often difficult to distinguish from legitimate user behavior. Many existing machine learning approaches rely on limited behavioral representations, high-dimensional feature spaces, and black-box models with limited interpretability, which constrains their practical utility in security operations. This paper proposes an explainable machine learning framework for insider threat detection based on behavioral feature engineering. The framework constructs daily user-level behavioral profiles from heterogeneous sources in the Computer Emergency Response Team (CERT) Insider Threat Dataset (Release 4.2), including logon, email, web browsing, file access, Universal Serial Bus (USB) device usage, and psychometric records. A Genetic Algorithm (GA) reduces the engineered feature space from 53 to 35 features while retaining comparable predictive performance. A LightGBM classifier is then optimized through Bayesian hyperparameter tuning with Optuna, followed by decision threshold optimization to balance precision and recall. SHapley Additive exPlanations (SHAP) provide global and local explanations, enabling security analysts to examine the factors behind individual decisions. On the independent test set, the framework achieved 99.79% accuracy, 83.78% precision, 60.78% recall, 70.45% F1-score, 97.92% ROC-AUC, 71.14% PR-AUC, 80.37% balanced accuracy, and 71.27% MCC. The gap between high accuracy and lower recall and F1-score reflects the severe class imbalance of the dataset. These findings demonstrate the feasibility of integrating behavioral feature engineering, feature selection, model optimization, and explainable AI within a unified framework.

What the data shows

  • No database records a citation yet, as is usual for a paper this new.
  • Omar Sedqi Kareem has the highest h-index among the authors (3).

Graph

This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.

Citing paper shares an authorAuthor without a profileSize shows citations, or h-index for authors

Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.

Start with

Authors (1)

Each author's standing in QAI's scholar index: the works their ORCID iD is attached to, and for anyone whose ORCID record names a lab OpenResearch follows, their arXiv preprints matched by name and a shared co-author. Names are as printed on the paper.

ProfileMost-cited paper

Cited by 0 papers

Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.

0 shown
No citing papers for this filter.

References (21)

What it cites, from open citation data, with Crossref's record of each.

Optuna
Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · 2019
9,134

Sign in to see 1 more reference

A free account opens the rest of the citing papers and references on every paper’s page.

An Explainable Machine Learning Framework for Insider Threat Detection Using Behavioral Feature Engineering - QAI OpenResearch