Skip to main content
U.S. flag

An official website of the United States government

Anomaly Detection and Diagnosis Algorithms for Discrete Symbols

Published by Dashlink | National Aeronautics and Space Administration | Catalog Last Checked: July 14, 2026 at 11:32 PM | Dataset Last Updated: March 31, 2025
We present a set of novel algorithms which we call sequenceMiner that detect and characterize anomalies in large sets of high-dimensional symbol sequences that arise from recordings of switch sensors in the cockpits of commercial airliners. While the algorithms we present are general and domain-independent, we focus on a specific problem that is critical to determining the system-wide health of a fleet of aircraft. The approach taken uses unsupervised clustering of sequences using the normalized length of the longest common subsequence (nLCS) as a similarity measure, followed by detailed outlier analysis to detect anomalies. In this method, an outlier sequence is defined as a sequence that is far away from the cluster centre. We present new algorithms for outlier analysis that provide comprehensible indicators as to why a particular sequence is deemed to be an outlier. The algorithms provide a coherent description to an analyst of the anomalies in the sequence when compared to more normal sequences. In the final section of the paper we demonstrate the effectiveness of sequenceMiner for anomaly detection on a real set of discrete sequence data from a fleet of commercial airliners. We show that sequenceMiner discovers actionable and operationally significant safety events. We also compare our innovations with standard HiddenMarkov Models, and show that our methods are superior.

Resources

16 resources available

  • View this dataset's algorithm theoretical basis document

    PDF
    Download

  • Download this dataset through Earthdata Search

    HTML
    Download

  • Data Subscriber

    HTML
    Download

  • View this dataset's data citation policy

    HTML
    Download

  • Download this dataset through a directory map

    HTML
    Download

  • View this dataset's user's guide

    PDF
    Download

  • View information related to this dataset

    PDF
    Download

  • The dataset's project home page

    HTML
    Download

  • View documentation related to this dataset

    HTML
    Download

  • View documentation related to this dataset

    HTML
    Download

  • View documentation related to this dataset

    HTML
    Download

  • View documentation related to this dataset

    HTML
    Download

  • Download this dataset

    HTML
    Download

  • Download this dataset

    HTML
    Download

  • Google Scholar search results

    HTML
    Download

  • Get a related visualization

    JPEG
    Download

Find Related Datasets

Search by Tags

Click any tag below to search for similar datasets

Complete Metadata
@type dcat:Dataset
accessLevel public
accrualPeriodicity irregular
bureauCode 
[
  "026:00"
]
contactPoint 
{
  "fn": "Ashok Srivastava",
  "@type": "vcard:Contact",
  "hasEmail": "mailto:ashok.n.srivastava@gmail.com"
}
description We present a set of novel algorithms which we call sequenceMiner that detect and characterize anomalies in large sets of high-dimensional symbol sequences that arise from recordings of switch sensors in the cockpits of commercial airliners. While the algorithms we present are general and domain-independent, we focus on a specific problem that is critical to determining the system-wide health of a fleet of aircraft. The approach taken uses unsupervised clustering of sequences using the normalized length of the longest common subsequence (nLCS) as a similarity measure, followed by detailed outlier analysis to detect anomalies. In this method, an outlier sequence is defined as a sequence that is far away from the cluster centre. We present new algorithms for outlier analysis that provide comprehensible indicators as to why a particular sequence is deemed to be an outlier. The algorithms provide a coherent description to an analyst of the anomalies in the sequence when compared to more normal sequences. In the final section of the paper we demonstrate the effectiveness of sequenceMiner for anomaly detection on a real set of discrete sequence data from a fleet of commercial airliners. We show that sequenceMiner discovers actionable and operationally significant safety events. We also compare our innovations with standard HiddenMarkov Models, and show that our methods are superior.
distribution 
[
  {
    "@type": "dcat:Distribution",
    "title": "View this dataset's algorithm theoretical basis document",
    "format": "PDF",
    "mediaType": "application/pdf",
    "description": "Algorithm Theoretical Basis Document (ATBD)",
    "downloadURL": "https://archive.podaac.earthdata.nasa.gov/podaac-ops-cumulus-docs/web-misc/swot_mission_docs/atbd/D-105502_SWOT_ATBD_L2_LR_SSH_20230724a_cite.pdf"
  },
  {
    "@type": "dcat:Distribution",
    "title": "Download this dataset through Earthdata Search",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "Browse granule search results in Earthdata Search",
    "downloadURL": "https://search.earthdata.nasa.gov/search/granules?p=C2799465497-POCLOUD"
  },
  {
    "@type": "dcat:Distribution",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "Data Subscriber",
    "downloadURL": "https://github.com/podaac/data-subscriber"
  },
  {
    "@type": "dcat:Distribution",
    "title": "View this dataset's data citation policy",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "Data Use and Citation Policy",
    "downloadURL": "https://podaac.jpl.nasa.gov/CitingPODAAC"
  },
  {
    "@type": "dcat:Distribution",
    "title": "Download this dataset through a directory map",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "HTTPS endpoint for data browse and download",
    "downloadURL": "https://cmr.earthdata.nasa.gov/virtual-directory/collections/C2799465497-POCLOUD"
  },
  {
    "@type": "dcat:Distribution",
    "title": "View this dataset's user's guide",
    "format": "PDF",
    "mediaType": "application/pdf",
    "description": "Product Description Document (PDD)",
    "downloadURL": "https://archive.podaac.earthdata.nasa.gov/podaac-ops-cumulus-docs/web-misc/swot_mission_docs/pdd/D-56407_SWOT_Product_Description_L2_LR_SSH_20231026_RevBcite.pdf"
  },
  {
    "@type": "dcat:Distribution",
    "title": "View information related to this dataset",
    "format": "PDF",
    "mediaType": "application/pdf",
    "description": "Release Note",
    "downloadURL": "https://archive.podaac.earthdata.nasa.gov/podaac-ops-cumulus-docs/web-misc/swot_mission_docs/releases/SWOT_VersionC_KaRIn_Products_Release_Note.pdf"
  },
  {
    "@type": "dcat:Distribution",
    "title": "The dataset's project home page",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "SWOT Mission Page",
    "downloadURL": "https://swot.jpl.nasa.gov"
  },
  {
    "@type": "dcat:Distribution",
    "title": "View documentation related to this dataset",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "SWOT Mission Page at AVISO",
    "downloadURL": "https://www.aviso.altimetry.fr/en/missions/current-missions/swot.html"
  },
  {
    "@type": "dcat:Distribution",
    "title": "View documentation related to this dataset",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "SWOT Mission Page at JPL",
    "downloadURL": "https://www.jpl.nasa.gov/missions/surface-water-and-ocean-topography-swot"
  },
  {
    "@type": "dcat:Distribution",
    "title": "View documentation related to this dataset",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "SWOT Mission Page at NASA",
    "downloadURL": "https://www.nasa.gov/swot"
  },
  {
    "@type": "dcat:Distribution",
    "title": "View documentation related to this dataset",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "SWOT Mission Page at PO.DAAC",
    "downloadURL": "https://podaac.jpl.nasa.gov/swot"
  },
  {
    "@type": "dcat:Distribution",
    "title": "Download this dataset",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "Search Granules from Bulk Reprocessing (PGC0)",
    "downloadURL": "https://search.earthdata.nasa.gov/search/granules?p=C2799465497-POCLOUD&pg%5B0%5D%5Bid%5D=*PGC0*"
  },
  {
    "@type": "dcat:Distribution",
    "title": "Download this dataset",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "Search Granules from Forward Processing (PIC0)",
    "downloadURL": "https://search.earthdata.nasa.gov/search/granules?p=C2799465497-POCLOUD&pg%5B0%5D%5Bid%5D=*PIC0*"
  },
  {
    "@type": "dcat:Distribution",
    "title": "Google Scholar search results",
    "format": "HTML",
    "mediaType": "text/html",
    "description": "Search results for publications that cite this dataset by its DOI.",
    "downloadURL": "https://scholar.google.com/scholar?q=10.5067%2FSWOT-SSH-2.0"
  },
  {
    "@type": "dcat:Distribution",
    "title": "Get a related visualization",
    "format": "JPEG",
    "mediaType": "image/jpeg",
    "description": "Thumbnail",
    "downloadURL": "https://podaac.jpl.nasa.gov/Podaac/thumbnails/SWOT_L2_LR_SSH_2.0.jpg"
  }
]
identifier DASHLINK_147
issued 2010-09-22
keyword 
[
  "ames",
  "dashlink",
  "nasa"
]
landingPage https://c3.nasa.gov/dashlink/resources/147/
modified 2025-03-31
programCode 
[
  "026:029"
]
publisher 
{
  "name": "Dashlink",
  "@type": "org:Organization"
}
title Anomaly Detection and Diagnosis Algorithms for Discrete Symbols

data.gov

An official website of the GSA's Technology Transformation Services

Looking for U.S. government information and services?
Visit USA.gov