SAS® Event Stream Processing Features

In-memory, distributed & optimized processing that scales

  • High-volume processing of millions of events per second. Low-latency response times (millisecond, submillisecond).
  • SAS Event Stream Processing metering server monitors and records event consumption for each SAS Event Stream Processing project, input window and production SAS Event Stream Processing server – speeding the collection of event consumption data.
  • Retained and aggregated data kept in memory.
  • Ability to take advantage of distributed grid architectures.
  • Processing speeds can be customized with flexible thread-pool sizing, caching stores and more.
  • Includes patented, instantaneous 1+N way failover, native failover, guaranteed delivery without the use of persistence and other fault-tolerance functions to ensure successful event stream processing activity.
  • Full and open access tall event metadata.

Cloud ready

  • Containerization.
  • Array and Binary Object Support.
  • Amazon Kinesis.
  • Cloud Foundry.
  • Dockers.
  • Kubernetes.
  • Recipes.
  • Multitenancy statement.

In-stream learning model windows

  • Allows you to use different window types to specify data stream input sources, patterns of interest and derived output actions. Learning model windows include:
    • Train – Develop an advanced analytical model in stream and pass the resulting model updates to a score window.
    • Score – Apply the trained model to current events in stream to produce score output, as well as support for learning models that use both training and scoring together.
    • Calculate – Use with offline ASTORE models, Python code, data normalization and transformation methods, as well as learning models that bundle training and scoring together.
    • Model supervisor – Control what model to deploy, and when and where to deploy it (for example, to the score window).
    • Model reader – Integrate offline ASTORE models and publish a model to another streaming analytics window, such as the score window.
  • With unified project and server management via SAS Event Stream Manager, you can:
    • Construct and manage repeatable deployment plans with an easy-to-use interface, for projects executing on SAS Event Stream Processing servers.
    • Quickly create deployments to monitor collections of servers and to simplify management.
    • Identify deployment errors and retry operations only on servers that need attention.
    • Create filtered lists of SAS Event Stream Processing servers to apply deployment operations.
    • Create repeatable deployment scripts for rapid automation and user prompts, simplifying SAS Event Stream Processing project activation.
    • Monitor events consumed with metering server displays to identify event usage patterns per license.
    • Easily add new SAS Event Stream Processing servers for improved monitoring.

Ability to consume and connect streaming data

  • Extensive suite of data adapters and connectors for publishing and subscribing to live data streams of both structured and unstructured data, including videos and images.
  • Predefined adapters include read and write (i.e., publish and subscribe):
    • Adapter connector makes it easier to manage adapters from within a SAS Event Stream Processing project, simplifying adapter orchestration (similar to connector orchestration).
    • Apache Camel
    • Axeda
    • BACNET
    • Cassandra
    • Database ODBC: supports a variety of databases such as IBM DB2, IBM Netezza, Sybase ASE, and others. See Data Driver support for complete list.
    • Event Stream Processor
    • File/socket
    • HDAT Reader
    • HDFS
    • IBM WebSphere MQ
    • JMS
    • Kafka
    • MapR
    • Modbus
    • MQTT
    • Nurego
    • OPC-UA
    • OSIsoft PI
    • Project Publish
    • Pylon
    • RabbitMQ
    • Rendezvous
    • REST
    • SAS Cloud Analytic Services
    • SAS data sets
    • Customized publish/subscribe APIs can also be written in C or Java.
    • SAS® LASR Analytic Server
    • Solace
    • Teradata
    • Teradata Listener
    • Tervela Data Fabric
    • TIBC
    • Timer
    • URL
    • UVC camera
    • WebSocket
    • XML/JSON file socket adapter.
  • Publish only to SAS Event Stream Processing from the following:
    • BoardReader
    • HTTP RESTful interfaces
    • Log sniffers (Oracle, Greenplum)
    • Network sniffer
    • SYSLOG
    • Twitter
    • Twitter GNI
  • Subscribe only from SAS Event Stream Processing to:
    • SOAP
    • SMTP

Adaptable, in-stream analytics and data manipulation

  • Machine learning streaming-algorithm support lets you create scoring and learning procedural windows for various continuous learning algorithms to include:
    • Streaming linear regression.
    • Logistic regression.
    • Support vector machine.
    • Density-based clustering (DBSCAN).
    • K-means clustering.
  • In-stream analytics packaged with SAS Event Stream Processing includes:
    • Change detection.
    • Pearson’s correlation.
    • Streaming regression analysis.
    • Streaming summary (univariate statistics).
    • Segmented correlation.
    • Short-time Fourier transform.
    • Streaming Speech Transcription.
    • Streaming Audio Feature Computation.
    • Streaming t-Distributed Stochastic Neighbor Embedding.
    • Text tokenization.
    • Text vectorization and moving relative range.
    • Weibull distribution fitting.
  • Algorithms for offline training packaged with SAS Event Stream Processing include:
    • Robust principal components analysis.
    • Bayesian network.
    • Recurrent neural networks.
    • Convolutional neural networks.
    • Deep neural networks.
  • DBSCAN lets you identify clusters in an unsupervised manner. A combination of train and score windows are used to periodically update the DBSCAN model.
  • The geofence window type allows you to track the location of objects relative to borders of a geofence. Alert when an object approaches, enters or leaves the defined geofence boundaries – and track entities within the geofence boundaries.
    • Transpose: Enables you to interchange an event’s rows as columns, or columns as rows
    • Remove State: Facilitates the transition of a stateful part of a model to a stateless part of a model.
    • Multiple Object Tracker (MOT): Enables you to perform multi-object tracking (MOT) in real time.
  • Model training on historical data (for accurate model development) complements high-performance analytics for at-rest data.
  • Flexible, modular, window-driven architecture to define complex continuous queries:
    • Based on an extensive suite of interchangeable window types and operators to detect an unlimited number of patterns, correlations, computations and aggregations.
    • Prebuilt, common data quality routines are used to cleanse, standardize and filter livestream data before it’s stored, reducing downstream processing.
    • Patterns of interest can include nearly unlimited advanced analytics calculations with in-stream, machine learning k-means clusters and livestream analytical scoring.
  • Analytical models include all SAS DATA step, DS2, Python and third-party code snippets.
  • Highly embeddable to gateways, edge devices, compute sticks and any existing C++ application (with dedicated thread-pool processing).

Graphical design time environment

  • Integration with SAS Model Manager provides faster, automated integration and monitoring of analytical models. Browse SAS Model Manager repository to easily locate and integrate advanced analytics to embed in SAS Event Stream Processing projects.
  • Added SAS Viya enabled mode.
    • Authentication with SAS Logon.
    • Uses Postgres as persisted data store.
  • Multitenancy support.
    • Database per tenant.
    • Schema per tenant.
  • Test mode enhancements.
    • Updated UI.
    • Access to ESP server log.
  • Run projects outside test mode.
    • Testing for long-running projects.
  • Usability and user experience improvements.
    • Application layout updated.
    • More responsive UI.
    • Diagram improvements.
    • New test server management page.
    • Improved output schema panel.
    • Enhanced validation of ESP syntax and properties.
  • Integration with SAS Event Stream Manager.
    • Published project surfaced in ESM automatically.
    • Minor version updates in ESM pushed back to Studio.

ESP operations & monitoring

  • Multitenancy support.
    • Database per tenant.
    • Schema per tenant.
  • ESP server monitoring.
    • ESP heartbeat monitoring.
    • ESP server status reporting.
    • ESP Server performance stats.
  • Enhanced metering.
    • More options for usage reporting.
    • Breakdown by license/server/type.
    • Breakdown by month/year.
  • Usability and user experience improvements.
    • More visual indicators of issues.
    • More responsive UI.
    • Improved deployment management.
    • Enhanced server config reporting.
  • Deployment controls.
    • Load and start projects without templates.
    • Stop and Unload projects without templates.
  • Integration with ESP Studio.
    • Published project surfaced in ESM automatically.

Expanded deployments & open data support

  • Deploy SAS Event Stream Processing at the edge for IoT applications:
    • SAS Event Stream Processing for Edge Computing provides a smaller, configurable disk footprint for simplified deployment to smaller edge devices.
    • Support for Docker container deployment for SAS Event Stream Processing for Edge Computing for standardized deployment.
  • SAS Event Stream Processing Python development interface:
    • Speed development time with a familiar, open and flexible Python interface for developing, publishing, testing and streaming events through SAS Event Stream Processing projects.
    • Python publish/subscribe API:
      • Publish events and subscribe to SAS Event Stream Processing using Python.

Use SAS & open source languages

  • In process event stream handlers:
    • BOSH Cloud Foundry for large-scale distributed services.
    • C/C++.
    • Connectors and adapters for IoT – Twitter, MQTT, OPC-UA, UVC, Pylon, Modbus, OSI PI Historian, BACnet, gateways, devices, Kafka, Cassandra (adapter only) and BoardReader.
    • Data stream support: Hortonworks DataFlow (HDF) NiFi integration – SAS and HDF can provide immediate, streaming and deep intelligence.
    • DS2.
    • MapR streams support – The Kafka adapter is certified towork with the MapR converged data platform for publishing and subscribing.
    • Python publish/subscribe API.
    • SAS Event Stream Processing for SAS® Viya® and CAS – Deploy SAS Viya data mining and machine learning models to SAS Event Stream Processing for streaming analytics.
    • Static data joins: integrate static data from databases or files to enrich streaming data using ODBC database adaptor and connector support in conjunction with database drivers
    • Teradata integration – Teradata Listener connector sends data from SAS Event Stream Processing to the Teradata Listener application. Teradata Listener ingests high-volume, real-time data streams and persists the data from those streams to Teradata, Aster or Hadoop.

Visual monitoring of event streams

  • Streamviewer support for SAS graphs in commercial streaming dashboards.
  • Streamviewer components support embedding within applications to deliver Streamviewer real-time insights.
  • WebSocket support for reliable and fast SAS Event Stream Processing server connectivity.
  • Configure the dashboard for customized testing of streaming activity.
  • Interactively filter and query livestream activity to examine specific behavior of elements.
  • Define and customize notifications by SMS, email and other alerts as part of event stream model workflow.
  • Faster response with new web socket support to monitor events from SAS Event Stream Processing server.
  • Compare historical activity with current processing using graphical representations.
  • Monitor stream processing detail by subscribing to events of interest.

Back to Top