cfxCloud Portal Walkthru

View Steps Show/hide Speaker Notes Show/Hide Popover Copy LinkCopied Embed PDF Presentation Mode

0/31

Click on Event Processing Report

1/31

Home PageÂ shows Overall Analytics and Enabled Services

Performance of key services and Data Fabric and AIOps components

List of Active services. From here you can - Activate new services -Launch service dashboard

RDA Studio is the interactive workbench where you can work with data bots and author pipelines in a low-code environment. Iterate/test/inspect or debug pipelines and publish once ready.

2/31

Hover mouse to left side to see Main Menu

In cfxCloud you can deploy one or more services from catalog. You can also create your own service.

Overall Analytics and Monitoring stats for Data Fabric and AIOps components

Fabric Components like Worker Nodes, Event Gateway, Datasets, Pipelines, Persistent Stream etc.

Get started with few curated learning videos

Documentation, Community and Support resources

3/31

Services page

4/31

List of Enabled Services

Add New Services

Launch Service Dashboard

Click on Details to Launch Service Dashboard

5/31

Overall Analytics and Monitoring of Services, Fabric Components and AIOps

6/31

Analytics Summary

Worker nodes process data, execute bots and pipelines. Workers can be deployed both on-prem and cloud. Every SaaS customer tenant has 1 default worker

Number of edge locations where workers are running

Number of Data Fabric agents like Event Gateway or Edge Collector

Total number of active/running jobs. Each Pipeline executing is a job. Some jobs run indefinitely, for example streaming data pipelines.

Number of total jobs executed by each data pipeline

Number of jobs across executed across different worker nodes.

7/31

Trend of job executions across all workers

8/31

Trend of all logs/events ingested into Event GatewayÂ

Event Gateway is how you Get Data In (GDI) into cfxCloud

9/31

Events Per Second (EPS).Â

Here you can see we hit almost 250K events/second

10/31

This will launch Configuration and Management page for various key components of cfxCloud

11/31

RDA Fabric configuration identifies you as a secure and authenticated entity on RDA Fabric.

Use this configuration to correctly register and authenticate your other fabric components like Workers, Event Gateway, RDA client etc.

12/31

Click on Fabric Components

Worker nodes provide computational capacity to execute bots and pipelines. A worker node is container based software, can be deployed on-prem and cloud

Agents extend RDA Fabric to enterprise and cloud environments. Agents are Event Gateway, Edge Collector

cfxCloud is powered by Microservices, including Core Microservices, Application Microservices

13/31

View Details

RDA client (rdac) is a command line utility that allows you to interact with cfxCloud and RDA fabric.

Installation instructions for RDA Client

14/31

This pane shows key cfxCloud artifacts

Service Blueprints define what is composed in a service, and how they should be run. For example, pipelines, which worker node to run, scaling and what dashboards/reports to publish.

Data pipelines automate data operations using data bots in a workflow. Pipelines are implemented with simple low-code like template.

Encrypted secure vault for storing login credentials to integrate with data sources/sinks/APIs. Used by RDA bots in pipelines

Jinja 2 style templates to format text payloads. For example can be used to create json payload for PagerDuty incident create API

Advanced Log/Event reduction policies based on intelligent sampling, correlation based, time-based etc.

15/31

Deployed Service BlueprintsÂ shows all active services.

Service Blueprint CatalogÂ shows services available for deployment from catalog. Services can have multiple versions or variations. You can select a specific version.

Partners or CustomersÂ can create Service Blueprints easily. It is YAML based

16/31

View and Edit RDA Pipelines. Pipelines allow you to automate data operations.

Pipelines, run on any Worker node

To interactively work with bots and pipelines you can launch RDA Studio from Home page

17/31

Click on Search

18/31

Click on 3-button menu

19/31

This pane shows key cfxCloud artifacts

20/31

Close the dialog after reviewing Pipeline content

This is low-code pipeline content. Pipeline is a workflow of data bots to help automate data operations.

Green color text indicates name of the RDA bot. RDA bot can be invoked by simply mentioning its name. We have 500+ bots in our library and growing.

Blue color text indicates parameters for RDA bots.

--> indicates new stage in the data pipeline.

21/31

Datasets are data repositories for bulk or batch data.

Datasets are typically created/used by Pipelines. Datasets can also be used for enrichment, lookups, key-value pairs etc.

22/31

Here you will find list ofÂ DatasetsÂ and for each Dataset you see key metadata

number of rows

number of columns

last updated

23/31

For each Dataset you canÂ

View Metadata

View Data (First 10 Rows)

View Data Types

View Dependencies

View Dependencies will show which Pipelines are referring to this DatasetÂ

24/31

Persistent StreamsÂ (or pstreams) are data repositories to hold real-time streaming data and analytics.Â

pstreams are created and used by cfxCloud as well as Services to provide real-time analytics.

Here you can View and Query Data in pstreamsÂ

25/31

Here you can View DataÂ in pstream.

26/31

Here you can see real-time analytics captured for Log Intelligence service.Â

Take a note of data size (byte_count), event type (type), syslog severity (syslog_severity) etc.

27/31

Log ArchivesÂ are object storage repositories (cloud or on-prem) to store raw and unfiltered data.Â Data can be sent to Log Archives in two ways:

Directly from Event Gateway (which is our log forwarder)

From Pipelines

Logs/Events can also Replayed from Log Archives using data bots

28/31

Here you will see list of Log Archive Repositories.Â Any AWS S3 compatible object storage would work.Â

In this case, we have an on-prem Minio storage and AWS S3.Â

Â

You can add new repositories by clicking here. Typically you would need hostname, bucket name, access key, secret key etc.

29/31

You can View Details of repository

30/31

Here you can see

Number of Archives - typically one for each application/team

Number of Days of Data

First Day, Last Day

31/31

Have Questions, or Need Help?Â Click on SupportÂ from main left menu. Heree you can

View Documentation

Contact Support

Join our growing community on Slack

Welcome! Click to start the walkthrough

Autoplay

You have reached the end of this walkthrough. Thank you!

Embed Code

Small

Medium

Large

Extra Large

HTML embed code (iframe)

Steps

Click on Home
Left Mouseover
Click on Services
Click on Services
Click on Analytics
Click on Analytics Summary
Click on Worker Job Activity
Click on Event Gateway Ingested Data
Click on Event Gateway Ingested Event Count
Click on Configuration
Click on Fabric Configuration
Click on Fabric Components
Click on RDA Client
Click on Artifacts
Click on Service Blueprints
Click on Pipelines View Details
Click on Search
Click on 3-button menu
Click on View
Click on Close
Click on Datasets View Details
Click on Search
Click on View Data (First 10 Rows)
Click on Persistent Streams - View Details
Click on View Data
Click on Close
Click on Log Archives - View Details
Click on Log Archive Repositories
Click on View Details
Click on Log Archives
Click on Support

0/3

There are a few loopholes and inconsistencies (for example {spoiler alert}: how the actual f@#k does the clan keep 3 giant ancient anacondas fed and alive ffs??) in conjunction with a few sub-par performances, but, overall its a pleasant spinoff and accompaniment to the other 2 films in the franchise, and does so with considerably less focus on firearms and more on the action one might expect to see from a strong culturally Japanese standpoint.

Click on Event Processing Report

Home PageÂ shows Overall Analytics and Enabled Services

Hover mouse to left side to see Main Menu

Services page

List of Enabled Services Add New Services Launch Service Dashboard

Overall Analytics and Monitoring of Services, Fabric Components and AIOps

Analytics Summary

Trend of job executions across all workers

Trend of all logs/events ingested into Event GatewayÂ Event Gateway is how you Get Data In (GDI) into cfxCloud

Events Per Second (EPS).Â Here you can see we hit almost 250K events/second

This will launch Configuration and Management page for various key components of cfxCloud

RDA Fabric configuration identifies you as a secure and authenticated entity on RDA Fabric. Use this configuration to correctly register and authenticate your other fabric components like Workers, Event Gateway, RDA client etc.

Click on Fabric Components

View Details

This pane shows key cfxCloud artifacts

View and Edit RDA Pipelines. Pipelines allow you to automate data operations. Pipelines, run on any Worker node To interactively work with bots and pipelines you can launch RDA Studio from Home page

Click on Search

Click on 3-button menu

This pane shows key cfxCloud artifacts

Close the dialog after reviewing Pipeline content

Datasets are data repositories for bulk or batch data. Datasets are typically created/used by Pipelines. Datasets can also be used for enrichment, lookups, key-value pairs etc.

Here you will find list ofÂ DatasetsÂ and for each Dataset you see key metadata number of rows number of columns last updated

For each Dataset you canÂ View Metadata View Data (First 10 Rows) View Data Types View Dependencies View Dependencies will show which Pipelines are referring to this DatasetÂ

Persistent StreamsÂ (or pstreams) are data repositories to hold real-time streaming data and analytics.Â pstreams are created and used by cfxCloud as well as Services to provide real-time analytics. Here you can View and Query Data in pstreamsÂ

Here you can View DataÂ in pstream.

Here you can see real-time analytics captured for Log Intelligence service.Â Take a note of data size (byte_count), event type (type), syslog severity (syslog_severity) etc.

Log ArchivesÂ are object storage repositories (cloud or on-prem) to store raw and unfiltered data.Â Data can be sent to Log Archives in two ways: Directly from Event Gateway (which is our log forwarder) From Pipelines Logs/Events can also Replayed from Log Archives using data bots

Here you will see list of Log Archive Repositories.Â Any AWS S3 compatible object storage would work.Â In this case, we have an on-prem Minio storage and AWS S3.Â Â

You can View Details of repository

Here you can see Number of Archives - typically one for each application/team Number of Days of Data First Day, Last Day

Have Questions, or Need Help?Â Click on SupportÂ from main left menu. Heree you can View Documentation Contact Support Join our growing community on Slack

Please enter details to continue

Please enter your email to continue

List of Enabled Services

Add New Services

Launch Service Dashboard

Trend of all logs/events ingested into Event GatewayÂ

Event Gateway is how you Get Data In (GDI) into cfxCloud

Events Per Second (EPS).Â

Here you can see we hit almost 250K events/second

RDA Fabric configuration identifies you as a secure and authenticated entity on RDA Fabric.

Use this configuration to correctly register and authenticate your other fabric components like Workers, Event Gateway, RDA client etc.

View and Edit RDA Pipelines. Pipelines allow you to automate data operations.

Pipelines, run on any Worker node

To interactively work with bots and pipelines you can launch RDA Studio from Home page

Datasets are data repositories for bulk or batch data.

Datasets are typically created/used by Pipelines. Datasets can also be used for enrichment, lookups, key-value pairs etc.

Here you will find list ofÂ DatasetsÂ and for each Dataset you see key metadata

number of rows

number of columns

last updated

For each Dataset you canÂ

View Metadata

View Data (First 10 Rows)

View Data Types

View Dependencies

View Dependencies will show which Pipelines are referring to this DatasetÂ

Persistent StreamsÂ (or pstreams) are data repositories to hold real-time streaming data and analytics.Â

pstreams are created and used by cfxCloud as well as Services to provide real-time analytics.

Here you can View and Query Data in pstreamsÂ

Here you can see real-time analytics captured for Log Intelligence service.Â

Take a note of data size (byte_count), event type (type), syslog severity (syslog_severity) etc.

Log ArchivesÂ are object storage repositories (cloud or on-prem) to store raw and unfiltered data.Â Data can be sent to Log Archives in two ways:

Directly from Event Gateway (which is our log forwarder)

From Pipelines

Logs/Events can also Replayed from Log Archives using data bots

Here you will see list of Log Archive Repositories.Â Any AWS S3 compatible object storage would work.Â

In this case, we have an on-prem Minio storage and AWS S3.Â

Â

Here you can see

Number of Archives - typically one for each application/team

Number of Days of Data

First Day, Last Day

Have Questions, or Need Help?Â Click on SupportÂ from main left menu. Heree you can

View Documentation

Contact Support

Join our growing community on Slack