Devo Adds Multiple Groupings, Enhances User Management in v5.3
Multiple Groupings in UI
It is now possible to create multiple groupings in queries directly from the UI. This avoids workarounds and reinjections that were necessary in the past. Now, in release 5.3, questions such as, “How can I calculate the standard deviation of a given set of averages?” can be added easily in the query editor window of the main query.
In release 5.3, we completely redesigned the role creation page, adding the ability to accommodate duplicate roles and including better descriptors for finer-grained actions. These refactored roles and enhancements eliminate administrative workarounds in managing the Devo environment. In addition, there is a new provisioning API to support user schema.
In Release 5.3, we introduced new API Authentication tokens. Devo administrators can now create tokens restricted to a set of tables, vs. the past API key which offered access to all tables. As Devo environments grow with the need to add 100s of end users, this significantly improves the granularity of security access management. Note, however, that the form to create the tokens remains the same – (Administration>Credentials>Http/Apiv2 Tokens)
Usability enhancements designed to handle complex scenarios
Lastly, based on user feature requests for ease of use in the UI, we’ve added the following enhancements in release 5.3:
- Data lists can now be sorted by name
- The Domain selector now offers a truncated list of domains to address CSS issues on long domain lists.
- Internal email sending capability from within the Devo application is enabled.
Devo enhances User Experience and Statistical capabilities V 5.2.10
In release 5.2.10, Devo offers improvements to our user interface, new statistical operations, improvement in the way the OR selector functions, and a number of bug fixes.
Default table layout
The operation of the Domain Table layout selector has been created so admins can set up and save a Default table layout for each table across a domain, providing users in a domain with a smoother and more predictable display of tables.
New statistical operations
New statistical operations, NNAVG, NNVAR, NNUVAR, NNSTDDEV, NNUSTDDDEV, provide users with different ways to calculate the Average, Variance (Biased and Unbiased) and Standard Deviation (Biased and Unbiased), without taking into account the Null values.
Fixes and enhancements in v5.2.10 make it simpler to use Devo. These include:
- The Monitor widget in Dashboards has been fixed.
- We’ve added an Odata password complexity checker.
- The textbox in the OR selector is no longer case-sensitive and we have improved the usability when a single value is selected.
- The Naming convention in Alerts has been standardized.
- We have made usability enhancements and fixes to Data Search Area.
- Devo has improved the display of menu options in the Data Search area of the user interface to accommodate new options.
Devo Advances Correlation Capabilities V 5.2.8
Cross-Search Graph Widget
The graph widget now allows users to calculate the relationship between different tables, using one or many columns to define that relationship. This takes the already powerful graph chart to a different level, simplifying the visualization of joins (inner and outer) between different data sources.
SORT In Data Search
It’s now easier to search in Devo. Customers can now sort results directly from the Devo user interface by one, many or all columns. In addition, we have improved the layout of the column header menu.
Widget to Query
Want to understand the code behind a Dashboard Widget? Now you can go to the query that generated the widget and see the code.
Mark Dashboards as Favorites
Mark your favorite dashboards so they can be accessed directly from the home page. Change your favorites to suit your needs.
New Shannon Entropy operation
Users can now calculate the Shannon Entropy measure for a given string (https://en.wiktionary.org/wiki/Shannon_entropy). This is useful, for example, in the cybersecurity space when detecting randomly-generated urls.
Devo Improves Dashboards, Visualizations and Queries V 5.2.5
Devo customers can now create custom styles for their line widgets. Additionally, once a customer has defined a custom style for a line widget they can store the style and use it across any line widgets within their domain. A customer might use this new feature when identifying a new exception parameter. Then, you could apply this new style across historical data in the domain. Finally, we have improved the table widget in dashboards to provide filtering and ordering.
With this release you can choose a time zone by the default browser, select a particular time zone, or select a time zone for one session. Customers can use this feature to look at data in time as it happened within the time zone, regardless of where the person(s) issuing the query is/are. This can be very useful, for example, in the world of IIoT where an operator could be in Cleveland but the machine they are operating is somewhere else in the world.
We have enabled the ability to perform OR selections directly from the column headers. Previously, to build an OR logical condition customers had to build the condition as a new column operation. Now, just clicking the OR-selector in the column headings will allow you to select, for example, one city or another, a range of IP addresses or another, and more.
Devo Improves Customer Experience with Dashboard, Data Enhancement and Alert Improvements
Export Widgets to Dashboards
Devo now supports the ability to export widgets to dashboards directly from search. This feature enables customers to create a widget in the search area and then directly export it to a dashboard. With this new feature, Devo transparently does the background work of creating the associated aggregation task, enabling you to gain insights from your data faster. This feature is available for the Voronoi, Heatmap and Line Charts; look for more enhancements to this feature, across the platform, in coming months.
Devo is introducing two new alerting features today:
- Deviation Alert.
- Gradient Alert.
When Devo is given a series of data and the deviation exceeds a defined threshold within a certain period, a deviation alert is issued. An example would be to detect the response time of a server that is significantly higher than the average of all other servers. This scenario could highlight what might be a predictable failure or a one-time anomaly.
The Devo Gradient Alert provides an alert when a value in a given period exceeds that same value in a previous period. Let’s use a use case to explain this one as well. A Devo user could be alerted when the average of a response time is 2x larger than the previous aggregation period. So, if the average in response time variance is in the 20% range, but all of a sudden jumps to 40%, a Gradient Alert would be issued.
With this release, customers can now view and edit lookups directly from Devo . The lookup process allows you to add external data to an existing data table. Previously, this type of external data upload was done via a .CSV file.
- Ability to copy paste the query in the tooltips
- New L&F Contact form
- New firstnotnull() and lastnotnull() operations
- Ability to see your own role
- The default role when creating a user is now “not privileges” to avoid creating wrong “admins”
- Ability to clone dashboards
- Ability to set dashboards as favorites
Devo Expands Chart and Global Search Capabilities V 5.1.5
Expanded Chart Capabilities
Devo Chart Aggregation is the most-used feature amongst our customers. As a software provider the first rule of product development fight club is if it’s not broke, don’t fix it, right? Right. But, what you do is listen to your customers and based on their feedback, bolster that feature. And that’s exactly what we’ve done, adding powerful new features to the chart widget to bolster its usability as a tool for Devo data analysis. In addition to the current line chart widget features, users can now:
- Filter the values of the grouping keys in the chart itself for fast analysis without having to modify the query;
- Configure the color and look and feel of the series;
- Create bands to measure fluctuations.
Devo Broadens Data Delivery, Security and Search. V 5.1.2
Devo now supports sending data directly via http(s) by use of a token. This token is managed within the Devo platform from Administration>Credentials>Http tokens. With this feature, Devo users can define target tables using wildcards and have the ability to validate and centrally manage tokens with the platform. So, what’s a new use case that a Devo user might enable for their company with HTTP Sending? Mobile and IoT are good examples. With HTTP Sending users can enable log sending in any number of scenarios – for example, from an application, mobile device and any smart or IoT device. If you are interested in enabling HTTP Sending, we have included code snippets in the documentation to get you started.
In the never-ending hunt to find nuggets of insight within data, we have made improvements to our Global Search, Search box and Event Flow management. For Global Search, in domains where Global Search is enabled, Devo now keeps search criteria when you drill down into the next level of detail of the data set. For example, it is now possible to do a search on all data and execute that same search on a subset of that original search – the search data is retained for you. Additionally, we have enabled Contextual Help within the Global Search function. With this release, within Global Search, your full search expression is shown and contextual help (a pop-up screen) is available to explain the search syntax and give you examples to complete your search.
Finally, we have added the ability to ensure real-time event flows as default. Within the platform a new account preference is enabled to set the default behavior for the “Real-Time Flow” preference switch. This feature is all about speed: enabling real-time event flows within queries ensures fastest access to the latest (real-time) data sets within the Devo platform. We are thrilled to be delivering enhancements to our data delivery, security and search capabilities within the Devo platform. We believe these improvements bring enhanced speed, mobile and IoT access, SSO ease of use, and search features that will drive further data insight and analysis for users of the Devo platform.
Devo is committed to supporting industry standards around security and data access. With this release, Devo can now implement the Security Assertion Markup Language (SAML) standard to perform delegated authentication. SAML ensures the authentication and authorization exchange of data between parties (identity and service provider, for example). Single Sign-on (SSO) is the most prevalent use case for SAML Integration. Customers that implement an identification provider (Google, Okta or OneLogin, among others), can now login to the Devo platform via SSO.
ASILO (Aggregation Stored in Logs)
All the aggregation back end technology has been moved from MONGO DB to Devo technology. This means that whenever an aggregation task (aka, datasource or casperable) is created is not stored in Mongo anymore but in a LT table. This represents a major shift in the architecture that will allow better scalability, performance and reliability. There is little change or none from the customer perspective but massive in the internals.
New links to doc
New links to doc all over the app.
Queries tooltips (v5.0)
Ability to see query’s linq in a tooltip in favorite and last queries.
Ability to download an existing lookup as a csv.
New first steps Look and Feel
New Look and Feel of the first steps page, including links to ”send your first data” and “sample data injection. The objective is to have a clearer call to action for new customers when they first land into the app.
New finder edition mode
The edition mode has been completely overhauled to improve its usability when there is a big amount of tables to manage, as it now allows to select/deselect multiple tables at the same time. It also implement clearer call to actions and a sleeker UI.
Sample data injection
Demo data sets available for customers to start extracting value out of Devo asap. This will come along a documented use case.
Odata Informative message
To avoid misusage of Odata a warning message is included in the feed creation.
New Social Intelligence interface
Total overhaul of the social intelligence pages, making it easier to use.
Copy/Paste Icon in API Key/Secret
Copy/Paste Icon in API Key/Secret to enhance usability
Alerts filtering simplified
Two levels / not three.
New query Management tool
Help domain administrators to manage the running queries.
Usability improvements in Injections
To avoid confusion when sending to other domains.
Include dots and lines in graphs
Ability to mix lines and dots in the same graph.
Automatic detection of Browser Exhaustion In Loxcope
In scenarios where the amount of events is too big for a human being to read and for the browser to cope with the app auto adjusts.
Finder (search) improved performance (v5.0)
Improved response time when opening the ”Search Data” option so the tables list appear way faster.
- New Enhanced Voronoi : New capabilities and configuration options
- UI Coherence tasks: UI improvements in empty screens, old forms removed, headers look and feel unified
- Improvements on Windows Agent
- Improvements into KakFa / Hdfs connectors
- Complete technical refactor on Alerts Functionality: Bug solving
- Menu names change: Data Search, Data upload, Data Management…
Enhancements in graphs
A few enhancement the graph widget have been included in this last version. When assigning a geographical location it can be done by just drag and dropping the coordinates in one step as opposed to having to include the latitude and the longitude separately. For example see below. It is also possible to assign colors to a given nodes by drag and dropping the chosen metric as follows. For detailed information please visit
The charts now provide the possibility to apply two different styles, dark and light, besides a new set of switches to enable/disable layout settings as the chart type and the graph options. The options are accessed by clicking on the “brush” icon in the upper right corner Should you want to apply these settings to other charts visible at the same time this can be done by clicking “Apply settings to all” Additionally other enhancements have been applied as for example the ability to move signal between boxes and reorder signals within the same box. And (this applies to all widgets) you can move the widget around in the case you need room to operate and see the data but without losing it as it happened in the past.
Refresh frequency selection button
A small improvement for panels. A selection button has been included into panels to choose which refresh frequency you want your the panel, either the grouping period used in the query or the last available period in the platform.
OData/API feeds management
A new management area for Api and OData feeds is now available. Customers now will be able to fully manage their feeds, including filtering by feed, change their status (enabled/disabled), change their authentication type, description name, etc. Another main update and improvement is the ability to identify the feeds when they are created and select the authentication type so we can address all the different use cases from the different OData consumers.
Several improvements in chart widget usability
- Information pop ups shown in multiple graphs opened
- Design improvements
- Drag, drop and order of the tags
- Bug solved on widgets not being recoverable when they are moved off limits
- Short cuts to make the Mark Graphs
- When select rows in datatable mark in graphs with a “flag” with “stairs” style
- Ability to save graphs into a png
- Order in tooltips
- Double click in graph signals (labels) must disable this signal
- In graphs when x position dont have value the line must break not go to 0
- Toolbar added in windows
- Ability to maximize the window
PDF export in Dashboards
Now it is possible to download as a PDF a given Dashboard It will give the possibility to select which widgets in the dashboard will be displayed in the exported PDF.
Improvements on Send Data from Local/Dropbox
- Support of windows file formats
- Preview of unmatched lines during file evaluation task
- New date formats added
New security feeds
We have added in selected domains new lookups that contains information about malware and fraud threats based on a given IP. This information is gathered daily from public OSINT (Open source Intelligence) sources providing a rich source of information that can be correlated with events going well beyond the current “reputation IP” available operations. By now this lookups are only activated on demand on selected domains. Should you need their activation please contact us.
Now it is possible to set up an alert when the number of events of a given source is not sending data or under a certain threshold.
We now allow to upload files directly to Devo either from your Dropbox account or from your local file system (with a 20MB limit). You will be able to either upload files to start using Devo or to perform one-off analysis that require no continuous data ingestion. This new feature both enables you to use the current date as the event date or to select a date included in the log itself, supporting a big set of different date formats.
Default finder in User Role creation
You can now associate a Default Finder when creating a new User Role.
Lookups restriction by table
It is possible now to restrict a lookup to be used only from certain tables only.
Topological view with Live Tiles
A new powerful tool has been added to complement the current finder. The tool will allow the creation of “panels” which will represent graphically a system infrastructure or process flow or whatever relationship that needs to be graphically represented. Once this is plotted each node of the panel can be linked with a query and/or an alert. This will provide a powerful high level tool to manage more complex architectures and its inherent relationships. Additionally you can include ?live data in the panels so you can track a given metric/status for analysis or surveillance.
New operations available.
New Graph Widget configuration capabilities + new options
A new way to set the graph up has been implemented to compose more complex representations and make it more customer friendly. Now a graph is used to configure the final graph including the option of setting bidirectional relationships, indicate that node types are equal, making more obvious the latitude and longitude properties. The way to introduce the metrics has also been redesigned to make it more appealing. And now the color of the nodes can be changed as well the icon appearance.
Now it is possible to define an alias for a given table and use the finder using Alias from that moment on.
Filter tables by activity
We have added the capability of hiding tables from the finder without activity for a given time period.
Improvements on ODATA
ODATA feeds have been improved with the following enhancements:
– Ability to indicate relative dates
– Ability to process in streaming
– Boolean data types added
– Fixes with some data types
– Improvements on memory usage
– Basic authentication on feeds
Secured OData feeds
The OData feeds will now have basic authentication. The default credentials will be set from Preferences > Account Preferences > API
Multi Factor Authentication
Now it is possible to enable Multi Factor Authentication (MFA) as an extra security mechanism on top of the current username and password validation. Using any of the mobile compatible applications you’ll be prompted to enter a temporarily generated code to enter to your Devo account. This can be configured in Preferences, Account Preferences.
New relays creation page
The relay creation page has been simplified and improved. Additionally the non valid options (Cloud relay and Secure sending) have been removed.
New smart table headers
Some of the tables across the app have a brand new header that allows to filter and sort at column level by just either clicking on the funnel icon or the up-down arrows. The sort mechanism is particularly handy as it allows to go to the last record without having to scroll down in a large set of data. Updates in Graph widget now it is available: a new option to compute node sizes as max(sum(incoming links), sum(outgoing links)) , new setting to specify links curvature. New map mode setting to show/hide unpositioned nodes, new setting to specify initial mode (graph or map), numbers use SI suffixes (K, G, M) by default now, limbo area is now delimited with a visible rectangle and a title.
My.App tables creation
From now on the my.app tables are created automatically, and the formatting emails are not sent unless this is requested proactively by the user.
Union and injections now available in all domains
The union operation as well as the data injection capabilities are now available in all domains.
New Widget “Graph Diagram”
A new widget has been included in the product, by now only in the query area. It allows to graphically represent the relationship between nodes of a given type as, for example,the relationship between source and destination IPs in a web traffic log file. Additionally, if location information is provided to each of the nodes, the given graph can be overlapped on a map to get a graphical representation adding the location value to the nodes’ relationship.
New widget “Time Heatmap”
A new widget named “Team heatmap” is added to the product. Given a time analysis period and a time aggrupation a matrix is produced representing each cell the density of a given value with a color scale. This new widget is available both in the query area and in the dashboard