Help
  • Explore Community
  • Get Started
  • Ask the Community
  • How-To & Best Practices
  • Contact Support
Notifications
Login / Register
Community
Community
Notifications
close
  • Forums
  • Knowledge Center
  • Events & Webinars
  • Ideas
  • Blogs
Help
Help
  • Explore Community
  • Get Started
  • Ask the Community
  • How-To & Best Practices
  • Contact Support
Login / Register
Sustainability
Sustainability

Join our "Ask Me About" community webinar on May 20th at 9 AM CET and 5 PM CET to explore cybersecurity and monitoring for Data Center and edge IT. Learn about market trends, cutting-edge technologies, and best practices from industry experts.
Register and secure your Critical IT infrastructure

Database Stream Files

Geo SCADA Knowledge Base

Access vast amounts of technical know-how and pro tips from our community of Geo SCADA experts.

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • Home
  • Schneider Electric Community
  • Knowledge Center
  • Geo SCADA Knowledge Base
  • Database Stream Files
Invite a Co-worker
Send a co-worker an invite to the portal.Just enter their email address and we'll connect them to register. After joining, they will belong to the same company.
You have entered an invalid email address. Please re-enter the email address.
This co-worker has already been invited to the Exchange portal. Please invite another co-worker.
Please enter email address
Send Invite Cancel
Invitation Sent
Your invitation was sent.Thanks for sharing Exchange with your co-worker.
Send New Invite Close
Top Labels
Top Labels
  • Alphabetical
  • database 32
  • Web Server and Client 31
  • WebX 19
  • Request Form 18
  • Lists, Events & Alarms 16
  • ViewX 15
  • Application Programming 12
  • Setup 12
  • Telemetry 8
  • Events & Alarms 7
  • Lists 7
  • Mimic Graphics 7
  • Downloads 6
  • Support 5
  • IoT 5
  • SCADA 5
  • Geo SCADA Expert 5
  • Drivers and Communications 4
  • Security 4
  • DNP 3 3
  • IEC 61131-3 Logic 3
  • Trends and Historian 2
  • Virtual ViewX 2
  • Geo Scada 1
  • ClearSCADA 1
  • Templates and Instances 1
  • Releases 1
  • Maps and GIS 1
  • Mobile 1
  • Architectures 1
  • Tools & Resources 1
  • Privacy Policy 1
  • OPC-UA 1
  • Previous
  • 1 of 4
  • Next
Latest Blog Posts
  • OPC UA - Driver and Server
  • Requirements for Generating a Valid OPC UA Server Certificate
  • Load Events Using LoadRecord and LoadRecords
  • Geo SCADA Embedded Component Licenses
  • Geo SCADA 2023 Known Issues
Related Products
product field
Schneider Electric
EcoStruxure™ Geo SCADA Expert

Invite a Colleague

Found this content useful? Share it with a Colleague!

Invite a Colleague Invite
Anonymous user
Not applicable
‎2021-06-09 06:16 PM
0 Likes
0
1702
  • Bookmark
  • Subscribe
  • Email to a Friend
  • Printer Friendly Page
  • Report Inappropriate Content

Link copied. Please paste this link to share this article on your social media post.

‎2021-06-09 06:16 PM

Database Stream Files

Originally published on Geo SCADA Knowledge Base by Anonymous user | June 10, 2021 03:16 AM

Home  Back  

The information available in the EcoStruxure Geo SCADA Expert database is stored in different file structures called streams. This allows the separation of data on disk into conveniently sized units for good performance. Different streams are structured differently for the information that they store.

The choice of stream size for the Journal (events), Configuration Changes, and Alarm Summary is important. You should choose these before commissioning a system. Please refer to the product help for advice on how to do this (see the 'Define the Stream Size…' topic in the Server Administration Guide in the help). If you want to investigate making changes to the stream sizes after commissioning then you are advised to read the document attached at the bottom of this page, titled 'Advice on Resizing Historic Streams'.

The different stream types are listed below:

  Name

  Number of Streams per Server Instance

  Examples

  Notes

  Configuration

1 per 16384 object IDs

Information that does not change often:

·       Point limits and anything shown when you click Properties.

·        Logic program code

·       Mimic content

·       Data grid structure and content

·       Data table structure (not content)

  • Stored in ClearSCADA.Dat, ClearSCADAConfig.Dat or ClearSCADAConfig0000.dat (and ClearSCADAConfigStr.dat) depending on your system's upgrade history
  • Synchronized between servers
  • Flushed to disk every minute but only when configuration has changed
  • Saving can have a noticeable performance hit on large databases
  • Is required to run the database
  • Memory resident

Data

1 per 16384 object IDs

Information that changes frequently:

·       A point's CurrentValue and CurrentTime

·       A variable's value

  • Stored in ClearSCADAData.Dat or ClearSCADAData0000.Dat depending on your system's upgrade history
  • Synchronized between servers
  • Flushed to disk only when data has changed (every minute)
  • Usually partnered with the configuration stream, however this stream is not strictly necessary to successfully start a database
  • Memory resident

Dynamic

1

Runtime information that does not have to be retained on start-up:

·       Alarm redirection state

·       A channel’s current state

  • Synchronized between servers
  • Memory resident
  • Not stored on disk

Metadata

1

Extra properties added to database items

Stored in ClearSCADAMetadata.dat, an XML file usually edited via ViewX

  • Flushed to disk on change
  • Synchronized between servers
  • A lack of file on database startup may cause some configuration to be lost
  • Memory resident

Archive

1

The Archive volume index

Stored in ClearSCADAArchive.dat

·       Not synchronized between servers (each server has its own local index)

  • Saved following each archive operation

Files

Multiple, 1 per 'CHisFiles' aggregate

Example: Historical Crystal Reports

  • Stored in the Files directory
  • Disk resident

 

Historic

Multiple, 1 per 'CHistory' aggregate

Point historic data

  • Synchronized between servers
  • New records are flushed to disk every minute (in batches, can take longer or be more frequent)
  • Stored in the History directory
  • Single-purpose stream
  • 32 bytes per record
  • Disk resident, with a memory cache

Journal

Multiple, many database items to one stream

Database item event data and messages

·        Synchronized between servers

·        New records are flushed to disk every minute (in batches, can take longer or be more frequent)

·        Number of streams = (current maximum object id in database/stream size)

  • Stream size can be adjusted for larger systems
  • Stored in the Journal directory
  • Single-purpose stream
  • 768 bytes per record
  • Disk resident, with a small memory cache

DataFiles

Multiple, 1 per type of file for each relevant database item

Contents of data tables

Crystal Report definitions

  • Synchronized between servers
  • Stored in the DataFiles directory

·        Disk resident

ConfigChanges

Multiple, many database items to one stream

Changes to configuration properties stored historically

  • Disabled by default
  • Synchronized between servers
  • Stored in the ConfigChanges directory
  • New records are saved to disk every minute
  • Number of streams = (current maximum object id in database/stream size)
  • Stream size can be adjusted for larger systems
  • Single-purpose stream
  • 1280 bytes per record
  • Disk resident, with a memory cache

  AlarmSummary

Multiple, many database items to one stream

Provides a combined list of current and historic alarms for an item, group of items or the whole database, creating an audit trail for alarms on the system. 

  • Disabled by default
  • Synchronized between servers
  • Stored in the AlarmSummary directory
  • New records are saved to disk every minute
  • Number of streams = (current maximum object id in database/stream size)
  • Stream size can be adjusted for larger systems
  • Single-purpose stream
  • 1280 bytes per record
  • Disk resident, with a memory cache

You can use the Database Schema to determine if a database property is either a Data, Configuration, or Dynamic stream property. However, as a rule of thumb if the property is configurable on the Properties Form of a database item, that property is stored in the Configuration stream.

The performance impact of the Configuration stream is that the Configuration stream is bigger than the Data stream, and as such it takes longer to save and requires a longer duration of a lock on the Geo SCADA Expert database. The Data stream is kept small to allow quicker saving, whereas the Configuration stream has 'the rest of the information', usually resulting in the Configuration stream being approximately five times the size of the Data stream. Because of this impact, configuration changes should be kept to a minimum when using automated tools to change them (that is, Logic and external programs). These programs can change the configuration, often rendering the performance improvement usually seen as minimal. Rapidly changing data should be stored in data properties instead of configuration properties.

Data Grids are also stored in the Configuration stream and so they are not good as a store for constantly changing data, as a change requires a save of the entire Configuration stream for that database item, whereas Data Tables are stored in the DataFiles stream and are more efficient in their storage and transfer.

Go: Home Back

Labels:
  • Geo SCADA Expert

  • Telemetry

  • Tags:
  • english
  • scada
  • SCADA app
  • SCADA software
  • SCADA tutorial
  • Telemetry and SCADA

Author

Biography

Anonymous user

Link copied. Please paste this link to share this article on your social media post.

  • Back to Blog
  • Newer Article
  • Older Article
To The Top!

Forums

  • APC UPS Data Center Backup Solutions
  • EcoStruxure IT
  • EcoStruxure Geo SCADA Expert
  • Metering & Power Quality
  • Schneider Electric Wiser

Knowledge Center

Events & webinars

Ideas

Blogs

Get Started

  • Ask the Community
  • Community Guidelines
  • Community User Guide
  • How-To & Best Practice
  • Experts Leaderboard
  • Contact Support
Brand-Logo
Subscribing is a smart move!
You can subscribe to this board after you log in or create your free account.
Forum-Icon

Create your free account or log in to subscribe to the board - and gain access to more than 10,000+ support articles along with insights from experts and peers.

Register today for FREE

Register Now

Already have an account? Login

Terms & Conditions Privacy Notice Change your Cookie Settings © 2025 Schneider Electric

This is a heading

With achievable small steps, users progress and continually feel satisfaction in task accomplishment.

Usetiful Onboarding Checklist remembers the progress of every user, allowing them to take bite-sized journeys and continue where they left.

of