ExportHistoryToTSV tool

[StanleyK]

Hi,

is it possible please to obtain somewhere the source code of SCX tool "ExportHistoryToTSV v1.0.30"?

It's very helpful tool, but it isn't suitable for a big amount of historic records (eg. 21mil records per point).

Thanks.

[BevanWeiss]

I haven't heard of this specific tool, and I don't remember anything similar being on the Resource Centre.

Are you sure that it came from Serck / Schneider?

Do you have a link to the source that you obtained it from?

There are a number of ways to get data out of ClearSCADA / Geo SCADA Expert.

It might be worth having a look through the code samples available here:

https://github.com/GeoSCADA/Utilities-and-Examples

In particular

https://github.com/GeoSCADA/Utilities-and-Examples/blob/ce75d441f7fe2af64f0910eefe8038bb1af39c7b/Ins... 

If you are looking to retrieve data of 21million events over a large number of points then you need to accept that this is a lot of data, and that if you expand it into a Tab Separated Values format (inefficient data storage) then it will both take up a lot of disk space, and it will also be slow, just because it's a lot of disk transactions.  The faster your disks (for both source and destination), the better..  if you're using magnetic drives, it will be slow.

There are other ways which don't involve code, like the Crystal Reports driver, or SQL Export.  But given the data volumes you're talking about I think these other layers will only cost you performance.

[sbeadle]

Hi All,

that tool is mine!

It's available compiled on the KB in the Tools and Samples page, see "Export and Import History Tool".

It's quite useful to both extract and restore historic data, as you can select the points and time period, then export to a Tab-Separated file per point. Import, like export, includes the additional fields like quality and reason.

Unfortunately I wrote it a long time ago, and it's in VB6. Very simple though, and if you translate to .Net then please consider open-sourcing - contact me if you wish me to add it to our GitHub.

I attach the source to this post.

Steve B

[BevanWeiss]

It looks like it is using OLE-DB, so I expect performance gains could be had if it migrated to using the .NET API instead 😊

But I reckon this is a task best left to the reader 😉

[StanleyK]

Hi,

thanks for your answer.

In the end, I solve it with ViewX scripting, I have exported historic files diveded after 10k records per CSV file. And it looks fast.

[ggallardo]

Hi,

We want to use the ExportHistoryToTSV to retrieve data from a Hot-Standby configuration GEOSCADA 2019 server, but we keep getting runtime-error '76': Path not found.

The folder specified in Target Folder already exists and we have run the tool in a local server without problem. Can you help us with more information about the error or with your experience with similar outcomes?

The data is from only a week

Thanks

[BevanWeiss]

You should raise a new topic for your issue.  If you mention @sbeadle he might be able to assist you with this.

[sbeadle]

The tool is built using VB6, so may not support UNC file paths. Are you using a drive letter? e.g. c:\ or x:\ ? 

[Clearscada_EIT]

THanks 

[AndrewScott]

@Clearscada_EIT, @sbeadle already attached the VB6 source code for ExportHistoryToTSV to the third post in this topic (above).

https://community.se.com/krefy84679/attachments/krefy84679/ecostruxure-geo-scada-expert-forum/2683/1... 

[sbeadle · Accepted solution]

I have written a new version in .Net, available on the KB in the Tools and Samples page, see "Export and Import History Tool".

Source code available on our GitHub too!

[StanleyK]

Thank you very much.