Help
  • Explore Community
  • Get Started
  • Ask the Community
  • How-To & Best Practices
  • Contact Support
Notifications
Login / Register
Community
Community
Notifications
close
  • Forums
  • Knowledge Center
  • Events & Webinars
  • Ideas
  • Blogs
Help
Help
  • Explore Community
  • Get Started
  • Ask the Community
  • How-To & Best Practices
  • Contact Support
Login / Register
Sustainability
Sustainability

Ask Me About Webinar: Data Center Assets - Modeling, Cooling, and CFD Simulation
Join our 30-minute expert session on July 10, 2025 (9:00 AM & 5:00 PM CET), to explore Digital Twins, cooling simulations, and IT infrastructure modeling. Learn how to boost resiliency and plan power capacity effectively. Register now to secure your spot!

ETL: Failed to sync between staging DB and DCO db?

EcoStruxure IT forum

Schneider Electric support forum about installation and configuration for DCIM including EcoStruxure IT Expert, IT Advisor, Data Center Expert, and NetBotz

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • Home
  • Schneider Electric Community
  • EcoStruxure IT
  • EcoStruxure IT forum
  • ETL: Failed to sync between staging DB and DCO db?
Options
  • Mark Topic as New
  • Mark Topic as Read
  • Float this Topic for Current User
  • Bookmark
  • Subscribe
  • Mute
  • Printer Friendly Page
Invite a Co-worker
Send a co-worker an invite to the portal.Just enter their email address and we'll connect them to register. After joining, they will belong to the same company.
You have entered an invalid email address. Please re-enter the email address.
This co-worker has already been invited to the Exchange portal. Please invite another co-worker.
Please enter email address
Send Invite Cancel
Invitation Sent
Your invitation was sent.Thanks for sharing Exchange with your co-worker.
Send New Invite Close
Top Experts
User Count
Cory_McDonald
Admiral Cory_McDonald Admiral
124
Jef
Admiral Jef Admiral
110
gsterling
Captain gsterling Captain
71
APC_Steve
Captain APC_Steve Captain
65
View All

Invite a Colleague

Found this content useful? Share it with a Colleague!

Invite a Colleague Invite
Solved Go to Solution
Back to EcoStruxure IT forum
Solved
DCIM_Support
Picard DCIM_Support
Picard

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

0 Likes
6
885
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Link copied. Please paste this link to share this article on your social media post.

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

ETL: Failed to sync between staging DB and DCO db?

I'm trying to use the "Netwok import" job on "ETL Integration Examples".

Imported configuration items are successfully detected and then I associated them to the devices on DCO Client.

After forcing synchronization, the network port are added in the network tab on DCO client.
But, I still could not find the network connection between the devices on DCO Client.

 

I checked the "network_connection" tables in staging database and found that all the "state_flag" columns are still "changed". So, I think it's still not yet synced with DCO database.

I have several questions.

1) Log file
  I'd like to check the log for synchronizing between staging database and DCO database. Which log file I should check?

  # I checked the logs below but I could not find doubtful records in the logs.
     /opt/jboss-as/standalone/log/etl.log
     /opt/jboss-as/standalone/log/server.log

2) DCO client view for network_connection

 I assume that, if it's successfully synchronized, the imported network connection should be graphically shown on the network view as which is manually connected on DCO client. 
Is my understanding correct?

3) How to delete the imported configuration items from DCO?
  This is not directly relate with this issue, but I'd like to remove several configuration items from "Unassociated Devices" tab. How should I delete them?

I assume that I can delete them by changing the corresponding state flag value from "synced" to "changed" from pgAdmin.
Is that ok? (I'm doing this test on my testing environment.)

Regards,

Akihiro Yamagami

(CID:134034085)

Labels
  • Labels:
  • Data Center Operation
Reply

Link copied. Please paste this link to share this article on your social media post.

Contact Support
  • All forum topics
  • Previous Topic
  • Next Topic

Accepted Solutions
DCIM_Support
Picard DCIM_Support
Picard

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

0 Likes
4
885
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Link copied. Please paste this link to share this article on your social media post.

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

Hello Akihiro

Perhaps someone else might assist you with the import etc of cable links.

Keeping Track of Information State has a good description of how to use state_flag.

To delete CIs, set state_flag to "delete", then sync.  If it's all good, the sync will change state_flag to "sync_deleted" 

I hope that helps

Cheers

Ed

 

 

new, changed, deleted, synced

(CID:134034098)

See Answer In Context

Reply

Link copied. Please paste this link to share this article on your social media post.

Contact Support
Replies 6
DCIM_Support
Picard DCIM_Support
Picard

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

0 Likes
4
886
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Link copied. Please paste this link to share this article on your social media post.

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

Hello Akihiro

Perhaps someone else might assist you with the import etc of cable links.

Keeping Track of Information State has a good description of how to use state_flag.

To delete CIs, set state_flag to "delete", then sync.  If it's all good, the sync will change state_flag to "sync_deleted" 

I hope that helps

Cheers

Ed

 

 

new, changed, deleted, synced

(CID:134034098)

Reply

Link copied. Please paste this link to share this article on your social media post.

Contact Support
DCIM_Support
Picard DCIM_Support
Picard

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

In response to DCIM_Support
0 Likes
0
885
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Link copied. Please paste this link to share this article on your social media post.

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

Hello Akihiro. You are correct the desktop client should display the new connections after they are processed through ETL. The client may not show them immediately if your desktop client is left in planning mode. Clicking the save button or switching to operations mode should cause the desktop client to update.

I have attached a brief pdf which describes how to import several items into DCO using ETL including network connections.

ETL-Database-Demo - V2.pdf

Couple of things to keep in mind for this to work. The two items you are connecting via a network connection must be defined in the configuration_item table in the import database and they must be associated to their appropriate assets in DCO before the connection will be completed. So I would suggest creating your configuration_item entries, associating them to DCO assets, then completing the network connection definitions in ETL.

Regards

Greg Sterling

(CID:134034841)

Reply

Link copied. Please paste this link to share this article on your social media post.

Contact Support
DCIM_Support
Picard DCIM_Support
Picard

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

In response to DCIM_Support
0 Likes
0
885
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Link copied. Please paste this link to share this article on your social media post.

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

Hello Ed and Greg,

Thank you for your information.
Using the pdf document, after several try and error, I finally could see the network connection which is imported using ETL on DCO client.
As Ed commented, it seems that it's because of the below.

  • In the "network_connection" table, the values of "cable_type_id" field are missing.
  • In the "cable_type" table, no cable type is defined.

After editing the values, using PgAdmin, I could see the network connections. 

In the "NETWORK_CONNECTION" table documentation, there is no description about the "cable_type_id".

I think this it's better to update the document at least. How do you think?

http://sxwhelpcenter.ecostruxureit.com/display/public/DCIMDEVELOPER/ETL+Import+Database

By the way, concerning about 3 questions from me, I still don't have answer for "1) Log file" in the below.
Do you have any information about this?

> 1) Log file
>I'd like to check the log for synchronizing between staging database and DCO database. Which log file I should check?

># I checked the logs below but I could not find doubtful records in the logs.
>/opt/jboss-as/standalone/log/etl.log
>/opt/jboss-as/standalone/log/server.log

(CID:134035507)

Reply

Link copied. Please paste this link to share this article on your social media post.

Contact Support
DCIM_Support
Picard DCIM_Support
Picard

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

In response to DCIM_Support
0 Likes
0
885
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Link copied. Please paste this link to share this article on your social media post.

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

Hi, check server.log again.   At the command prompt issue

cd 
tail -f server.log| grep -i etl

then start a manual sync and you should see some messages.   You can then use some log watching software (e.g. swatch) to watch server.log and email you when certain events occur

(CID:134036368)

Reply

Link copied. Please paste this link to share this article on your social media post.

Contact Support
DCIM_Support
Picard DCIM_Support
Picard

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

In response to DCIM_Support
0 Likes
0
885
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Link copied. Please paste this link to share this article on your social media post.

Posted: ‎2020-07-04 11:50 PM . Last Modified: ‎2024-04-04 02:25 AM

Hello Ed, 

 Thank you for your kind explanation. I could find several warning messages relating to ETL.  I'm still not sure whether it's enough or not, but it's quite helpful.

Regards,

Akihiro

(CID:134037933)

Reply

Link copied. Please paste this link to share this article on your social media post.

Contact Support
DCIM_Support
Picard DCIM_Support
Picard

Posted: ‎2020-07-04 11:51 PM . Last Modified: ‎2023-10-22 01:57 AM

0 Likes
0
885
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Link copied. Please paste this link to share this article on your social media post.

Posted: ‎2020-07-04 11:51 PM . Last Modified: ‎2023-10-22 01:57 AM

superhero.png

This question is closed for comments. You're welcome to start a new topic if you have further comments on this issue.

Reply

Link copied. Please paste this link to share this article on your social media post.

Contact Support
To The Top!

Forums

  • APC UPS Data Center Backup Solutions
  • EcoStruxure IT
  • EcoStruxure Geo SCADA Expert
  • Metering & Power Quality
  • Schneider Electric Wiser

Knowledge Center

Events & webinars

Ideas

Blogs

Get Started

  • Ask the Community
  • Community Guidelines
  • Community User Guide
  • How-To & Best Practice
  • Experts Leaderboard
  • Contact Support
Brand-Logo
Subscribing is a smart move!
You can subscribe to this board after you log in or create your free account.
Forum-Icon

Create your free account or log in to subscribe to the board - and gain access to more than 10,000+ support articles along with insights from experts and peers.

Register today for FREE

Register Now

Already have an account? Login

Terms & Conditions Privacy Notice Change your Cookie Settings © 2025 Schneider Electric

This is a heading

With achievable small steps, users progress and continually feel satisfaction in task accomplishment.

Usetiful Onboarding Checklist remembers the progress of every user, allowing them to take bite-sized journeys and continue where they left.

of