Help
  • Explore Community
  • Get Started
  • Ask the Community
  • How-To & Best Practices
  • Contact Support
Notifications
Login / Register
Community
Community
Notifications
close
  • Forums
  • Knowledge Center
  • Events & Webinars
  • Ideas
  • Blogs
Help
Help
  • Explore Community
  • Get Started
  • Ask the Community
  • How-To & Best Practices
  • Contact Support
Login / Register
Sustainability
Sustainability

Join our "Ask Me About" community webinar on May 20th at 9 AM CET and 5 PM CET to explore cybersecurity and monitoring for Data Center and edge IT. Learn about market trends, cutting-edge technologies, and best practices from industry experts.
Register and secure your Critical IT infrastructure

ETL - Extract Transform Load

ETL - Extract Transform Load

EcoStruxure IT Advisor integrations for the advanced user

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • Home
  • Schneider Electric Community
  • EcoStruxure IT Help Center
  • EcoStruxure IT Help Center Categories
  • IT Advisor
  • ETL - Extract Transform Load
  • ETL - Extract Transform Load
  • ETL - Extract Transform Load
Options
  • Subscribe to RSS Feed
  • Mark as New
  • Mark as Read
  • Bookmark
  • Subscribe
  • Email to a Friend
  • Printer Friendly Page
  • Report Inappropriate Content
Invite a Co-worker
Send a co-worker an invite to the portal.Just enter their email address and we'll connect them to register. After joining, they will belong to the same company.
You have entered an invalid email address. Please re-enter the email address.
This co-worker has already been invited to the Exchange portal. Please invite another co-worker.
Please enter email address
Send Invite Cancel
Invitation Sent
Your invitation was sent.Thanks for sharing Exchange with your co-worker.
Send New Invite Close

Related Forums

  • EcoStruxure IT forum

  • APC UPS Data Center & Enterprise Solutions Forum

Previous Next

Invite a Colleague

Found this content useful? Share it with a Colleague!

Invite a Colleague Invite

EcoStruxure IT Support

Submit a support request for additional assistance with EcoStruxure IT software.

Request Support
Back to ETL - Extract Transform Load
Options
  • Subscribe to RSS Feed
  • Mark as New
  • Mark as Read
  • Bookmark
  • Subscribe
  • Email to a Friend
  • Printer Friendly Page
  • Report Inappropriate Content
0 Likes
3339 Views

Link copied. Please paste this link to share this article on your social media post.

Trying to translate this page to your language?
Select your language from the translate dropdown in the upper right. arrow
Translate to: English
  • (Français) French
  • (Deutsche) German
  • (Italiano) Italian
  • (Português) Portuguese
  • (Русский) Russian
  • (Español) Spanish

ETL - Extract Transform Load

Picard EcoStruxureIT
‎2020-04-06 06:49 AM

Last Updated: Sisko JLehr Sisko ‎2023-12-19 11:28 AM

More about ETL

Setting up an ETL configuration

ETL examples, troubleshooting, and tips

 

One of the ways to integrate with external systems is using the Extract, Transform, Load (ETL) system. The ETL system creates databases that can be accessed directly by 3rd party tools and solutions. It also allows scheduled execution of transformation scripts on the IT Advisor server. Together this gives the ability to extract and enter data on the ITA server.

 

Based on the ETL system, it is possible to develop custom solutions, integrating ITA with a broad range of data sources.

 

ETL can be used in 2 ways: Importing Data in to and Exporting Data from IT Advisor.

 

ITA_ETL_intro_1_360007339757.pngITA_ETL_intro_1_360007339757.png

 

Importing data

 

  1. Importing data into IT Advisor is used whenever data must be provided to ITA.
    The data is being imported via the ETL Import Database. 
    There are 2 ways of importing data. One where "Data is Ready" and one where "Data needs change" before being used in ITA.
    1. Data is Ready
      When data is ready the only thing that must be done is setting up the integration between the external system providing data and ITA.
      This is done at database level. The integration is configured using the server configuration interface and can be found here
    2. Data needs change
      When data needs to be changed/modified before it is used inside ITA this can be done using a transformation or a set of transformations called a job. More information here
      Once transformation(s) are in place the integration is configured using the server configuration interface and can be found here

 

Exporting data

 

  1. Exporting data from IT Advisor is used when ever data is used outside ITA.
    The data is exported using the ETL Export Database.
    The data exported from IT Advisor cannot be changed by transformations inside the ITA server. If transformation is needed this must be done outside the server in a separate setup.
  2. Setting up the export is done using the server configuration interface as described here

 

ITA_ETL_intro_2_360007339757.pngITA_ETL_intro_2_360007339757.png

 

Upgrading ETL external system integration

 

No files (or databases) will be deleted when upgrading/restoring an ITA system. Upgrade of the ETL system is a part of the general ITA upgrade.

 

When upgrading an existing solution running ETL for importing and/or exporting data to ITA a couple of guidelines are:

 

  • Both import and export databases are viewed as "api-like" interface to the system.
  • At any point in time the data in the import and/or export database represents the currently best known state of the system.
  • The ETL databases do not contain the sole instance of any piece of data.

 

Database

 

This means that it is always safe to drop any ETL database and recreate it without the risk of losing data.

 

Since no data is stored in the ETL database, it is highly recommended to drop the databases and recreate them rather than moving them. This will allow databases to follow potential new database schema(s). To use the old databases, these must be moved manually which is not recommended.

 

Transformations

 

When upgrading from previous versions the old transformation files will be moved into the folder /data/pentaho_backup. The transformation files must manually be moved from /data/pentaho_backup into a potential new folder structure (described below).

 

Restoring an old backup will place transformation files in the same structure as they were in the backed up system. Please note this might not be the correct folder structure since the structure has changed between versions.

 

Note: When moving/copying files into the new folder structure make sure to preserve the ownership of the folders in order for the future script to be added and executed.

 

The transformation files must be placed in their respective folders on the ITA server.

The transformation files folder structure on the ITA server is /data/pentaho/export or /data/pentaho/import. You can find more information about the ETL Transformation here.

Was this article helpful? Yes No
100% helpful (1/1)

Link copied. Please paste this link to share this article on your social media post.

Didn't find what you are looking for? Ask our Experts
To The Top!

Forums

  • APC UPS Data Center Backup Solutions
  • EcoStruxure IT
  • EcoStruxure Geo SCADA Expert
  • Metering & Power Quality
  • Schneider Electric Wiser

Knowledge Center

Events & webinars

Ideas

Blogs

Get Started

  • Ask the Community
  • Community Guidelines
  • Community User Guide
  • How-To & Best Practice
  • Experts Leaderboard
  • Contact Support
Brand-Logo
Subscribing is a smart move!
You can subscribe to this board after you log in or create your free account.
Forum-Icon

Create your free account or log in to subscribe to the board - and gain access to more than 10,000+ support articles along with insights from experts and peers.

Register today for FREE

Register Now

Already have an account? Login

Terms & Conditions Privacy Notice Change your Cookie Settings © 2025 Schneider Electric

This is a heading

With achievable small steps, users progress and continually feel satisfaction in task accomplishment.

Usetiful Onboarding Checklist remembers the progress of every user, allowing them to take bite-sized journeys and continue where they left.

of