Examples: WeatherExtension: Forecast and CityName not updating

LucasHawk · ‎2018-03-01

I am trying to test the results of the developers guide. I have the SetupProcessor running, and the UpdateProcessor set to run every 15min. It looks like I am getting currentconditions updating. but the forecast is not. Also, using SoapUI, I updated the CityCode, but the CityName is still not coming back as 'Paris'.

This was happening with my code, so I completely deleted it. I downloaded the GitHub solution into my source folder for VS (and rebuilt a new dll, replacing the old one and starting/stopping the SmartConnector srevice). So, I should have an exactly correct build. I deleted the processors in the portal, and rebuilt and restarted them. The problem persists.

I also created a new API key on OWM.org, thinking maybe I had incorrect permissions on their site. No dice.

Below is what I see in the portal (Apologies for the scrolling...), and a few seemingly interesting things stand out to me:

1) CurrentConditions are working fine, and Forecast days are not working.

2) The history item in CurrentConditions gets two values every time the data updates. It writes a good value as soon as it comes in, and then immediately calls it 'Uncertain' and relogs it. It seems to be good for about a millisecond. This does not seem what was intended.

3) The history persisted from my original code to the new hotness from github. How is this? I guess the history object exists in the SmartConnector folder somewhere? (Where the dll's are...) From this, I can see in forecast that the only time any of those values were updated was when SetupProcessor originally built the object, at 9:03.

I am confoosed. It seems the code is not running the update on the forecast, but.. it should be. I am using the github code. Or is there something else I need to delete and recreate in the dll folder?

Thanks for any help!

Root ContainerItem

EWS Id: RootContainer
Name: Root ContainerItem
Description: All folders derive from here
Type: Server
ContainerItems (2)
- CurrentConditions
  - EWS Id: CurrentConditions
  - Name: CurrentConditions
  - Description:
  - Type: Folder
  - ContainerItems (0)
  - ValueItems (4)
    - CurrentConditions.LastUpdated
      - EWS Id: CurrentConditions.LastUpdated
      - Name: CurrentConditions.LastUpdated
      - Description:
      - Type: Date Time
      - Value: 03/01/2018 11:00 AM
      - Writeable: Read Only
      - Forceable: Not Forceable
      - State: Uncertain
      - Unit:
      - Last Modified: 03/01/2018 11:16:59 AM
    - CurrentConditions.Pressure
      - EWS Id: CurrentConditions.Pressure
      - Name: CurrentConditions.Pressure
      - Description:
      - Type: Double
      - Value: 992
      - Writeable: Read Only
      - Forceable: Not Forceable
      - State: Uncertain
      - Unit: hPa
      - Last Modified: 03/01/2018 11:16:59 AM
    - CurrentConditions.RelativeHumidity
      - EWS Id: CurrentConditions.RelativeHumidity
      - Name: CurrentConditions.RelativeHumidity
      - Description:
      - Type: Integer
      - Value: 64
      - Writeable: Read Only
      - Forceable: Not Forceable
      - State: Uncertain
      - Unit: %
      - Last Modified: 03/01/2018 11:16:59 AM
    - CurrentConditions.Temperature
      - EWS Id: CurrentConditions.Temperature
      - Name: CurrentConditions.Temperature
      - Description:
      - Type: Double
      - Value: 1.75
      - Writeable: Read Only
      - Forceable: Not Forceable
      - State: Uncertain
      - Unit: °C
      - Last Modified: 03/01/2018 11:16:58 AM
  - AlarmItems (0)
  - HistoryItems (3)
    - CurrentConditions.Pressure.History
      - EWS Id: CurrentConditions.Pressure.History
      - Name: CurrentConditions.Pressure.History
      - Description:
      - Type: Double
      - Unit: hPa
      - ValueItem: CurrentConditions.Pressure
      - Is Active: True
      - History (18)
        03/01/2018 9:07:46 AM
        Value: 1011
        State: Good
        Timestamp: 03/01/2018 9:07:46 AM
        03/01/2018 9:07:47 AM
        Value: 1011
        State: Uncertain
        Timestamp: 03/01/2018 9:07:47 AM
        03/01/2018 9:17:32 AM
        03/01/2018 9:17:32 AM
        03/01/2018 9:42:13 AM
        03/01/2018 9:42:14 AM
        03/01/2018 10:43:10 AM
        03/01/2018 10:43:11 AM
        03/01/2018 10:43:16 AM
        03/01/2018 10:43:16 AM
        03/01/2018 10:45:37 AM
        03/01/2018 10:45:37 AM
        03/01/2018 10:52:11 AM
        03/01/2018 10:52:11 AM
        03/01/2018 10:58:14 AM
        03/01/2018 10:58:14 AM
        03/01/2018 11:16:59 AM
        Value: 992
        State: Good
        Timestamp: 03/01/2018 11:16:59 AM
        03/01/2018 11:16:59 AM
        Value: 992
        State: Uncertain
        Timestamp: 03/01/2018 11:16:59 AM
    - CurrentConditions.RelativeHumidity.History
    - CurrentConditions.Temperature.History
- Forecast
  - EWS Id: Forecast
  - Name: Forecast
  - Description:
  - Type: Folder
  - ContainerItems (3)
    - Forecast.Day1
      - EWS Id: Forecast.Day1
      - Name: Forecast.Day1
      - Description:
      - Type: Folder
      - ContainerItems (0)
      - ValueItems (6)
        Forecast.Day1.Date
        EWS Id: Forecast.Day1.Date
        Name: Forecast.Day1.Date
        Description:
        Type: Date Time
        Value: 12/31/1969 6:00 PM
        Writeable: Read Only
        Forceable: Not Forceable
        State: Uncertain
        Unit:
        Last Modified: 03/01/2018 9:03:37 AM
        Forecast.Day1.Description
        EWS Id: Forecast.Day1.Description
        Name: Forecast.Day1.Description
        Description:
        Type: String
        Value:
        Writeable: Read Only
        Forceable: Not Forceable
        State: Uncertain
        Unit:
        Last Modified: 03/01/2018 9:03:37 AM
        Forecast.Day1.HighTemp
        EWS Id: Forecast.Day1.HighTemp
        Name: Forecast.Day1.HighTemp
        Description:
        Type: Double
        Value: 0
        Writeable: Read Only
        Forceable: Not Forceable
        State: Uncertain
        Unit: °C
        Last Modified: 03/01/2018 9:03:37 AM
        Forecast.Day1.LowTemp
        EWS Id: Forecast.Day1.LowTemp
        Name: Forecast.Day1.LowTemp
        Description:
        Type: Double
        Value: 0
        Writeable: Read Only
        Forceable: Not Forceable
        State: Uncertain
        Unit: °C
        Last Modified: 03/01/2018 9:03:37 AM
        Forecast.Day1.Pressure
        EWS Id: Forecast.Day1.Pressure
        Name: Forecast.Day1.Pressure
        Description:
        Type: Double
        Value: 0
        Writeable: Read Only
        Forceable: Not Forceable
        State: Uncertain
        Unit: hPa
        Last Modified: 03/01/2018 9:03:37 AM
        Forecast.Day1.RelativeHumidity
        EWS Id: Forecast.Day1.RelativeHumidity
        Name: Forecast.Day1.RelativeHumidity
        Description:
        Type: Integer
        Value: 0
        Writeable: Read Only
        Forceable: Not Forceable
        State: Uncertain
        Unit: %
        Last Modified: 03/01/2018 9:03:37 AM
      - AlarmItems (0)
      - HistoryItems (0)
    - Forecast.Day2
    - Forecast.Day3
  - ValueItems (0)
  - AlarmItems (0)
  - HistoryItems (0)
ValueItems (2)
AlarmItems (0)
HistoryItems (0)

JeffBowman · ‎2018-03-01

Hi Lucas,

Can you verify if ALL forecast data is being set to 'Uncertain' or is it just 1 days worth?

I would almost say, this is now a good time for you to get familiar with the program called 'Fiddler'. It is an HTTP optimized traffic sniffer. With this, you should be able to see the requests that the SmartConnector extension is sending to the web service, and the response that is returned from the web service. It might help to figure out what may be going on.

Download Fiddler Web Debugging Tool for Free by Telerik

Regards,

-Jeff

See Answer In Context

JeffBowman · ‎2018-03-01

Hi Lucas,

The current conditions update and forecast update happen in separate calls. Do you see anything in your log file that would say why the second is failing? Failures are being logged.

As far as why the History Records remained. These are stored in the database, and if you didn't delete the EWS server that the processor uses (it uses the 'name' as the key to decide if a new one should be created or not), then it would have been persisted. Try deleting the EWS server then running the Setup Processor again and see if the History records go away.

Regards,

-Jeff

LucasHawk · ‎2018-03-01

Forgive me - where are the logs?

JeffBowman · ‎2018-03-01

Hi Lucas,

You can find the SmartConnector logs in:

C:\ProgramData\SmartConnector\Logs

Regards,

-Jeff

LucasHawk · ‎2018-03-01

Found em - Thanks.

Here are the errors I am seeing:

2018-03-01 11:16:59.1889,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 11:16:59.1970,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 11:16:59.2227,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 11:16:59.2401,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

JeffBowman · ‎2018-03-01

Hi Lucas,

Did you delete the original EWS server, and re-run the SetupProcessor before running the update processor again?

Regards,

-Jeff

LucasHawk · ‎2018-03-01

I think so, but just to verify, I redid all that (deleted the EWS server, then ran setup, then ran update). Below is the resulting log entries:

2018-03-01 12:51:34.7427,Status,Service,<no principal>,Stopping EWS Server http://localhost:5300/SmartConnectorWeatherService,

2018-03-01 12:51:49.7165,Info,WorkerThread,<no principal>,Weather Setup Processor,Started,

2018-03-01 12:51:49.7236,Error,Processor,<no principal>,The EwsServer was not located or the credentials you supplied were incorrect. Please verify your credentials and try again.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ConnectExisting(String ewsServerName, String userName, String password)

at SmartConnector.WeatherExtension.WeatherProcessorBase.get_DataAdapter()

,[],

2018-03-01 12:51:49.7536,Status,Service,<no principal>,Starting EWS Server http://localhost:5300/SmartConnectorWeatherService,

2018-03-01 12:51:49.8128,Status,Service,<no principal>,Stopping EWS Server http://localhost:5300/SmartConnectorWeatherService,

2018-03-01 12:51:49.8128,Status,Service,<no principal>,Starting EWS Server http://localhost:5300/SmartConnectorWeatherService,

2018-03-01 12:51:50.2920,Info,WorkerThread,<no principal>,Weather Setup Processor,Ended successfully,

2018-03-01 12:51:50.2920,Info,WorkerThread,<no principal>,Weather Setup Processor,Next run will be at next SmartConnector startup,

2018-03-01 12:52:06.0309,Info,WorkerThread,<no principal>,Weather Update Processor,Started,

2018-03-01 12:52:06.4626,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 12:52:06.4626,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 12:52:06.4741,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 12:52:06.4947,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 12:52:06.5198,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 12:52:06.5424,Info,WorkerThread,<no principal>,Weather Update Processor,Ended successfully,

2018-03-01 12:52:06.5424,Info,WorkerThread,<no principal>,Weather Update Processor,Next run will be at 2018-03-01T18:52:17,

2018-03-01 12:52:17.0851,Info,WorkerThread,<no principal>,Weather Update Processor,Started,

2018-03-01 12:52:17.3685,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 12:52:17.3685,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 12:52:17.3685,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 12:52:17.4022,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 12:52:17.4207,Error,Processor,<no principal>,Item was not found and may have been deleted.

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.AssertEntityNotDeleted(Object item)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState_Internal(EwsValueItem toModify, EwsValueStateEnum newState)

at Mongoose.Ews.Server.Data.EwsServerDataAdapter.ModifyValueItemState(String valueItemAlternateId, EwsValueStateEnum newState)

at SmartConnector.WeatherExtension.ServerHelper.MakeDataServedUncertain(EwsServerDataAdapter adapter, String cityName, String logCategory)

,[],

2018-03-01 12:52:17.4408,Info,WorkerThread,<no principal>,Weather Update Processor,Ended successfully,

2018-03-01 12:52:17.4408,Info,WorkerThread,<no principal>,Weather Update Processor,Next run will be at 2018-03-01T19:07:17,

JeffBowman · ‎2018-03-01

Hi Lucas,

Can you verify if ALL forecast data is being set to 'Uncertain' or is it just 1 days worth?

I would almost say, this is now a good time for you to get familiar with the program called 'Fiddler'. It is an HTTP optimized traffic sniffer. With this, you should be able to see the requests that the SmartConnector extension is sending to the web service, and the response that is returned from the web service. It might help to figure out what may be going on.

Download Fiddler Web Debugging Tool for Free by Telerik

Regards,

-Jeff

LucasHawk · ‎2018-03-01

Just verified - ALL of the Forecast data is no bueno. I wIll look into fiddler and report back.

LucasHawk · ‎2018-03-02

I fiddled with the fiddler, and I am getting 'invalid API key' in the response to my forecast requests (see below, yellow/green is bad, black is good). I have tried generating a new one, but that did not work. There is language on their website alluding to only requesting data once every 10 minutes. I am not sure if that is across all your different requests, or specific to the actual data (i.e. - you want temp in Paris and Temp in carrollton. will that be count as two requests in ten minutes? or one each?)

So, I guess this is just something on their end. I am fine rolling with this, as I am trying to learn how to use SmartConnector, not deal with data providers.

Thanks for your help! (And thanks for Fiddler! I have always used WireShark, but I like this much better.)