Steam protocol

[Vulpix]

I don't have Ghazan's jabber

NVM! :p forum has it. Added him

[unitwobble]

Sorry I didn't have CrashDumper enabled when it happened, but Miranda crashed and all my Steam contacts were offline. I fixed it by added a new friend and had them send me a message.

Like an earlier poster mentioned, the incoming chat history is also getting corrupted, especially messages with URLs - don't know if it happened before the crash or after I ran dbchecker.

[Vulpix]

Sorry I didn't have CrashDumper enabled when it happened, but Miranda crashed and all my Steam contacts were offline. I fixed it by added a new friend and had them send me a message.

Like an earlier poster mentioned, the incoming chat history is also getting corrupted, especially messages with URLs - don't know if it happened before the crash or after I ran dbchecker.

Unitwobble, did you check the option to convert old messages to utf format in dbchecker? I think that the corruptions only happened when I did that.

[Robyer]

Unitwobble, did you check the option to convert old messages to utf format in dbchecker? I think that the corruptions only happened when I did that.

Are these corruptions reproducable? Because it would mean Steam proto still saves messages to DB with wrong flag.

[Vulpix]

Yeah you should talk to Watcher about it :X It happened to me twice, but then it stopped and I couldn't reproduce it.

Watcher tried it and it did happen to him as well, but then again it stopped happening.... so I don't know what causes it, I only know that I run dbchecker nowadays without the convert to utf8 (I used to check it previously) and I've not experienced those issues again.

It actually also happened with Tox. Unsane was the author of both plugins (I believe) but I don't think he knows why it happened either.

EDIT:

Here: http://forum.miranda-ng.org/index.php?topic=2499.0

[Robyer]

Vulpix, I see... Well, if I remember correctly,, that option in DbTool is for pre Miranda IM 0.7 profiles, where data was saved in utc2 instead of utf8, so that option was only to one-time upgrade. It has no meaning to run DbTool (i.e., DbChecker) with that option checked anyway

I think unsane forgot to set flag specifying in what codepage that message is saved, so DbChecker thought it's ucs2 and tried to convert it (again) to utf8. Then he probably fixed it in source code (because I don't see anything wrong there right now) and that's why it happened only twice/once for you/watcher, because it were old messages added by old plugin. Probably :-)

[unitwobble]

Unitwobble, did you check the option to convert old messages to utf format in dbchecker? I think that the corruptions only happened when I did that.

I think you nailed it on the head! I checked both the "convert UTF" and "mark all messages read" options.

[Vulpix]

Last 2 days, I keep getting disconnected _very_ often.

Looks like some kind of SSL connection failure... not sure what to do. My connection is fine (playing online game without issues + running ping and no timeouts.. I have fibre optics).

Code: [Select]

[23:27:50 1D78] [STEAM_1] (0000000010668328:860) Connection closed internal
[23:27:50 1D78] [STEAM_1] (0000000010668328:4294967295) Connection closed
[23:28:09 1168] [STEAM_1] (00000000106680C8:1796) Data received
HTTP/1.1 200 OK
[23:28:09 1168] [STEAM_1] (00000000106680C8:1796) Data received
date: Thu, 01 Jan 2015 22:27:53 GMT
expires: Thu, 01 Jan 2015 22:27:53 GMT
Content-Type: application/json; charset=UTF-8
Content-Length: 56

[23:28:09 1168] [STEAM_1] (00000000106680C8:1796) Data received
{
"pollid": 0,
"sectimeout": 20,
"error": "Timeout"
}
[23:28:09 1168] [STEAM_1] CSteamProto::PollingThread: https://api.steampowered.com/ISteamWebUserPresenceOAuth/Poll/v0001
[23:28:32 1168] [STEAM_1] (00000000106680C8:1796) Data received
HTTP/1.1 200 OK
[23:28:32 1168] [STEAM_1] (00000000106680C8:1796) Data received
date: Thu, 01 Jan 2015 22:28:13 GMT
expires: Thu, 01 Jan 2015 22:28:13 GMT
Content-Type: application/json; charset=UTF-8
Content-Length: 56

[23:28:32 1168] [STEAM_1] (00000000106680C8:1796) Data received
{
"pollid": 0,
"sectimeout": 20,
"error": "Timeout"
}
[23:28:32 1168] [STEAM_1] CSteamProto::PollingThread: https://api.steampowered.com/ISteamWebUserPresenceOAuth/Poll/v0001
[23:28:34 1168] SSL Server signaled SSL Shutdown
[23:28:34 1168] [STEAM_1] modules\netlib\netlibhttp.cpp 540: HttpPeekFirstResponseLine Failed (38 10)
[23:28:34 1168] [STEAM_1] modules\netlib\netlibhttp.cpp 540: HttpPeekFirstResponseLine Failed (38 9)
[23:28:34 1168] [STEAM_1] (00000000106680C8:1796) Connection closed internal
[23:28:34 1168] [STEAM_1] (00000000106680C8:4294967295) Connection closed
[23:28:34 1168] [STEAM_1] CSteamProto::PollingThread: https://api.steampowered.com/ISteamWebUserPresenceOAuth/Poll/v0001
[23:28:34 1168] [STEAM_1] Connection request to api.steampowered.com:443 (Flags 11)....
[23:28:34 1168] [STEAM_1] (00000000106680C8) Connecting to server api.steampowered.com:443....
[23:28:34 1168] [STEAM_1] (00000000106680C8) Connecting to ip 208.64.202.85:443 ....
[23:28:36 1168] [STEAM_1] (1796) Connected to api.steampowered.com:443
[23:28:36 1168] [STEAM_1] (1796 api.steampowered.com) Starting SSL negotiation
[23:28:37 1168] SSL Negotiation failure recieving data (10054)
[23:28:37 1168] [STEAM_1] (1796 api.steampowered.com) Failure to negotiate SSL connection
[23:28:37 1168] [STEAM_1] CSteamProto::PollingThread: https://api.steampowered.com/ISteamWebUserPresenceOAuth/Poll/v0001
[23:28:37 1168] [STEAM_1] (00000000106680C8:1796) Connection closed internal
[23:28:37 1168] [STEAM_1] (00000000106680C8) Connecting to server api.steampowered.com:443....
[23:28:37 1168] [STEAM_1] (00000000106680C8) Connecting to ip 208.64.202.85:443 ....
[23:28:37 1168] [STEAM_1] (1724) Connected to api.steampowered.com:443
[23:28:37 1168] [STEAM_1] (1724 api.steampowered.com) Starting SSL negotiation
[23:28:37 1168] SSL Negotiation failure recieving data (10054)
[23:28:37 1168] [STEAM_1] (1724 api.steampowered.com) Failure to negotiate SSL connection
[23:28:37 1168] [STEAM_1] CSteamProto::PollingThread: leaving
[23:28:37 1168] [STEAM_1] CSteamProto::PollingThread: unexpected termination; switching protocol to offline
[23:28:37 1168] [STEAM_1] CSteamProto::SetStatus: changing status from 40072 to 40071
[23:28:37 1168] [STEAM_1] CSteamProto::StopQueue: https://api.steampowered.com/ISteamWebUserPresenceOAuth/Logoff/v0001
[23:28:37 1168] [STEAM_1] Connection request to api.steampowered.com:443 (Flags 11)....
[23:28:37 1168] [STEAM_1] (00000000106680C8) Connecting to server api.steampowered.com:443....
[23:28:37 1168] [STEAM_1] (00000000106680C8) Connecting to ip 208.64.202.85:443 ....
[23:28:38 1D78] [STEAM_1] CSteamProto::QueueThread: leaving
[23:28:38 1168] [STEAM_1] (2736) Connected to api.steampowered.com:443
[23:28:38 1168] [STEAM_1] (2736 api.steampowered.com) Starting SSL negotiation
[23:28:38 1168] SSL Negotiation failure recieving data (10054)
[23:28:38 1168] [STEAM_1] (2736 api.steampowered.com) Failure to negotiate SSL connection
[23:28:39 0C40] KeepStatus: connection lost! (STEAM_1)

Any idea what the problem could be?

[Robyer]

Any idea what the problem could be?

No idea, maybe overload to steam servers during holidays? Nothing I can do about this.

[Vulpix]

No idea, maybe overload to steam servers during holidays? Nothing I can do about this.

You're likely right, no issues for the last day now.

GabeN pls.
Post Merge: 03 01 2015, 09:42:36@Robyer; while checking the message stream to see why I was getting disconnected, I saw this:

Code: [Select]

[23:22:19 1168] [STEAM_1] (00000000106680C8:1796) Data received
{
"pollid": 0,
"messages": [
{
"type": "typing",
"timestamp": 765686523,
"utc_timestamp": 1420150922,
"steamid_from": "<cnsrd>",
"text": ""
}
]
,
"messagelast": 82,
"timestamp": 765686523,
"utc_timestamp": 1420150922,
"messagebase": 81,
"sectimeout": 6,
"error": "OK"
}
I assume that means the api exposes "is typing" notifications! Do you think you could implement that in the steam protocol, (to both send the 'is typing' notifications and receive them?)

Thanks! ^_^

[unitwobble]

Last 2 days, I keep getting disconnected _very_ often.

The Steam Web API goes down alot especially during holidays. You can check the server statuses using: http://steamstat.us/

[Robyer]

I have some time now so you can bring me new issues/feature requests :-)

@Robyer; while checking the message stream to see why I was getting disconnected, I saw this:
I assume that means the api exposes "is typing" notifications! Do you think you could implement that in the steam protocol, (to both send the 'is typing' notifications and receive them?)

Interesting. What client was used on the other side? Classic Steam? I can check that typing notifications ;-)

[Vulpix]

Hello Robyer!

Yep it was the classic steam, and from netlog, the event looks like this:

[19:00:44 1E1C] [STEAM_1] (000000001059CB98:1752) Data received
{
   "pollid": 0,
   "messages": [
      {
         "type": "typing",
         "timestamp": 236970703,
         "utc_timestamp": 1423245626,
         "steamid_from": "the_actual_steam_id_goes_here",
         "text": ""
      }
   ]
   ,
   "messagelast": 82,
   "timestamp": 236970703,
   "utc_timestamp": 1423245626,
   "messagebase": 81,
   "sectimeout": 6,
   "error": "OK"
}

[Robyer]

Vulpix, implemented :-)

[Vulpix]

Awesome! Are we also sending typing notifications (miranda users ?).

Also, offline messages - I can send an offline message but if I sign in and there are some offline messages waiting for me, I don't receive them (I can "check them out" by opening the actual steam client and clicking "unread messages")