× Discuss about OFS, Temenos Connectors, Various OFS modes, OFS with Versions, OFS performance, Logging, EB.PHANTOM, OFS.SOURCE etc…

Arabic characters not shown properly after SMS reaches MQ ?

  • Moe_T24
  • Topic Author
  • Offline
  • Senior Member
  • Senior Member
  • T24 Technical
More
7 years 2 months ago #20817 by Moe_T24
Hello guys ,

We are sending SMS to client from T24 through IBM MQ then there is a .NET application that reads from SMS Queue and send SMS to client through some gatway.

The problem is when we try to send SMS in Arabic ( UTF-8) then message conent is shown like this :
U?U??¯U? U?U? ?¬?³?§?¨U? "?¨U?U?U??© "USD-500.00 "U??§?µ?¨?¬ ?±?

Knowing that when I check what goes out from T24 through log in Browser JBoss server , I can see the conent of message in arabic correctly . But after it reaches the MQ ,I browse the SMS then it is corrupted.

We send SMS from T24 in UTF-8 , also MQ is configured in UTF-8 and the receving the application reads the XML in utf-8.


I have been struggling with this problem ,and have been searching the internet for days but not luck .


Any insights on this would be appreciated.

Thanks .

Best Regards

Please Log in or Create an account to join the conversation.

  • Moe_T24
  • Topic Author
  • Offline
  • Senior Member
  • Senior Member
  • T24 Technical
More
7 years 2 months ago #20857 by Moe_T24
Any hint or idea guys will help me alot, thanks .

Best Regards

Please Log in or Create an account to join the conversation.

  • VK
  • VK's Avatar
  • Offline
  • Platinum Member
  • Platinum Member
  • Globus|G09-G13 TAFC|R05-R23 TAFJ|R19,R23-test
More
7 years 2 months ago #20859 by VK
Hi
I worked with other set of UTF characters and I noticed that, for example, CalldotNET interprets them wrongly... Could it be your .NET application?
We haven't tried to investigate further - just masked our characters (like '\unnnn'), that was sufficient for us.

Try to see where exactly your characters are messed up...

Cheers
VK

Please Log in or Create an account to join the conversation.

  • Moe_T24
  • Topic Author
  • Offline
  • Senior Member
  • Senior Member
  • T24 Technical
More
7 years 2 months ago #20862 by Moe_T24
Hi VK ,
I'm sure it's not my .NET application because it becomes corrupted when it arrives at MQ before my application even reads it .
All arabic characters in the SMS are messed up, no single character is shown correctly.

Also when I browse the message from MQ Explorer and open its properties , I can see that encoding has changed to something else not UTF-8.

Best Regards

Please Log in or Create an account to join the conversation.

  • VK
  • VK's Avatar
  • Offline
  • Platinum Member
  • Platinum Member
  • Globus|G09-G13 TAFC|R05-R23 TAFJ|R19,R23-test
More
7 years 2 months ago #20863 by VK
Then how exactly the message is sent from T24 to MQ?

Cheers
VK

Please Log in or Create an account to join the conversation.

  • Moe_T24
  • Topic Author
  • Offline
  • Senior Member
  • Senior Member
  • T24 Technical
More
7 years 2 months ago #20868 by Moe_T24
we send it using Delivery module .
The message goes from Browser's JBoss to MQ Jboss to MQ server.
What I know for sure that SMS went out from Browser in Arabic and I can view it in log correctly .

Best Regards

Please Log in or Create an account to join the conversation.

  • VK
  • VK's Avatar
  • Offline
  • Platinum Member
  • Platinum Member
  • Globus|G09-G13 TAFC|R05-R23 TAFJ|R19,R23-test
More
7 years 2 months ago #20872 by VK
Maybe then our solution can be applied?
Mask your utf-8 characters and convert them back to Arabic in your .NET application.

For example, we masked "LATIN CAPITAL LETTER D WITH STROKE" (Balkan one) to a string "\uc490" etc. When this construction passed the doubtful stage, it was converted back. Even full message can be "masked" in jBC using:
FMT(utf_string, 'MX')

Cheers
VK

Please Log in or Create an account to join the conversation.

  • Moe_T24
  • Topic Author
  • Offline
  • Senior Member
  • Senior Member
  • T24 Technical
More
7 years 1 month ago #20936 by Moe_T24
Hi VK ,

I will try to do so, but what 'MX' is for in FMT function ?
Can you explian this function a little more, have no idea about it.

Thanks.

Best Regards

Please Log in or Create an account to join the conversation.

  • VK
  • VK's Avatar
  • Offline
  • Platinum Member
  • Platinum Member
  • Globus|G09-G13 TAFC|R05-R23 TAFJ|R19,R23-test
More
7 years 1 month ago #20939 by VK

Please Log in or Create an account to join the conversation.

  • Moe_T24
  • Topic Author
  • Offline
  • Senior Member
  • Senior Member
  • T24 Technical
More
7 years 1 month ago #20953 by Moe_T24
Hi VK ,

I solved that by reading message from MQ as byte then convert it back to string UTF-8. It was working okay,then I found some messages still get corrupted.

So I tried your method of masking characters as Hexadecimal, and sent it to MQ, then I read those Hexadecimals in my application and convert it to UTF-8 string ,but it always get corrupted !
So that made me to think that message gets corrupted originally in routine ?! Is that possible ?

Best Regards

Please Log in or Create an account to join the conversation.

  • VK
  • VK's Avatar
  • Offline
  • Platinum Member
  • Platinum Member
  • Globus|G09-G13 TAFC|R05-R23 TAFJ|R19,R23-test
More
7 years 1 month ago #20955 by VK
Hi
could be... Introduce logging at every stage of your process and see...

Cheers
VK

Please Log in or Create an account to join the conversation.

  • Moe_T24
  • Topic Author
  • Offline
  • Senior Member
  • Senior Member
  • T24 Technical
More
7 years 1 month ago #20956 by Moe_T24
Forget about it...that was a mistake... I was playing with encoding in my VB.NET application and forgot to change it back to UTF-8 :)

It's working, I will keep testing ...Thanks.

Best Regards

Please Log in or Create an account to join the conversation.

Time to create page: 0.133 seconds