BULK WRITE

  • gangstervano
  • Topic Author
  • Visitor
  • Visitor
2 years 11 months ago #23569 by gangstervano
BULK WRITE was created by gangstervano
Hi,

We need to import much data into T24 applications (about 150GB). Is there a way to make it fast? Something like BULK INSERT in SQL?

For example, something like imaginary function MATWRITEBLK(FN.FILE, REC.ARRAY, ID.ARRAY, ERR) or anything similar?

Please Log in or Create an account to join the conversation.

  • VK
  • VK's Avatar
  • Offline
  • Platinum Member
  • Platinum Member
  • Globus:G9-G13|TAFC:R05-R23|TAFJ:R19,R23,R24:test
More
2 years 11 months ago #23571 by VK
Replied by VK on topic BULK WRITE
Hi
I think you can try to use OFS.BULK.MANAGER...
What kind of data is it?
 

Cheers
VK

Please Log in or Create an account to join the conversation.

  • gangstervano
  • Topic Author
  • Visitor
  • Visitor
2 years 11 months ago - 2 years 11 months ago #23572 by gangstervano
Replied by gangstervano on topic BULK WRITE
Hi,

We have R06 T24 release.

Due to this we think we don't have routine OFS.BULK.MANAGER.

When we try to call it we got:
BASE debugger-> ** Error [ SUBROUTINE_CALL_FAIL ] ** Unable to perform CALL to subroutine OFS.BULK.MANAGER , Line 68 , Source KMB. M.IVAN.TEST Press C to continue or Q to quit
Trap from an error message, error message name = SUBROUTINE_CALL_FAIL


jshow output:
jsh test ~ -->jshow OFS.BULK.MANAGER
jsh test ~ -->

We want to upload many large XMLs to our local applications (about 150GB).
Last edit: 2 years 11 months ago by gangstervano.

Please Log in or Create an account to join the conversation.

  • VK
  • VK's Avatar
  • Offline
  • Platinum Member
  • Platinum Member
  • Globus:G9-G13|TAFC:R05-R23|TAFJ:R19,R23,R24:test
More
2 years 11 months ago - 2 years 11 months ago #23573 by VK
Replied by VK on topic BULK WRITE
Hi
if it's your local applications and you are sure about referential integrity of data, you can just use WRITE (if you're under jBASE). Another option - pre-convert XMLs to plain text (equal to future records structure) and use COPY FROM ... TO ..

Make also sure (if target files are J4 type) that the sizing is correct.

If you're under RDBMS, maybe its own tools would be faster...
 

Cheers
VK
Last edit: 2 years 11 months ago by VK.
The following user(s) said Thank You: gangstervano

Please Log in or Create an account to join the conversation.

Time to create page: 0.069 seconds