Sign UpSign Up   Sign InSign In Welcome Guest,
Live Chat Live Chat

Concatenate/Insert/Append workaround?

Last post 03-30-2010, 2:43 AM by aspose.notifier. 24 replies.
Page 1 of 2 (25 items)   1 2 Next >
Sort Posts: Previous Next
  •  01-07-2010, 8:07 AM 216019

    Concatenate/Insert/Append workaround? .NET

    Hi,

    We are trying to merge multiple pages into a large document, this varies between 20 pages and up to 100. The pages can be simple text pages and also pages filled with images.

    The job that is generating problems has 96 single pages (each 2mb ~ 4mb) with a combined total of 275mb. When we are merging the pages, the memory usage goes up to 800+mb. When we are lucky the proces can finish. If not the proces throws an OutOfMemoryException (and sometimes i get a NullReferenceException in Insert/Append. And i even got a 0-byte file without exception on my workstation while testing)
    When we are trying to do it in batches of 10 pages, we have no trouble. But when we want to merge the batches to get the document we want, it's still a no go :-(

    We tried inserting the MemoryManagement class posted in this forum, but this is after pdf.kit is finished. We are having trouble while pdf.kit is running.
    We notices this with Pdf.Kit 3.5.0, we updated to 4.0.0 and still have the same issue.

    Is there a workaround that allows us to finish this task with Pdf.Kit? Currently we can use aspose on our smaller products, but not on the bigger documents. Currently this is getting a serious problem for us.

    Sincerely,
    Fred


    ps: it is possible to flush data to disk while inserting/appending to reduce the memory used during this process?

     

     

     
  •  01-07-2010, 8:28 AM 216024 in reply to 216019

    Re: Concatenate/Insert/Append workaround?

    Hi Freddy,

    Thank you very much for considering Aspose.

    The extensive memory consumption issues with Append and Concatenate methods are already logged as PDFKITNET-13206 and PDFKITNET-13208 in our issue tracking system. Our team is looking to improve the process and reduce memory consumption. We'll update you once we enhance the process.

    Regarding your other issues like NullReferenceException and 0-byte output file, I would like to say that it might not be caused due to the same memory consumption issue. Can you please sort out the PDF files causing these particular problems and share with us? We'll investigate the issue at our end and update you accordingly.

    We're sorry for the inconvenience.
    Regards,


    Shahzad Latif - [Follow me on Twitter!]
    Support Developer/Developer Evangelist
    Aspose Sialkot Team
    Aspose - Your File Format Experts

    Keep in touch! We're on Twitter and Facebook
     
  •  01-07-2010, 9:44 AM 216037 in reply to 216024

    Re: Concatenate/Insert/Append workaround?

    Hello,

    Thank you for your quick response. I will send you a PM with a link to the pdf files.

    Sincerely,
    Fred

     
  •  01-08-2010, 5:23 AM 216185 in reply to 216037

    Re: Concatenate/Insert/Append workaround?

    Hi Freddy,

    Thank you for sharing the files. I have downloaded the sample files. We'll investigate the issue at our end and update you accordingly.

    If you have any other questions, please do let us know.
    Regards,


    Shahzad Latif - [Follow me on Twitter!]
    Support Developer/Developer Evangelist
    Aspose Sialkot Team
    Aspose - Your File Format Experts

    Keep in touch! We're on Twitter and Facebook
     
  •  01-12-2010, 10:13 PM 216774 in reply to 216185

    Re: Concatenate/Insert/Append workaround?

    Hi Freddy,

    I have tested the files you shared earlier, however I couldn't reproduce the NullReferenceException and 0-byte output file issues. Although, the memory and processor utilization is high, which is already logged.

    As the tests ran on these individual and pair of files, along with all the files at once, didn't show this problem at my end, so probably these issues are the by product of the extensive memory utilization at your end; and I hope once the resource utilization is improved, these issues will be resolved as well.

    Nevertheless, if you can share a little more details regarding your environment, we'll try to reproduce these issues using your particular scenario. Can you please share the details regarding your system specifications, OS details and .NET Framework version etc?

    We're sorry for the inconvenience.
    Regards,


    Shahzad Latif - [Follow me on Twitter!]
    Support Developer/Developer Evangelist
    Aspose Sialkot Team
    Aspose - Your File Format Experts

    Keep in touch! We're on Twitter and Facebook
     
  •  01-13-2010, 2:04 AM 216810 in reply to 216774

    Re: Concatenate/Insert/Append workaround?

    Hello,

    Thank you for your reply.

    In addition to the nullreference and 0-byte output files: i think they are caused by the outofmemory issue. When i'm testing with all the files i get the nullreference error in aspose.pdf.kit. When i reduce the file count i can reproduce the outofmemory error. (and sometimes a 0-byte output file)

    The server running the application/website is a server 2008 standard sp1, 32bit with 4gb ram running in vmware. Cpu is a quad xeon (E5420) at 2,5ghz.
    We use sql 2008 express, which uses about 1gb ram. We also have two sites running on the same server, the iis worker process is using 300ram and we use the .net 3.5 framework.

    All pdf manipulation is done in an application (generate / merging pages) and this is where we have troubles merging large pdf pages.

    If you need more information, please let me know.

    Sincerely,
    Freddy

     
  •  01-14-2010, 12:34 AM 217019 in reply to 216810

    Re: Concatenate/Insert/Append workaround?

    Hi Freddy,

    I have reproduced the NullReferenceException at my end on Windows Server 2008 with .NET 3.5. I have logged this issue as PDFKITNET-13481 in our issue  tracking system. Our team will look into this and you'll be updated via this forum thread once this is resolved.

    Moreover, I couldn't reproduce the 0-byte output due to the NullReferenceException mentioned above. We'll need to look into this once the high memory consumption and NullReferenceException issues are resolved and we're able to produce the file successfully.

    We're sorry for the inconvenience.
    Regards,




    Shahzad Latif - [Follow me on Twitter!]
    Support Developer/Developer Evangelist
    Aspose Sialkot Team
    Aspose - Your File Format Experts

    Keep in touch! We're on Twitter and Facebook
     
  •  01-14-2010, 7:08 AM 217122 in reply to 217019

    Re: Concatenate/Insert/Append workaround?

    Hi Freddy,

    I have also reproduced the OutOfMemory exception with Concatenate and Insert methods and logged these issues as PDFKITNET-13488 and PDFKITNET-13489 respectively. We'll update you once these issues are resolved.

    If you have any further questions, please do let us know.
    Regards,


    Shahzad Latif - [Follow me on Twitter!]
    Support Developer/Developer Evangelist
    Aspose Sialkot Team
    Aspose - Your File Format Experts

    Keep in touch! We're on Twitter and Facebook
     
  •  02-03-2010, 6:38 AM 220481 in reply to 217122

    Re: Concatenate/Insert/Append workaround?

    Hello Shahzad,

    Is there any news on the described issues?

    If there is no solution yet, is there any way that you can provide a workaround for inserting pages into large documents? (we just need a reliable function to insert pages, we don’t care about how it is done or how much time the function takes to complete)

    Currently we are stuck on the insert issue and the orders we need to process are getting more urgent.

    Feel free to PM me if that is more appropriate.

    Sincerely, 
    Fred

     
  •  02-03-2010, 11:15 AM 220563 in reply to 220481

    Re: Concatenate/Insert/Append workaround?

    Hi Freddy,

    I have contacted our development team to get their opinion regarding this situation. You'll be updated once the team shares some idea.

    We appreciate your patience.
    Regards,


    Shahzad Latif - [Follow me on Twitter!]
    Support Developer/Developer Evangelist
    Aspose Sialkot Team
    Aspose - Your File Format Experts

    Keep in touch! We're on Twitter and Facebook
     
  •  02-03-2010, 11:44 PM 220634 in reply to 220563

    Re: Concatenate/Insert/Append workaround?

    Hi Freddy,

    I would like to share with you that our team is working on this issue and we'll try to provide you the fix in the next monthly release due at the end of February 2010. I'm afraid, I can't share any workaround at the moment.

    We're very sorry for the inconvenience.
    Regards,


    Shahzad Latif - [Follow me on Twitter!]
    Support Developer/Developer Evangelist
    Aspose Sialkot Team
    Aspose - Your File Format Experts

    Keep in touch! We're on Twitter and Facebook
     
  •  03-02-2010, 9:50 AM 224905 in reply to 220634

    Re: Concatenate/Insert/Append workaround?

    I too am very interested in seeing the OutOfMemoryException resolved.
    Last year I had posted that I was having the same issue this thread:

    We are still having this issue today and this is major problem for us.  Seeing this resolved in the very near future will be GREATLY appreciated.
     
  •  03-03-2010, 4:56 AM 225062 in reply to 224905

    Re: Concatenate/Insert/Append workaround?

    Hi Eric,

    We're going to publish the latest version today. Please try it at your end, once it is published, and share if it works for you or not.

    We're sorry for the inconvenience and looking forward to help you out.
    Regards,


    Shahzad Latif - [Follow me on Twitter!]
    Support Developer/Developer Evangelist
    Aspose Sialkot Team
    Aspose - Your File Format Experts

    Keep in touch! We're on Twitter and Facebook
     
  •  03-03-2010, 8:23 AM 225099 in reply to 225062

    Re: Concatenate/Insert/Append workaround?

    Sounds good.  Any idea what time the update will be published?

    Thanks

     
  •  03-03-2010, 9:27 AM 225115 in reply to 225099

    Re: Concatenate/Insert/Append workaround?

    Hi Eric,

    We're working on the latest release and hopefully it'll be available in a few hours.

    Regards,


    Shahzad Latif - [Follow me on Twitter!]
    Support Developer/Developer Evangelist
    Aspose Sialkot Team
    Aspose - Your File Format Experts

    Keep in touch! We're on Twitter and Facebook
     
Page 1 of 2 (25 items)   1 2 Next >
View as RSS news feed in XML