if your xml is validated by a schema, then you are probably not using the
same tag in other places. Most xml parsers throw errors on schemas that use
documents into a single doc for batching. we used streaming quite
effectively. the files were in the 20MB range.
Loading them into memory caused serious problems... only streaming was a
representative of my employer.
I do not answer questions on behalf of my employer. I'm just a
programmer helping programmers.
"Niklas E" <raven_tln0sp4m@hotmail.com> wrote in message
news:%23SVKWZWIFHA.2456@TK2MSFTNGP09.phx.gbl...
> Thanks for your suggestions. Are forward only xml-readers eating a lot of
> memory as well? If it is a complex structure and you are using a
> streamreader, I guess you have to watch the start and end tags yourself.
> If
> the tag below the root which I want to split on is used in other places, I
> guess you could run into problems.
>
> The documents right now are about 50MB and they will grow.
>
> BrainProgrammer:
> We have been using Notepad so far, but we are tired of doing that all the
> time... If you have some code, please send it. Always nice to see examples
> and get ideas.
>
> Best regards
> Niklas Engfelt
>
>
> "Nick Malik [Microsoft]" <nickmalik@hotmail.nospam.com> wrote in message
> news:es2dndD0bIOCkLTfRVn-ig@comcast.com...
>> If you load a very very very large file as an XML doc, you are likely to
> run
>> out of memory.
>>
>> Just stream it in, creating a new document every 1000 records or so.
>>
>> --
>> --- Nick Malik [Microsoft]
>> MCSD, CFPS, Certified Scrummaster
>>
http://blogs.msdn.com/nickmalik >>
>> Disclaimer: Opinions expressed in this forum are my own, and not
>> representative of my employer.
>> I do not answer questions on behalf of my employer. I'm just a
>> programmer helping programmers.
>> --
>> "BrianProgrammer" <Brian@rpgamerica.com> wrote in message
>> news:1109971669.553373.270130@o13g2000cwo.googlegroups.com...
>> > If you load it as a xml document, clone the file. trim and truncate the
>> > nodes as nessesary. You can even remove whole branches of data at once.
>> >
>> > It is fast and simple.
>> >
>> > If this is a standaalone data file, for a one shot use, notepad. :P
>> >
>> > I can send code if needed.
>> >
>>
>>
>
>