Diff for Design for fix topicmerge

--- Fri, 2008-03-21 15:07 by robander
+++ Tue, 2008-12-16 15:08 by robander
 Topic merge in previous releases are written in xsl which calls document() to load different xml files into memory. But xsl transformation engine won't release the document tree once it gets loaded. This caused out of memory exception when merging large documents. Another bug in current topic merge is that the intermediate merged file lost the structure information in dita map and caused the structured toc can't be reflected in output.<br />
 <strong>Design Description:</strong><br />
-Use Java SAX to implement topic merge. When meeting with topicref in ditamap, the processor will read the dita topic and change all of its references to dita topic files into internal references. Then the processor will write the topic content with all of topicref information into the intermediate file. <br />
+<em>Removed information. The description did not accurately describe the latest topicmerge program and was causing confusion.</em>
-For example,<br />
-a.ditamap looks like<br />
-&lt;map&gt;<br />
-  &lt;topicref href=&quot;a.dita&quot;&gt;<br />
-    &lt;topicref href=&quot;b.dita&quot;/&gt;<br />
-  &lt;/topicref&gt;<br />
-&lt;/map&gt;
-</p>
-<p>
-a.dita looks like<br />
-&lt;topic id=&quot;a&quot;&gt;<br />
-  &lt;title&gt;a.dita&lt;/title&gt;<br />
-  &lt;body&gt;<br />
-    &lt;p&gt;&lt;xref href=&quot;b.dita#b/test&quot;/&gt;&lt;/p&gt;<br />
-  &lt;/body&gt;<br />
-&lt;/topic&gt;
-</p>
-<p>
-b.dita looks like<br />
-&lt;topic id=&quot;b&quot;&gt;<br />
-  &lt;title&gt;b.dita&lt;/title&gt;<br />
-  &lt;body&gt;<br />
-    &lt;p id=&quot;test&quot;&gt;test paragraph&lt;/p&gt;<br />
-  &lt;/body&gt;<br />
-&lt;/topic&gt;
-</p>
-<p>
-The merged output should be like this.<br />
-&lt;map&gt;<br />
-  &lt;topicref href=&quot;a.dita&quot;&gt;<br />
-    &lt;topic id=&quot;unique_1&quot;&gt;<br />
-      &lt;title&gt;a.dita&lt;/title&gt;<br />
-      &lt;body&gt;<br />
-        &lt;p&gt;&lt;xref href=&quot;unique_3&quot;/&gt;&lt;/p&gt;<br />
-      &lt;/body&gt;<br />
-    &lt;/topic&gt;<br />
-    &lt;topicref href=&quot;b.dita&quot;&gt;<br />
-      &lt;topic id=&quot;unique_2&quot;&gt;<br />
-        &lt;title&gt;b.dita&lt;/title&gt;<br />
-        &lt;body&gt;<br />
-          &lt;p id=&quot;unique_3&quot;&gt;test paragraph&lt;/p&gt;<br />
-        &lt;/body&gt;<br />
-      &lt;/topic&gt;<br />
-    &lt;/topicref&gt;<br />
-  &lt;/topicref&gt;<br />
-&lt;/map&gt;
-</p>
-<p>
-The merged output above will be first stored in memory as string. If there is not additional xsl applied to this result, it will be generated to the merged file. Otherwise the user defined xsl should be applied to the result and output to merged file.
-</p>
-<p>
-Duplicate resolution:<br />
-XSL-FO doesn't allow duplicate id. When a dita file is topicref'd more than once in ditamap, we need to mark up the duplicate version of content in the merged output and assign different ids to them.<br />
-During the processing, we will use a hashtable to record the mapping between original id and the unique id we assigned in the merged result. In the exmaple above, the id of the paragraph in b.dita is b.dita#b/test. The unique id we assigned in merge result is unique_3. So there will be an entry in the hashtable. The key of the entry is b.dita#b/test and the value is unique_3. <br />
-If we modified the ditamap to include b.dita twice as following:
-</p>
-<p>
-&lt;map&gt;<br />
-  &lt;topicref href=&quot;a.dita&quot;&gt;<br />
-    &lt;topicref href=&quot;b.dita&quot;/&gt;<br />
-  &lt;/topicref&gt;<br />
-  &lt;topicref href=&quot;b.dita&quot;/&gt;<br />
-&lt;/map&gt;<br />
-then the second b.dita will be record as b.dita(d&lt;random_num&gt;) . In the hash table there will be key value b.dita(d&lt;random_num&gt;) and b.dita(d&lt;random_num&gt;)#b/test. &lt;random_num&gt;is generated randomly. It is not likely to have the same &lt;random_num&gt;for different duplicate content if the author doesn't include the same file in ditamap that much. The possible merged result looks like:<br />
-&lt;map&gt;<br />
-  &lt;topicref href=&quot;a.dita&quot;&gt;<br />
-    &lt;topic id=&quot;unique_1&quot;&gt;<br />
-      &lt;title&gt;a.dita&lt;/title&gt;<br />
-      &lt;body&gt;<br />
-        &lt;p&gt;&lt;xref href=&quot;unique_3&quot;/&gt;&lt;/p&gt;<br />
-      &lt;/body&gt;<br />
-    &lt;/topic&gt;<br />
-    &lt;topicref href=&quot;b.dita&quot;&gt;<br />
-      &lt;topic id=&quot;unique_2&quot;&gt;<br />
-        &lt;title&gt;b.dita&lt;/title&gt;<br />
-        &lt;body&gt;<br />
-          &lt;p id=&quot;unique_3&quot;&gt;test paragraph&lt;/p&gt;<br />
-        &lt;/body&gt;<br />
-      &lt;/topic&gt;<br />
-    &lt;/topicref&gt;<br />
-  &lt;/topicref&gt;<br />
-  &lt;topicref href=&quot;b.dita(d123523)&quot;&gt;<br />
-      &lt;topic id=&quot;unique_4&quot;&gt;<br />
-        &lt;title&gt;b.dita&lt;/title&gt;<br />
-        &lt;body&gt;<br />
-          &lt;p id=&quot;unique_5&quot;&gt;test paragraph&lt;/p&gt;<br />
-        &lt;/body&gt;<br />
-      &lt;/topic&gt;<br />
-    &lt;/topicref&gt;<br />
-&lt;/map&gt;
-</p>
-<p>
-If there is a &lt;xref&gt; in b.dita which refer to the paragraph in the same file the merged result could be:
-</p>
-<p>
-&lt;map&gt;<br />
-  &lt;topicref href=&quot;a.dita&quot;&gt;<br />
-    &lt;topic id=&quot;unique_1&quot;&gt;<br />
-      &lt;title&gt;a.dita&lt;/title&gt;<br />
-      &lt;body&gt;<br />
-        &lt;p&gt;&lt;xref href=&quot;unique_3&quot;/&gt;&lt;/p&gt;<br />
-      &lt;/body&gt;<br />
-    &lt;/topic&gt;<br />
-    &lt;topicref href=&quot;b.dita&quot;&gt;<br />
-      &lt;topic id=&quot;unique_2&quot;&gt;<br />
-        &lt;title&gt;b.dita&lt;/title&gt;<br />
-        &lt;body&gt;<br />
-          &lt;p id=&quot;unique_3&quot;&gt;test paragraph&lt;/p&gt;<br />
-          &lt;xref href=&quot;unique_3&quot;/&gt;<br />
-        &lt;/body&gt;<br />
-      &lt;/topic&gt;<br />
-    &lt;/topicref&gt;<br />
-  &lt;/topicref&gt;<br />
-  &lt;topicref href=&quot;b.dita(d123523)&quot;&gt;<br />
-      &lt;topic id=&quot;unique_4&quot;&gt;<br />
-        &lt;title&gt;b.dita&lt;/title&gt;<br />
-        &lt;body&gt;<br />
-          &lt;p id=&quot;unique_5&quot;&gt;test paragraph&lt;/p&gt;<br />
-          &lt;xref href=&quot;unique_5&quot;/&gt;<br />
-        &lt;/body&gt;<br />
-      &lt;/topic&gt;<br />
-    &lt;/topicref&gt;<br />
-&lt;/map&gt;<br />
-The duplicate &lt;xref&gt; should point to the duplicate &lt;p&gt; because they are in the same file.
 </p>

Current revision:

Design for fix topicmerge

Note: This information has not been updated since original creation, and may no longer be up to date. It is still here for reference. Up to date information on the toolkit can be found here: The DITA Open Toolkit

Requirement/Problem:
Topic merge in previous releases are written in xsl which calls document() to load different xml files into memory. But xsl transformation engine won't release the document tree once it gets loaded. This caused out of memory exception when merging large documents. Another bug in current topic merge is that the intermediate merged file lost the structure information in dita map and caused the structured toc can't be reflected in output.
Design Description:
Removed information. The description did not accurately describe the latest topicmerge program and was causing confusion.

Diff for Design for fix topicmerge

Design for fix topicmerge

Search

Download DITA

Browse

Recent Content

Subscribe

Site info

Who's who

Navigation

Hosted by:

Sponsored by:

Sponsored links: