Re: SQL2005: shred the feeds or store as XML?



Thanks Michael and Hilary.

The first thing I did was review Michael's blog [1] and observe much in
general that is going to prove insightful but nothing, nada, zip, zero, as
in where's da' beef with discussions I'm sure you'll both agree is rapidly
becoming fundamental to the way content is created and transported across
the web; syndicated web feeds? Lots of big picture stuff going on for sure.

I'll thank Microsoft for finally coining a useful and understandable term
"WebFeed" and note the WebFeed [rss|xml] files are being kept in the file
system where they can be accessible to aggregators and readers using HTTP as
well as developers using APIs but to provide a searchable interface, support
analytics and other benefits to those whose WebFeeds are being hosted
shredding elements into relational tables is I have to conclude a "must do"
process. Along comes SQL 2005 and the whole WebFeed can be stored in a table
and I'm frozen with indecision.

Since WebFeeds have been around since the time when SQL 2005 was first being
planned and are about to become commodities I am still astounded that there
is nothing specific that Microsoft has built into the box or has been
publishing and it again, specifically, it sure seems .NET bloggers are mum
or have not coalesced at this time.

To respond to Michael's and Hilary's replies, I would say as a matter of
context, feed items are either being modified frequently as certain vertical
markets may change price lists, special offers and so on which is content if
a feed item itself. A given channel will be modified rarely.

Others such as bloggers are adding gruesome chunks of content on a whimsical
basis. The chunks themselves are rarely if ever modified but one or more
comments may be appended to a chunk at any given arbitrary point in time.
Don't ya' just like a sure thing :-)

These are my observations and others are needed. Refactor my insights please
:-)

<%= Clinton Gallagher

[1] http://sqljunkies.com/weblog/mrys/



"Michael Rys [MSFT]" <mrys@xxxxxxxxxxxxxxxxxxxx> wrote in message
news:eK1x5teBGHA.3984@xxxxxxxxxxxxxxxxxxxxxxx
> Another "rule" is whether you often repurpose part of the data in
> different ways (shred it) or you mainly retrieve the full XML document
> (keep it whole). And then you may as well promote properties or define
> indices for faster access...
>
> Best regards
> Michael
>
> "Hilary Cotter" <hilary.cotter@xxxxxxxxx> wrote in message
> news:%23Mpoy7dBGHA.2568@xxxxxxxxxxxxxxxxxxxxxxx
>>I think the "rule" is that if you need to update the data frequently you
>>get better performance if you shred it. Otherwise store it as XML in the
>>XML data type.
>>
>> --
>> Hilary Cotter
>> Looking for a SQL Server replication book?
>> http://www.nwsu.com/0974973602.html
>>
>> Looking for a FAQ on Indexing Services/SQL FTS
>> http://www.indexserverfaq.com
>>
>> "clintonG" <csgallagher@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx> wrote in
>> message news:ORLQ%23BcBGHA.3840@xxxxxxxxxxxxxxxxxxxxxxx
>>>I hope I can get some insight into this issue. I'm developing a feed
>>>builder and intend to host feed data to make it available for search and
>>>analytics and so on. What's my best strategy? Shred the feeds or use
>>>SQL2005 to store the whole file as XML? Any white papers or other
>>>documents about this specific concern?
>>>
>>> <%= Clinton Gallagher
>>>
>>
>>
>
>


.



Relevant Pages

  • Re: locale specific input
    ... that some feeds contain items in different languages. ... surprised if they are sometimes mixed with items from different languages. ... I'm using an rss library to parse the xml and give me simple objects to work ... My understanding is that XML is by default encoded in UTF-8, and an XML parser should assume it's receiving UTF-8 data until it receives an encoding declaration stating otherwise. ...
    (comp.lang.java)
  • Re: locale specific input
    ... that some feeds contain items in different languages. ... It seems that only a few are in Japanese, ... surprised if they are sometimes mixed with items from different languages. ... I'm using an rss library to parse the xml and give me simple objects to work ...
    (comp.lang.java)
  • Parent/child orchestrations and enveloping
    ... In the Parent orchestration, recieve an xml file with a Feed element. ... Feeds ... Feed xml schema envelope the Entry xml schema properly and it debatches ...
    (microsoft.public.biztalk.general)
  • Re: SQL2005: shred the feeds or store as XML?
    ... Michael ... Otherwise store it as XML in the ... Shred the feeds or use ... >>SQL2005 to store the whole file as XML? ...
    (microsoft.public.sqlserver.xml)