Page 1 of 1

Headers / Database Size

Posted: Sat Oct 11, 2003 8:37 pm
by maso
Hi,

I was trying out NewsPro with newsfeeds. I set it to downlaod a single group off five servers and noticed it had downloaded 150meg worth of headers off them all. The group has about 750,000 articles but it still seemed quite a lot of data.

Is this normal or am I downloading more than I need to?

Thanks
MaSo

Posted: Sat Oct 11, 2003 9:11 pm
by edfreeman
Doesn't seem like too much to me. That's one of the problems with subscribing to Newsfeeds, you either download a ton of headers from all their servers or try to use message id direct and suppress headers, which can result it servers that don't even contain the groups being "pinged" for articles that aren't there. I had a working arrangement, but was still downloading headers from a bunch of their servers. Finally gave up and went to a good single server provider.

Posted: Sun Oct 12, 2003 3:55 am
by bruce73
FWIW, my workaround for minimizing headers using Newfeeds servers is to only pull headers for each newsgroup from the server that carries the most, or nearly the most, headers for that particular group (as indicated by right-clicking on the newsgroup name in the Newsgroups List). I then use message id for the rest of the appropriate servers for the type of group I'm downloading from. If the completion is incomplete, then I'll do an XPAT.

This works well for me, as I'm only interested in large files with many parts, so I don't think I miss seeing anything by not pulling headers initially from more than one server.